Model Highlights
- Audio-driven dance generation: Generates dance movements directly from music without manual keyframing or motion capture
- Hierarchical framework: Two-stage architecture (global + local) for coherent body motion and detailed movement refinement
- Music-synchronized output: Dance motions are naturally aligned to the input audio’s rhythm and tempo
- Style control: Configurable dance style and motion amplitude for creative direction
- Minute-scale generation: Produces long-form, coherent dance videos with temporal consistency across the full duration
Workflow Overview
The Wan Dancer workflow takes two inputs: a reference image of the character and an audio file. It generates two video outputs: a global output preview showing the overall dance structure, and a final refined output with enhanced motion details.Wan Dancer Workflow
1. Download Workflow File
Update your ComfyUI to the latest version, then download and drag the workflow file into ComfyUI, or find “Wan Dancer” in the Template Library underWorkflow → Browse Templates → Video.
Run in Comfy Cloud
Open in Comfy Cloud
Download Workflow
Download JSON or search “Wan Dancer” in Template Library
2. Download Input Materials
Reference Image: blue_dancer.png
Input character image for dance generation. Download and use this image, or replace with your own.
Reference Audio
Reference audio track for dance synchronization. Download and use this audio, or replace with your own music.
3. Manually Download Models
Diffusion Models LoRA Text Encoder CLIP Vision VAE4. Workflow Instructions
-
Load the reference image: Use the
Load Imagenode to upload your character image. The default input usesblue_dancer.png. -
Load the audio file: Use the
Load Audionode to upload your music or audio track. The default input useswan_dancer_reference_audio.mp3. -
Configure dance parameters:
dance_style: Select the dance style for the output videomotion_amplitude: Control the intensity of dance movementsaudio_duration: Set to match the duration of your input audiofinal_duration: Choose the final output video duration
-
Configure output dimensions:
widthandheight: Set the resolution of the output video. Choose values appropriate for your GPU’s available VRAM.
-
Verify model paths: Make sure the model selector widgets point to the correct model files:
global_model: Should loadwan2.2_dancer_14b_global_fp8_scaled.safetensorslocal_model: Should loadwan2.2_dancer_14b_local_fp8_scaled.safetensorslightning_lora: Should loadlightx2v_I2V_14B_480p_cfg_step_distill_rank64_bf16.safetensorsclip_vision: Should loadclip_vision_h.safetensors
-
Run generation: Click the
Runbutton or use the shortcutCtrl(Cmd) + Enterto execute video generation.
5. Output
The workflow produces two video outputs:- Global output preview: Shows the overall dance structure generated by the global model
- Final output: The refined dance video after local model enhancement
SaveVideo nodes.
Model Information
Wan Dancer is an open source model released under the Apache 2.0 license. The model weights are available on Hugging Face:- Comfy-Org/Wan-Dancer: Global and local diffusion models
Report Issues
If you encounter runtime errors or unexpected behavior:- Ensure ComfyUI is updated to the latest version
- Check that all required models are downloaded and placed in the correct directories
- For Desktop/Cloud users: updates follow stable releases, so nightly-supported models may not be available immediately