Skip to main content
Wan Dancer is an audio-driven dance video generation model built on the Wan 2.2 architecture. It uses a hierarchical framework with global and local expert models to generate coherent, expressive dance videos synchronized to input music. Given a reference image of a character and an audio track, Wan Dancer produces a dance video where the character performs movements that match the rhythm and style of the music. The global model captures overall dance structure and body coordination, while the local model refines fine-grained motion details for natural, high-quality output.

Model Highlights

  • Audio-driven dance generation: Generates dance movements directly from music without manual keyframing or motion capture
  • Hierarchical framework: Two-stage architecture (global + local) for coherent body motion and detailed movement refinement
  • Music-synchronized output: Dance motions are naturally aligned to the input audio’s rhythm and tempo
  • Style control: Configurable dance style and motion amplitude for creative direction
  • Minute-scale generation: Produces long-form, coherent dance videos with temporal consistency across the full duration

Workflow Overview

The Wan Dancer workflow takes two inputs: a reference image of the character and an audio file. It generates two video outputs: a global output preview showing the overall dance structure, and a final refined output with enhanced motion details.
Make sure your ComfyUI is updated.Workflows in this guide can be found in the Workflow Templates. If you can’t find them in the template, your ComfyUI may be outdated.If nodes are missing when loading a workflow, possible reasons:
  1. You are not using the latest ComfyUI version (Nightly version)
  2. Some nodes failed to import at startup

Wan Dancer Workflow

Wan Dancer: Music to Dance

Generate minute-scale coherent dance videos from music using a hierarchical Wan Dancer framework. Input a music file and reference image to produce synchronized dance videos. Wan Dancer: Music to Dance workflow preview

Run on Comfy Cloud

Open in Comfy Cloud

Download Workflow

Download JSON or search “Wan Dancer” in Template Library
Input materials Upload these files to the matching nodes:

blue_dancer.png

LoadImage node 547 · blue_dancer.png

wan_dancer_reference_audio.mp3

LoadAudio node 548 · wan_dancer_reference_audio.mp3
blue_dancer.png

3. Manually Download Models

Diffusion Models LoRA Text Encoder CLIP Vision VAE

4. Workflow Instructions

Wan Dancer samples 149 frames at once and requires significant VRAM. The default workflow outputs a 5-second video. Make sure you have a GPU with sufficient VRAM before running this workflow.
  1. Load the reference image: Use the Load Image node to upload your character image. The default input uses blue_dancer.png.
  2. Load the audio file: Use the Load Audio node to upload your music or audio track. The default input uses wan_dancer_reference_audio.mp3.
  3. Configure dance parameters:
    • dance_style: Select the dance style for the output video
    • motion_amplitude: Control the intensity of dance movements
    • audio_duration: Set to match the duration of your input audio
    • final_duration: Choose the final output video duration
  4. Configure output dimensions:
    • width and height: Set the resolution of the output video. Choose values appropriate for your GPU’s available VRAM.
  5. Verify model paths: Make sure the model selector widgets point to the correct model files:
    • global_model: Should load wan2.2_dancer_14b_global_fp8_scaled.safetensors
    • local_model: Should load wan2.2_dancer_14b_local_fp8_scaled.safetensors
    • lightning_lora: Should load lightx2v_I2V_14B_480p_cfg_step_distill_rank64_bf16.safetensors
    • clip_vision: Should load clip_vision_h.safetensors
  6. Run generation: Click the Run button or use the shortcut Ctrl(Cmd) + Enter to execute video generation.

5. Output

The workflow produces two video outputs:
  • Global output preview: Shows the overall dance structure generated by the global model
  • Final output: The refined dance video after local model enhancement
Both outputs are saved automatically via the SaveVideo nodes.

Model Information

Wan Dancer is an open source model released under the Apache 2.0 license. The model weights are available on Hugging Face:

Report Issues

If you encounter runtime errors or unexpected behavior:
  • Ensure ComfyUI is updated to the latest version
  • Check that all required models are downloaded and placed in the correct directories
  • For Desktop/Cloud users: updates follow stable releases, so nightly-supported models may not be available immediately
Report issues to: ComfyUI/issues