Skip to main content
Wan2.2-Fun-Camera-Control is a next-generation video generation and camera control model developed by Alibaba PAI. By introducing innovative Camera Control Codes and combining deep learning with multimodal conditional inputs, it generates high-quality videos that adhere to predefined camera motion conditions. The model is released under the Apache 2.0 license, allowing for commercial use. Key Features:
  • Camera Motion Control: Supports various camera motion modes, including Pan Up, Pan Down, Pan Left, Pan Right, Zoom In, Zoom Out, and combinations thereof.
  • High-Quality Video Generation: Based on the Wan2.2 architecture, it outputs cinematic-quality videos.
Here are the relevant model weights and code repository:

​
Wan2.2 Fun Camera Control: Video Generation Workflow Example

Make sure your ComfyUI is updated.Workflows in this guide can be found in the Workflow Templates. If you can’t find them in the template, your ComfyUI may be outdated.If nodes are missing when loading a workflow, possible reasons:
  1. You are not using the latest ComfyUI version (Nightly version)
  2. Some nodes failed to import at startup
The workflow provided includes two versions:
  1. Using the Wan2.2-Lightning 4-step LoRA via lightx2v: This may result in reduced video dynamics but offers faster generation.
  2. The fp8_scaled version without the acceleration LoRA.
Below are the timing results tested on an RTX4090D 24GB GPU for 640*640 resolution and 81-frame length: While the 4-step LoRA improves initial user experience, it may reduce video dynamism. By default, the accelerated LoRA version is enabled. To switch workflows, select the nodes and press Ctrl+B.

​
1. Workflow and Asset Download

Download the video or JSON file below and drag it into ComfyUI to load the corresponding workflow. The workflow will prompt you to download the models. Wan2.2 Fun Camera Control workflow

Run on Comfy Cloud

Open in Comfy Cloud

Download Workflow

Download JSON or search “Wan2.2 Fun Camera” in Template Library
Please download the image below, which we will use as input. Input materials

video_wan2_2_14B_fun_camera_start_image.jpg

Starting frame for the video generation. Download and use this image, or replace with your own.
The following models can be found in Wan_2.2_ComfyUI_Repackaged: Diffusion Models

wan2.2_fun_camera_high_noise_14B_fp8_scaled.safetensors

High noise diffusion model for Wan2.2 Fun Camera

wan2.2_fun_camera_low_noise_14B_fp8_scaled.safetensors

Low noise diffusion model for Wan2.2 Fun Camera
Wan2.2-Lightning LoRA (Optional, for acceleration)

wan2.2_i2v_lightx2v_4steps_lora_v1_high_noise.safetensors

4-step acceleration LoRA for high noise model

wan2.2_i2v_lightx2v_4steps_lora_v1_low_noise.safetensors

4-step acceleration LoRA for low noise model
VAE

wan_2.1_vae.safetensors

Wan2.1 VAE for encoding/decoding
Text Encoder

umt5_xxl_fp8_e4m3fn_scaled.safetensors

FP8 scaled text encoder
File save location

​
3. Complete the Workflow Step-by-Step

Wan2.2 Fun Camera Control Workflow Steps
This workflow uses LoRA. Ensure the Diffusion model and LoRA are consistent; high noise and low noise models and LoRA must be paired accordingly.
  1. High noise model and LoRA loading
  • Ensure the Load Diffusion Model node loads wan2.2_fun_camera_high_noise_14B_fp8_scaled.safetensors
  • Ensure the LoraLoaderModelOnly node loads wan2.2_i2v_lightx2v_4steps_lora_v1_high_noise.safetensors
  1. Low noise model and LoRA loading
  • Ensure the Load Diffusion Model node loads wan2.2_fun_camera_low_noise_14B_fp8_scaled.safetensors
  • Ensure the LoraLoaderModelOnly node loads wan2.2_i2v_lightx2v_4steps_lora_v1_low_noise.safetensors
  1. Ensure the Load CLIP node loads umt5_xxl_fp8_e4m3fn_scaled.safetensors
  2. Ensure the Load VAE node loads wan_2.1_vae.safetensors
  3. Upload the starting frame in the Load Image node
  4. Modify the Prompt (both Chinese and English are acceptable)
  5. Set camera control parameters in the WanCameraEmbedding node:
    • Camera Motion: Select the camera motion type (Zoom In, Zoom Out, Pan Up, Pan Down, Pan Left, Pan Right, Static, etc.)
    • Width/Height: Set video resolution
    • Length: Set the number of video frames (default is 81 frames)
    • Speed: Set video speed (default is 1.0)
  6. Click the Run button or use the shortcut Ctrl(cmd) + Enter to execute video generation