Skip to main content
This node was added to support the Alibaba Wan Fun Control model for video generation, and was added after this commit.
  • Purpose: Prepare the conditioning information needed for video generation, using the Wan 2.1 Fun Control model.
The WanFunControlToVideo node is a ComfyUI addition designed to support Wan Fun Control models for video generation, aimed at utilizing WanFun control for video creation. This node serves as a preparation point for essential conditioning information and initializes the center point of the latent space, guiding the subsequent video generation process using the Wan 2.1 Fun model. The node’s name clearly indicates its function: it accepts various inputs and converts them into a format suitable for controlling video generation within the WanFun framework. The node’s position in the ComfyUI node hierarchy indicates that it operates in the early stages of the video generation pipeline, focusing on manipulating conditioning signals before actual sampling or decoding of video frames.

Inputs

Parameter NameDescriptionRequiredData TypeDefault Value
positiveStandard ComfyUI positive conditioning data, typically from a “CLIP Text Encode” node. The positive prompt describes the content, subject matter, and artistic style that the user envisions for the generated video.YesCONDITIONINGN/A
negativeStandard ComfyUI negative conditioning data, typically generated by a “CLIP Text Encode” node. The negative prompt specifies elements, styles, or artifacts that the user wants to avoid in the generated video.YesCONDITIONINGN/A
vaeRequires a VAE (Variational Autoencoder) model compatible with the Wan 2.1 Fun model family, used for encoding and decoding image/video data.YesVAEN/A
widthThe desired width of output video frames in pixels, with a default value of 832, minimum value of 16, maximum value determined by nodes.MAX_RESOLUTION, and a step size of 16.YesINT832
heightThe desired height of output video frames in pixels, with a default value of 480, minimum value of 16, maximum value determined by nodes.MAX_RESOLUTION, and a step size of 16.YesINT480
lengthThe total number of frames in the generated video, with a default value of 81, minimum value of 1, maximum value determined by nodes.MAX_RESOLUTION, and a step size of 4.YesINT81
batch_sizeThe number of videos generated in a single batch, with a default value of 1, minimum value of 1, and maximum value of 4096.YesINT1
clip_vision_output(Optional) Visual features extracted by a CLIP vision model, allowing for visual style and content guidance.NoCLIP_VISION_OUTPUTNone
start_image(Optional) An initial image that influences the beginning of the generated video.NoIMAGENone
control_video(Optional) Allows users to provide a preprocessed ControlNet reference video that will guide the motion and potential structure of the generated video.NoIMAGENone

Outputs

Parameter NameDescriptionData Type
positiveProvides enhanced positive conditioning data, including encoded start_image and control_video.CONDITIONING
negativeProvides negative conditioning data that has also been enhanced, containing the same concat_latent_image.CONDITIONING
latentA dictionary containing an empty latent tensor with the key “samples”.LATENT
This documentation was AI-generated. If you find any errors or have suggestions for improvement, please feel free to contribute! Edit on GitHub