Runway is a company focused on generative AI, providing powerful video generation capabilities. Currently, ComfyUI has integrated the Runway API, allowing you to directly use the related nodes in ComfyUI for video generation. Currently, ComfyUI natively integrates the following Runway video generation models:
  • Runway Gen3a turbo
  • Runway Gen4 turbo
  • Runway First Last Frame to video
To use the API nodes, you need to ensure that you are logged in properly and using a permitted network environment. Please refer to the API Nodes Overview section of the documentation to understand the specific requirements for using the API nodes.
Make sure your ComfyUI is updated.Workflows in this guide can be found in the Workflow Templates. If you can’t find them in the template, your ComfyUI may be outdated.(Desktop version’s update will delay sometime)If nodes are missing when loading a workflow, possible reasons:
  1. You are not using the latest ComfyUI version(Nightly version)
  2. You are using Stable or Desktop version (Latest changes may not be included)
  3. Some nodes failed to import at startup

​
Gen3a turbo Image-to-Video Workflow

​
1. Workflow File Download

The video below contains workflow information in its metadata. Please download and drag it into ComfyUI to load the corresponding workflow.

Download Json Format Workflow File

 Download the image below as input image ComfyUI Runway gen3a turbo image to video Input Image

​
2. Complete the Workflow Execution Step by Step

ComfyUI Runway gen3a turbo image to video Step Guide You can refer to the numbers in the image to complete the basic image-to-video workflow execution:
  1. In the Load Image node, load the provided input image
  2. In the Runway Gen3a turbo node, set the prompt to describe video content, modify the duration parameter to set video length, modify the ratio parameter to set video aspect ratio
  3. Click the Run button, or use the shortcut Ctrl(cmd) + Enter to execute video generation.
  4. After waiting for the API to return results, you can view the generated video in the Save Video node (right-click to save). The corresponding video will also be saved to the ComfyUI/output/ directory.

​
Gen4 turbo Image-to-Video Workflow

​
1. Workflow File Download

The video below contains workflow information in its metadata. Please download and drag it into ComfyUI to load the corresponding workflow.

Download Json Format Workflow File

 Download the image below as input image ComfyUI Runway gen4 turbo image to video Input Image

​
2. Complete the Workflow Execution Step by Step

ComfyUI Runway gen4 turbo image to video Step Guide You can refer to the numbers in the image to complete the basic image-to-video workflow execution:
  1. In the Load Image node, load the provided input image
  2. In the Runway Gen4 turbo node, set the prompt to describe video content, modify the duration parameter to set video length, modify the ratio parameter to set video aspect ratio
  3. Click the Run button, or use the shortcut Ctrl(cmd) + Enter to execute video generation.
  4. After waiting for the API to return results, you can view the generated video in the Save Video node (right-click to save). The corresponding video will also be saved to the ComfyUI/output/ directory.

​
First-Last Frame Video Generation Workflow

​
1. Workflow File Download

The video below contains workflow information in its metadata. Please download and drag it into ComfyUI to load the corresponding workflow.

Download Json Format Workflow File

 Download the images below as input images ComfyUI Runway gen4 turbo image to video Input Image ComfyUI Runway gen4 turbo image to video Input Image

​
2. Complete the Workflow Execution Step by Step

ComfyUI Runway gen4 turbo image to video Step Guide You can refer to the numbers in the image to complete the basic first-last frame to video workflow execution:
  1. In the Load Image node, load the starting frame
  2. In the Load Image node, load the ending frame
  3. In the Runway First-Last-Frame to Video node, set the prompt to describe video content, modify the duration parameter to set video length, modify the ratio parameter to set video aspect ratio
  4. Click the Run button, or use the shortcut Ctrl(cmd) + Enter to execute video generation.
  5. After waiting for the API to return results, you can view the generated video in the Save Video node (right-click to save). The corresponding video will also be saved to the ComfyUI/output/ directory.