Runway is a company focused on generative AI, providing powerful image generation capabilities. Its models support features such as style transfer, image extension, and detail control. Currently, ComfyUI has integrated the Runway API, allowing you to directly use the related nodes in ComfyUI for image generation. In this guide, we will walk you through the following workflows:
  • Text-to-image
  • Reference-to-image
To use the API nodes, you need to ensure that you are logged in properly and using a permitted network environment. Please refer to the API Nodes Overview section of the documentation to understand the specific requirements for using the API nodes.
Make sure your ComfyUI is updated.Workflows in this guide can be found in the Workflow Templates. If you can’t find them in the template, your ComfyUI may be outdated.(Desktop version’s update will delay sometime)If nodes are missing when loading a workflow, possible reasons:
  1. You are not using the latest ComfyUI version(Nightly version)
  2. You are using Stable or Desktop version (Latest changes may not be included)
  3. Some nodes failed to import at startup

​
Runway Image Text-to-Image Workflow

​
1. Workflow File Download

The image below contains workflow information in its metadata. Please download and drag it into ComfyUI to load the corresponding workflow. ComfyUI Runway Image Text to Image

​
2. Complete the Workflow Execution Step by Step

ComfyUI Runway Image Text to Image Step Guide You can refer to the numbers in the image to complete the basic text-to-image workflow execution:
  1. In the Runway Text to Image node, input your prompt in the prompt field
  2. (Optional) Adjust the ratio setting to set different output aspect ratios
  3. Click the Run button, or use the shortcut Ctrl(cmd) + Enter to execute image generation.
  4. After waiting for the API to return results, you can view the generated image in the Save Image node (right-click to save). The corresponding image will also be saved to the ComfyUI/output/ directory.

​
Runway Image Reference-to-Image Workflow

​
1. Workflow and Input Image Download

The image below contains workflow information in its metadata. Please download and drag it into ComfyUI to load the corresponding workflow. ComfyUI Runway Image Reference to Image Download the image below for input ComfyUI Runway Image Reference to Image Input

​
2. Complete the Workflow Execution Step by Step

ComfyUI Runway Image Reference to Image Step Guide You can refer to the numbers in the image to complete the basic reference-to-image workflow execution:
  1. In the Load Image node, load the provided input image
  2. In the Runway Text to Image node, input your prompt in the prompt field and adjust dimensions
  3. Click the Run button, or use the shortcut Ctrl(cmd) + Enter to execute image generation.
  4. After waiting for the API to return results, you can view the generated image in the Save Image node (right-click to save). The corresponding image will also be saved to the ComfyUI/output/ directory.