Use Video To Video with Comfy Router

API Reference for moonvalley/video-to-video, served by Comfy Router from Moonvalley.

Quick start

Create a key at platform.comfy.org/profile/api-keys and export it as COMFY_API_KEY. The Python and TypeScript snippets use the Comfy SDKs (pip install comfy-sdk, npm install @comfyorg/sdk); the cURL snippet is the same call over raw HTTP. Model ID: moonvalley/video-to-video Endpoint: POST https://api.comfy.org/v2/models/moonvalley/video-to-video

from comfy_sdk import Comfy

# Reads COMFY_API_KEY from the environment. Each call sends a fresh
# Idempotency-Key and waits up to 10 minutes for the finished result.
with Comfy() as client:
    result = client.models.run(
        "moonvalley/video-to-video",
        {
            "control_type": "motion_control",
            "prompt_text": "Apply motion control to enhance this video",
            "video_url": "https://test-videos.co.uk/vids/bigbuckbunny/mp4/h264/360/Big_Buck_Bunny_360_10s_1MB.mp4",
        },
    )

print(result)

import { comfy } from "@comfyorg/sdk";

// Reads COMFY_API_KEY from the environment. Each call sends a fresh
// Idempotency-Key and waits up to 10 minutes for the finished result.
const { data } = await comfy.models.run("moonvalley/video-to-video", {
  control_type: "motion_control",
  prompt_text: "Apply motion control to enhance this video",
  video_url: "https://test-videos.co.uk/vids/bigbuckbunny/mp4/h264/360/Big_Buck_Bunny_360_10s_1MB.mp4",
});

console.log(data);

curl https://api.comfy.org/v2/models/moonvalley/video-to-video \
  -H "X-API-Key: $COMFY_API_KEY" \
  -H "Idempotency-Key: $(uuidgen)" \
  -H "Content-Type: application/json" \
  -d "{\"control_type\": \"motion_control\", \"prompt_text\": \"Apply motion control to enhance this video\", \"video_url\": \"https://test-videos.co.uk/vids/bigbuckbunny/mp4/h264/360/Big_Buck_Bunny_360_10s_1MB.mp4\"}"

Schema

Input

string

required

Supported types for video controlPossible values: motion_control, pose_control

string

Url to control image

object

integer

default:"6"

Intensity of motion controlFormat: int32

number

default:"10"

Guidance scale for generation controlFormat: float

string

Negative prompt text

integer

default:"9"

Random seed for generation (default: random)

integer

default:"80"

Number of denoising steps

boolean

default:"true"

Whether to use negative prompts

string

required

Describes the video to generate

string

required

Url to control video

string

Optional webhook URL for notifications

Generated from the schema Router serves at GET /v2/models/moonvalley/video-to-video/openapi.json, the same document it validates a call against before the request reaches the provider.

Output

Router does not publish an output schema for this model.

Examples

Input

{
  "control_type": "motion_control",
  "prompt_text": "Apply motion control to enhance this video",
  "video_url": "https://test-videos.co.uk/vids/bigbuckbunny/mp4/h264/360/Big_Buck_Bunny_360_10s_1MB.mp4"
}

Before you ship

The snippets above are the shortest working call. Three things are the same for every model and are documented once on the Comfy Router headers page: send an Idempotency-Key on every paid call and reuse it when you retry, expect the connection to be held up to Router’s 10 minute deadline, and keep X-Comfy-Request-Id from every response. The SDKs do all three for you; the cURL tab does none of them. On failure, X-Comfy-Error-Type names the bucket, and a 422 means the body failed the model’s schema and was never billed.

Headers

Authentication, idempotency, request IDs, error buckets, retry pacing, spend limits.

Quick Start

Typed error handling in Python and TypeScript, reading the 422, walking the catalog.

Limitations

What Router does not do today, and what to use instead.

Develop with Comfy

Deploy ComfyUI

Run Workflows

Comfy Router

Comfy CLI

Specifications

Use Video To Video with Comfy Router

Quick start

Schema

Input

Output

Examples

Input

Before you ship

Headers

Quick Start

Limitations

​Quick start

​Schema

​Input

​Output

​Examples

​Input

​Before you ship

Headers

Quick Start

Limitations

Quick start

Schema

Input

Output

Examples

Input

Before you ship