Skip to main content
Endpoint: POST https://fal.run/bytedance/seedance-2.0/reference-to-video Endpoint ID: bytedance/seedance-2.0/reference-to-video

Try it in the Playground

Run this model interactively with your own prompts.

Quick Start

import fal_client

def on_queue_update(update):
    if isinstance(update, fal_client.InProgress):
        for log in update.logs:
           print(log["message"])

result = fal_client.subscribe(
    "bytedance/seedance-2.0/reference-to-video",
    arguments={
        "prompt": "An octopus finds a football in the ocean and excitedly calls its octopus friends to come and play. Cut scene to an octopus football game under the sea."
    },
    with_logs=True,
    on_queue_update=on_queue_update,
)
print(result)

Examples

Room is slowly getting filled from empty state to fully organized with furnitures. Camera is fixed timelapse.
Sunlight filters into a crystalline cave, illuminating formations that hum softly. Air currents brush through the formations, their gentle vibrations creating ethereal melodies throughout the cavern. The serene simplicity of the cave reveals nature’s delicate, musical architecture where tiny cleaner…

Capabilities

  • Text prompt input
  • Duration control
  • Aspect ratio control
  • Reproducible generation (seed)

API Reference

Input Schema

prompt
string
required
The text prompt used to generate the video.
image_urls
list<string>
Reference images to guide video generation. Refer to them in the prompt as @Image1, @Image2, etc. Supported formats: JPEG, PNG, WebP. Max 30 MB per image. Up to 9 images. Total files across all modalities must not exceed 12.
video_urls
list<string>
Reference videos to guide video generation. Refer to them in the prompt as @Video1, @Video2, etc. Supported formats: MP4, MOV. Up to 3 videos, combined duration must be between 2 and 15 seconds, total size under 50 MB. Each video must be between ~480p (640x640) and ~720p (834x1112) in resolution.
audio_urls
list<string>
Reference audio to guide video generation. Refer to them in the prompt as @Audio1, @Audio2, etc. Supported formats: MP3, WAV. Up to 3 files, combined duration must not exceed 15 seconds. Max 15 MB per file.If audio is provided, at least one reference image or video is required.
resolution
ResolutionEnum
default:"720p"
Video resolution - 480p for faster generation, 720p for balance. Default value: "720p"Possible values: 480p, 720p
duration
DurationEnum
default:"auto"
Duration of the video in seconds. Supports 4 to 15 seconds, or auto to let the model decide based on the prompt. Default value: "auto"Possible values: auto, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15
aspect_ratio
AspectRatioEnum
default:"auto"
The aspect ratio of the generated video. Use 16:9 for landscape, 9:16 for portrait/vertical, 1:1 for square, 21:9 for ultrawide cinematic, or auto to let the model decide. Default value: "auto"Possible values: auto, 21:9, 16:9, 4:3, 1:1, 3:4, 9:16
generate_audio
boolean
default:"true"
Whether to generate synchronized audio for the video, including sound effects, ambient sounds, and lip-synced speech. The cost of video generation is the same regardless of whether audio is generated or not. Default value: true
seed
integer
Random seed for reproducibility. Note that results may still vary slightly even with the same seed.
end_user_id
string
The unique user ID of the end user.

Output Schema

video
File
required
The generated video file.
seed
integer
required
The seed used for generation.

Input Example

{
  "prompt": "An octopus finds a football in the ocean and excitedly calls its octopus friends to come and play. Cut scene to an octopus football game under the sea.",
  "image_urls": [
    "https://v3b.fal.media/files/b/0a8eba37/Cqg-4Uwzyz4DELfceT1CF_a17e588773ec45b1a9e6f100a787b80b.jpg"
  ],
  "resolution": "720p",
  "duration": "auto",
  "aspect_ratio": "auto",
  "generate_audio": true
}

Output Example

{
  "video": {
    "url": "https://storage.googleapis.com/falserverless/example_outputs/bytedance/seedance_2/output.mp4"
  },
  "seed": 42
}

Limitations

  • resolution restricted to: 480p, 720p
  • aspect_ratio restricted to: auto, 21:9, 16:9, 4:3, 1:1, 3:4, 9:16