Generate videos from an image and text using Bytedance's Seedance 1.0 Pro model.
This endpoint allows you to provide a starting image frame along with a text prompt to generate a video. The model will animate the image based on the text description. You can optionally keep the original aspect ratio of the input image.
The client provides a convenient way to interact with the model API.
npm install --save @fal-ai/clientSet FAL_KEY as an environment variable in your runtime.
export FAL_KEY="YOUR_API_KEY"The client API handles the API submit protocol. It will handle the request status updates and return the result when the request is completed.
import { fal } from "@fal-ai/client";
const result = await fal.subscribe("fal-ai/bytedance/seedance/v1/pro/image-to-video", {
input: {
prompt: "A skier glides over fresh snow, joyously smiling while kicking up large clouds of snow as he turns. Accelerating gradually down the slope, the camera moves smoothly alongside.",
image_url: "https://storage.googleapis.com/falserverless/example_inputs/seedance_pro_i2v_img.jpg"
},
logs: true,
onQueueUpdate: (update) => {
if (update.status === "IN_PROGRESS") {
update.logs.map((log) => log.message).forEach(console.log);
}
},
});
console.log(result.data);
console.log(result.requestId);The API uses an API Key for authentication. It is recommended you set the FAL_KEY environment variable in your runtime when possible.
import { fal } from "@fal-ai/client";
fal.config({
credentials: "YOUR_FAL_KEY"
});The client API provides a convenient way to submit requests to the model.
import { fal } from "@fal-ai/client";
const { request_id } = await fal.queue.submit("fal-ai/bytedance/seedance/v1/pro/image-to-video", {
input: {
prompt: "A skier glides over fresh snow, joyously smiling while kicking up large clouds of snow as he turns. Accelerating gradually down the slope, the camera moves smoothly alongside.",
image_url: "https://storage.googleapis.com/falserverless/example_inputs/seedance_pro_i2v_img.jpg"
},
webhookUrl: "https://optional.webhook.url/for/results",
});You can fetch the status of a request to check if it is completed or still in progress.
import { fal } from "@fal-ai/client";
const status = await fal.queue.status("fal-ai/bytedance/seedance/v1/pro/image-to-video", {
requestId: "764cabcf-b745-4b3e-ae38-1200304cf45b",
logs: true,
});Once the request is completed, you can fetch the result. See the Output Schema for the expected result format.
import { fal } from "@fal-ai/client";
const result = await fal.queue.result("fal-ai/bytedance/seedance/v1/pro/image-to-video", {
requestId: "764cabcf-b745-4b3e-ae38-1200304cf45b"
});
console.log(result.data);
console.log(result.requestId);Some attributes in the API accept file URLs as input. Whenever that's the case you can pass your own URL or a Base64 data URI.
You can pass a Base64 data URI as a file input. The API will handle the file decoding for you. Keep in mind that for large files, this alternative although convenient can impact the request performance.
You can also pass your own URLs as long as they are publicly accessible. Be aware that some hosts might block cross-site requests, rate-limit, or consider the request as a bot.
We provide a convenient file storage that allows you to upload files and use them in your requests. You can upload files using the client API and use the returned URL in your requests.
import { fal } from "@fal-ai/client";
const file = new File(["Hello, World!"], "hello.txt", { type: "text/plain" });
const url = await fal.storage.upload(file);Read more about file handling in our file upload guide.
prompt string* requiredThe text prompt used to generate the video
aspect_ratio AspectRatioEnumThe aspect ratio of the generated video Default value: "auto"
Possible enum values: 21:9, 16:9, 4:3, 1:1, 3:4, 9:16, auto
resolution ResolutionEnumVideo resolution - 480p for faster generation, 720p for balance, 1080p for higher quality Default value: "1080p"
Possible enum values: 480p, 720p, 1080p
duration DurationEnumDuration of the video in seconds Default value: "5"
Possible enum values: 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12
camera_fixed booleanWhether to fix the camera position
seed integerRandom seed to control video generation. Use -1 for random.
enable_safety_checker booleanIf set to true, the safety checker will be enabled. Disabling it requires account authorization; unauthorized requests are always checked. Default value: true
num_frames integerThe number of frames to generate. If provided, will override duration.
image_url string* requiredThe URL of the image used to generate video
end_image_url stringThe URL of the image the video ends with. Defaults to None.
{
"prompt": "A skier glides over fresh snow, joyously smiling while kicking up large clouds of snow as he turns. Accelerating gradually down the slope, the camera moves smoothly alongside.",
"aspect_ratio": "auto",
"resolution": "1080p",
"duration": "5",
"enable_safety_checker": true,
"image_url": "https://storage.googleapis.com/falserverless/example_inputs/seedance_pro_i2v_img.jpg"
}Generated video file
seed integer* requiredSeed used for generation
{
"video": {
"url": "https://storage.googleapis.com/falserverless/example_inputs/seedance_pro_i2v.mp4"
},
"seed": 42
}url string* requiredThe URL where the file can be downloaded from.
content_type stringThe mime type of the file.
file_name stringThe name of the file. It will be auto-generated if not provided.
file_size integerThe size of the file in bytes.