V2.6 Video to Video
About
Generate a video using reference files (videos and/or images) with the faster R2V Flash model.
WAN 2.6 R2V Flash features:
- 10-20 seconds faster than standard R2V model
- Reference up to 5 files total (videos + images) for character/subject consistency
- Maximum 3 videos, maximum 5 images, total cannot exceed 5
- Characters referenced as Character1, Character2, etc. in prompt
- Resolution: 720p and 1080p
- Duration: 5 or 10 seconds
- Audio control: generate with or without audio
- Multi-shot support with intelligent scene segmentation
Audio options:
- enable_audio=True (default): Generate video with audio (half price of standard R2V)
- enable_audio=False: Generate silent video (25% price of standard R2V)
Reference video requirements:
- Format: mp4, mov
- Quantity: 0-3 videos
- Duration: 1-30 seconds each
- File size: Up to 100MB each
- FPS: At least 16 FPS
Reference image requirements:
- Format: JPEG, JPG, PNG (no alpha), BMP, WEBP
- Quantity: 0-5 images
- Resolution: 240-5000 pixels
- File size: Up to 10MB each
Reference ordering:
- video_urls are numbered first (Character1, Character2...)
- image_urls continue the sequence after videos
- Example: 2 videos + 1 image = Character1 (video), Character2 (video), Character3 (image)
Prompt guidelines:
- Use Character1, Character2, Character3 to reference subjects
- Example: "Character1 sings on the roadside, Character2 dances beside them."
1. Calling the API#
Install the client#
The client provides a convenient way to interact with the model API.
npm install --save @fal-ai/clientMigrate to @fal-ai/client
The @fal-ai/serverless-client package has been deprecated in favor of @fal-ai/client. Please check the migration guide for more information.
Setup your API Key#
Set FAL_KEY as an environment variable in your runtime.
export FAL_KEY="YOUR_API_KEY"Submit a request#
The client API handles the API submit protocol. It will handle the request status updates and return the result when the request is completed.
import { fal } from "@fal-ai/client";
const result = await fal.subscribe("wan/v2.6/reference-to-video/flash", {
input: {
prompt: "Dance battle between Character1 and Character2."
},
logs: true,
onQueueUpdate: (update) => {
if (update.status === "IN_PROGRESS") {
update.logs.map((log) => log.message).forEach(console.log);
}
},
});
console.log(result.data);
console.log(result.requestId);2. Authentication#
The API uses an API Key for authentication. It is recommended you set the FAL_KEY environment variable in your runtime when possible.
API Key#
import { fal } from "@fal-ai/client";
fal.config({
credentials: "YOUR_FAL_KEY"
});Protect your API Key
When running code on the client-side (e.g. in a browser, mobile app or GUI applications), make sure to not expose your FAL_KEY. Instead, use a server-side proxy to make requests to the API. For more information, check out our server-side integration guide.
3. Queue#
Submit a request#
The client API provides a convenient way to submit requests to the model.
import { fal } from "@fal-ai/client";
const { request_id } = await fal.queue.submit("wan/v2.6/reference-to-video/flash", {
input: {
prompt: "Dance battle between Character1 and Character2."
},
webhookUrl: "https://optional.webhook.url/for/results",
});Fetch request status#
You can fetch the status of a request to check if it is completed or still in progress.
import { fal } from "@fal-ai/client";
const status = await fal.queue.status("wan/v2.6/reference-to-video/flash", {
requestId: "764cabcf-b745-4b3e-ae38-1200304cf45b",
logs: true,
});Get the result#
Once the request is completed, you can fetch the result. See the Output Schema for the expected result format.
import { fal } from "@fal-ai/client";
const result = await fal.queue.result("wan/v2.6/reference-to-video/flash", {
requestId: "764cabcf-b745-4b3e-ae38-1200304cf45b"
});
console.log(result.data);
console.log(result.requestId);4. Files#
Some attributes in the API accept file URLs as input. Whenever that's the case you can pass your own URL or a Base64 data URI.
Data URI (base64)#
You can pass a Base64 data URI as a file input. The API will handle the file decoding for you. Keep in mind that for large files, this alternative although convenient can impact the request performance.
Hosted files (URL)#
You can also pass your own URLs as long as they are publicly accessible. Be aware that some hosts might block cross-site requests, rate-limit, or consider the request as a bot.
Uploading files#
We provide a convenient file storage that allows you to upload files and use them in your requests. You can upload files using the client API and use the returned URL in your requests.
import { fal } from "@fal-ai/client";
const file = new File(["Hello, World!"], "hello.txt", { type: "text/plain" });
const url = await fal.storage.upload(file);Auto uploads
The client will auto-upload the file for you if you pass a binary object (e.g. File, Data).
Read more about file handling in our file upload guide.
5. Schema#
Input#
prompt string* requiredUse Character1, Character2, etc. to reference subjects from your reference files. Works for people, animals, or objects. For multi-shot prompts: '[0-3s] Shot 1. [3-6s] Shot 2.' Max 1500 characters. Reference order: video_urls first, then image_urls.
Reference videos for subject consistency (0-3 videos). Videos' FPS must be at least 16 FPS. Combined with image_urls, total references cannot exceed 5. Reference order: video_urls are numbered first (Character1, Character2...), then image_urls continue the sequence.
Reference images for subject consistency (0-5 images). Combined with video_urls, total references cannot exceed 5. Formats: JPEG, JPG, PNG (no alpha), BMP, WEBP. Resolution: 240-5000px. Max 10MB each. Reference order: image_urls continue numbering after video_urls.
aspect_ratio AspectRatioEnumThe aspect ratio of the generated video. Default value: "16:9"
Possible enum values: 16:9, 9:16, 1:1, 4:3, 3:4
resolution ResolutionEnumVideo resolution tier. R2V Flash only supports 720p and 1080p. Default value: "1080p"
Possible enum values: 720p, 1080p
duration DurationEnumDuration of the generated video in seconds. R2V Flash supports only 5 or 10 seconds. Default value: "5"
Possible enum values: 5, 10
negative_prompt stringNegative prompt to describe content to avoid. Max 500 characters. Default value: ""
enable_prompt_expansion booleanWhether to enable prompt rewriting using LLM. Default value: true
multi_shots booleanWhen true (default), enables intelligent multi-shot segmentation for coherent narrative videos with multiple shots. When false, generates single continuous shot. Only active when enable_prompt_expansion is True. Default value: true
enable_audio booleanWhether to generate a video with audio. Set to false for silent video generation. Silent videos are faster and cost 25% of the audio version price. Default value: true
seed integerRandom seed for reproducibility. If None, a random seed is chosen.
enable_safety_checker booleanIf set to true, the safety checker will be enabled. Default value: true
{
"prompt": "Dance battle between Character1 and Character2.",
"video_urls": [
"https://v3b.fal.media/files/b/0a8d6d47/FtSBJGfZuivKfBIrRuWxa_video.mp4"
],
"image_urls": [
"https://v3b.fal.media/files/b/0a8d6d49/4XDgJcWQHLgkmUOL2JlPt_iXGPlm9y.png"
],
"aspect_ratio": "16:9",
"resolution": "1080p",
"duration": "5",
"negative_prompt": "low resolution, error, worst quality, low quality, defects",
"enable_prompt_expansion": true,
"multi_shots": true,
"enable_audio": true,
"enable_safety_checker": true
}Output#
The generated video file
seed integer* requiredThe seed used for generation
actual_prompt stringThe actual prompt used if prompt rewriting was enabled
{
"video": {
"content_type": "video/mp4",
"url": "https://v3b.fal.media/files/b/0a86762b/iDknfPkLFSFwWkyMgJi0U_QIzjwBDQ.mp4"
},
"seed": 175932751,
"actual_prompt": "Dance battle between Character1 and Character2, cinematic lighting, dynamic camera movement."
}Other types#
VideoFile#
url string* requiredThe URL where the file can be downloaded from.
content_type stringThe mime type of the file.
file_name stringThe name of the file. It will be auto-generated if not provided.
file_size integerThe size of the file in bytes.
file_data stringFile data
width integerThe width of the video
height integerThe height of the video
fps floatThe FPS of the video
duration floatThe duration of the video
num_frames integerThe number of frames in the video
ImageSize#
width integerThe width of the generated image. Default value: 512
height integerThe height of the generated image. Default value: 512
File#
url string* requiredThe URL where the file can be downloaded from.
content_type stringThe mime type of the file.
file_name stringThe name of the file. It will be auto-generated if not provided.
file_size integerThe size of the file in bytes.
file_data stringFile data