Loading playground
Input
Additional Settings
Customize your input with more control.
Result
Idle
Customize your input with more control.
Customize your input with more control.
Hint: Drag and drop video files from your computer, video from web pages, paste from clipboard (Ctrl/Cmd+V), or provide a URL. Accepted file types: mp4, mov, webm, m4v, gif
Hint: Drag and drop audio files from your computer, audio from web pages, paste from clipboard (Ctrl/Cmd+V), or provide a URL. Accepted file types: mp3, ogg, wav, m4a, aac
Customize your input with more control.
Your request will cost $0.2 for videos up to 40 seconds. For longer videos, you will be charged $0.005 per second of output video.
Your request will cost $0.2 for videos up to 40 seconds. For longer videos, you will be charged $0.005 per second of output video.
LatentSync is a state-of-the-art video-to-video model that generates high-quality lip sync animations from audio using advanced algorithms. Perfect for applications requiring realistic synchronization between video and audio content.
LatentSync delivers professional-grade lip synchronization through an end-to-end framework based on audio-conditioned latent diffusion models. Created by ByteDance, this model excels at creating natural, smooth lip-sync effects without intermediate representations, supporting both real-life and anime character video processing.
Transform your videos with LatentSync's powerful capabilities:
Realistic Synchronization
Developer Experience
Enterprise Ready
Getting up and running with LatentSync takes just a few minutes. Here's how:
JavaScript/TypeScript:
bashnpm install --save @fal-ai/client
Python:
bashpip install fal-client
javascriptimport { fal } from "@fal-ai/client"; fal.config({ credentials: "YOUR_FAL_KEY_HERE" });
javascriptconst result = await fal.subscribe("fal-ai/latentsync", { input: { video_url: "https://example.com/your-video.mp4", audio_url: "https://example.com/your-audio.mp3" } }); console.log(result.video.url);
LatentSync works with two primary inputs:
Video Input
Audio Input
Always implement proper error handling:
javascripttry { const result = await fal.subscribe("fal-ai/latentsync", { input: { video_url: "your-video-url", audio_url: "your-audio-url" } }); } catch (error) { console.error("Lip sync generation failed:", error.message); // Implement appropriate fallback behavior }
video_url (required): URL of the input videoaudio_url (required): URL of the audio file for lip synchronizationAdditional settings can be customized through the control panel when available.
Architecture
Performance
LatentSync excels in various applications:
Transparent, duration-based pricing:
View detailed pricing or contact sales for enterprise solutions.
For asynchronous processing:
javascript// Submit request const { request_id } = await fal.queue.submit("fal-ai/latentsync", { input: { video_url: "your-video-url", audio_url: "your-audio-url" } }); // Check status const status = await fal.queue.status("fal-ai/latentsync", { requestId: request_id }); // Get result const result = await fal.queue.result("fal-ai/latentsync", { requestId: request_id });
We're here to help you succeed with LatentSync:
LatentSync represents a breakthrough in lip synchronization technology, diverging from previous diffusion-based methods by directly leveraging the capabilities of Stable Diffusion to model complex audio-visual correlations. The model is fully open source, providing researchers and developers the ability to reproduce and improve this technology.
Get started at fal.ai/login and start creating realistic lip sync animations today with LatentSync.