🚀 Try this Example
View the complete source code on GitHub.
Steps to run:
- Install fal:
- Authenticate (if not already done):
- Clone the demos repo and install dependencies:
- Run the trainer:
This demo uses a GPU-heavy training stack and can run for a while depending on your step count.
Deploy to fal
To host the trainer as an API:
How it works
- Downloads WAN weights from Hugging Face and a pinned training repo.
- Prepares a dataset from your ZIP file (images and/or short videos).
- Runs LoRA training with DeepSpeed and returns the adapter weights.
Your training_data_url should point to a ZIP containing:
- Images or videos (
.png, .jpg, .jpeg, .gif, .mp4)
- Optional caption files (
my_clip.txt next to my_clip.mp4)
If you set auto_scale_input=true, videos are fit to 81 frames at 16 fps for WAN training.
Example request