So101
The client provides a convenient way to interact with the model API.
npm install --save @fal-ai/clientThe @fal-ai/serverless-client package has been deprecated in favor of @fal-ai/client. Install the new package and update your imports — see client setup.
Set FAL_KEY as an environment variable in your runtime.
export FAL_KEY="YOUR_API_KEY"The client API handles the API submit protocol. It will handle the request status updates and return the result when the request is completed.
import { fal } from "@fal-ai/client";
const result = await fal.subscribe("fal-ai/flux-3-action/so101", {
input: {
prompt: "place the box in the container",
scene_image_url: "https://v3b.fal.media/files/b/0aaba0cf/rbESQ2h5nozh5K8Ms1FDm_scene.png",
wrist_image_url: "https://v3b.fal.media/files/b/0aaba0cf/qyaj49X3PZc70wJwz90f1_wrist.png",
state: [-18.94, 134.52, 120.15, 28.3, -32.17, 27.02]
},
logs: true,
onQueueUpdate: (update) => {
if (update.status === "IN_PROGRESS") {
update.logs.map((log) => log.message).forEach(console.log);
}
},
});
console.log(result.data);
console.log(result.requestId);The API uses an API Key for authentication. It is recommended you set the FAL_KEY environment variable in your runtime when possible.
import { fal } from "@fal-ai/client";
fal.config({
credentials: "YOUR_FAL_KEY"
});When running code on the client-side (e.g. in a browser, mobile app or GUI applications), make sure to not expose your FAL_KEY. Instead, use a server-side proxy to make requests to the API. For more information, check out our server-side integration guide.
The client API provides a convenient way to submit requests to the model.
import { fal } from "@fal-ai/client";
const { request_id } = await fal.queue.submit("fal-ai/flux-3-action/so101", {
input: {
prompt: "place the box in the container",
scene_image_url: "https://v3b.fal.media/files/b/0aaba0cf/rbESQ2h5nozh5K8Ms1FDm_scene.png",
wrist_image_url: "https://v3b.fal.media/files/b/0aaba0cf/qyaj49X3PZc70wJwz90f1_wrist.png",
state: [-18.94, 134.52, 120.15, 28.3, -32.17, 27.02]
},
webhookUrl: "https://optional.webhook.url/for/results",
});You can fetch the status of a request to check if it is completed or still in progress.
import { fal } from "@fal-ai/client";
const status = await fal.queue.status("fal-ai/flux-3-action/so101", {
requestId: "764cabcf-b745-4b3e-ae38-1200304cf45b",
logs: true,
});Once the request is completed, you can fetch the result. See the Output Schema for the expected result format.
import { fal } from "@fal-ai/client";
const result = await fal.queue.result("fal-ai/flux-3-action/so101", {
requestId: "764cabcf-b745-4b3e-ae38-1200304cf45b"
});
console.log(result.data);
console.log(result.requestId);Some attributes in the API accept file URLs as input. Whenever that's the case you can pass your own URL or a Base64 data URI.
You can pass a Base64 data URI as a file input. The API will handle the file decoding for you. Keep in mind that for large files, this alternative although convenient can impact the request performance.
You can also pass your own URLs as long as they are publicly accessible. Be aware that some hosts might block cross-site requests, rate-limit, or consider the request as a bot.
We provide a convenient file storage that allows you to upload files and use them in your requests. You can upload files using the client API and use the returned URL in your requests.
import { fal } from "@fal-ai/client";
const file = new File(["Hello, World!"], "hello.txt", { type: "text/plain" });
const url = await fal.storage.upload(file);The client will auto-upload the file for you if you pass a binary object (e.g. File, Data).
Read more about file handling in our file upload guide.
prompt string* requiredNatural-language task instruction for the robot.
scene_image_url string* requiredCurrent frame from the fixed scene camera (tiled left). Resized to 256x256.
wrist_image_url string* requiredCurrent frame from the wrist camera (tiled right). Resized to 256x256.
Measured state: shoulder pan, shoulder lift, elbow flex, wrist flex, wrist roll (degrees), gripper (percent).
Measured states at the 7 control ticks (30 Hz) before state, oldest first. Requires command_history. Omit for a fresh episode.
Absolute commands in effect at each of the 8 observation ticks, oldest first; the last row is the most recent command sent. Requires state_history.
history_scene_image_url stringScene frame from the oldest history tick (7 ticks before now). Requires state_history. Defaults to the current frame.
history_wrist_image_url stringWrist frame from the oldest history tick. Requires state_history.
num_inference_steps integerEuler denoising steps. The checkpoint was validated at 4. Default value: 4
guidance_scale floatClassifier-free guidance on video and action; 1.0 disables CFG. Default value: 3
seed integerSampling seed. Omit for a random seed; the reference evaluation seed is 0 for DROID and 42 for SO-101.
{
"prompt": "place the box in the container",
"scene_image_url": "https://v3b.fal.media/files/b/0aaba0cf/rbESQ2h5nozh5K8Ms1FDm_scene.png",
"wrist_image_url": "https://v3b.fal.media/files/b/0aaba0cf/qyaj49X3PZc70wJwz90f1_wrist.png",
"state": [
-18.94,
134.52,
120.15,
28.3,
-32.17,
27.02
],
"num_inference_steps": 4,
"guidance_scale": 3
}Predicted action chunk, one row per control step in time order. DROID: 32x8 absolute joint targets (rad) plus gripper closed fraction at 15 Hz. SO-101: 42x6 absolute commands (deg, gripper %) at 30 Hz. Not clipped: enforce joint, velocity and workspace limits on the robot.
Name of each action column.
action_hz float* requiredControl rate of the action rows.
execute_steps integer* requiredExecute this many leading actions, then request a new chunk.
seed integer* requiredSeed used for sampling.
Server-side timings in seconds.
{}