Foley-Omni
Invite-only studio that turns a silent clip into dialogue, foley, and music.
Guide
From invite code to finished soundtrack — step by step.
Registration is invite-only. Ask an admin for a code, or use one they shared with your team.
Open Get access, choose Register, then enter email, a password (at least 8 characters), and your invite code.
After signing in you land in the studio. Click New chat to begin a session.
Each chat locks a single source video. Upload an MP4 (server limits apply for size and duration). Start a new chat to switch videos.
WORDS — spoken lines or lyrics. AUDIO_CAPTION — foley, ambience, vocal style. MUSIC — score mood and tempo, or leave empty for none.
Videos longer than ~10s are split into windows. Give each chunk its own WORDS / AUDIO_CAPTION / MUSIC so later scenes do not reuse early dialogue.
Hit Generate. Jobs run one at a time on the GPU; the UI shows queue position and ETA while you wait.
Preview the MP4 (and WAV if requested). Tweak prompts in the same chat for more takes, or open a new chat for a different video.
Examples
Original silent (or muted) picture vs model soundtrack — with the prompts that produced them.
Calm then excited speech, electric sparks, table thud, porcelain shatter — no music.
Hold still, Shiny. I'll get you down. Gotcha.
(empty — no music)
Two windows: spoken countdown into dance music, then sung gratitude over continuous cartoon pop.
Long-clip style: separate prompts per window.
No scripted dialogue — overlapping panic screams, continuous chase music, sync footsteps; audio never drops when characters leave frame.
(empty — no scripted WORDS)
More demos
Additional model outputs from the demo set — play any clip to hear the soundtrack.
Invite-only
Sign in to open the studio, or register with an invite code.
Includes non-commercial components. Licenses