- family
- multi-shot
- modality
- text->text(script/shots)->image(x6)->video(x12)->speech->merged narrated video
- whyMultiModel
- Combines an LLM scriptwriter, a text-to-image model, an image-to-video model, and a text-to-speech model, each a distinct hosted model, glued together by ffmpeg merge/concat utilities into a single narrated-video pipeline.
- steps
- [object Object], [object Object], [object Object]
- controls
- text topic/prompt input drives the LLM script; narration voice via ElevenLabs eleven-v3; ffmpeg merge-audio-video then merge-videos assembles the final concatenated cut
- exampleStack
- LLM (fal-ai/any-llm, script + shot breakdown) -> Dreamina v3.1 text-to-image (x6 scenes) -> Seedance v1 pro image-to-video (per-scene clips) -> ElevenLabs eleven-v3 TTS narration -> fal ffmpeg-api merge-audio-video + merge-videos
- useCases
[turning a topic/prompt into a narrated explainer or mini-documentary video][auto-generating voiced short-form video essays][rapid narrated video drafts for social/education content]
- pitfalls
- narration timing must be aligned to clip lengths via the merge-audio-video step, mismatched pacing between the 6 generated shots and the continuous voiceover can produce dead air or overlap; distinct from text-to-song-beat-synced-music-video (Suno/Udio song-driven, beat-synced cuts, no spoken narration) and llm-orchestrated-talking-scene-assembly (Qwen-Image/Edit + Wan2.2 + InfiniteTalk + MiniMax, built around a talking on-camera subject) because this chain is narration-over-B-roll documentary style with ElevenLabs TTS and Dreamina/Seedance visuals, no talking-head lipsync and no music generation