People tell stories far better than they draw them, but today's visual AI tools usually make you write prompts, manage images and assemble scenes by hand. NarraFlow removes that friction. You press one microphone button and tell a story naturally. AssemblyAI's Voice Agent API handles real-time speech recognition, turn-taking, barge-in and spoken replies, and calls structured tools that turn what you said into a real story: characters, locations and scenes. Each scene is illustrated in the background while the conversation keeps going. Every character's visual traits are stored once and reused in every illustration, so the same girl in a yellow dress in scene one is still her in scene five. The story then becomes editable by voice. Say "make the tree blue," "change her dress to green," or "regenerate scene two," and only the affected scenes repaint - nothing else is touched. Say "play the story" and it becomes an animated storybook with captions and narration, exportable as an MP4. This build was tested against the real AssemblyAI service, not just mocks: real speech, real transcription, real barge-in and real tool calls into the real story engine, all confirmed live. Tool-call reliability turn-to-turn is still a work in progress and documented honestly in the README rather than overclaimed. Built with FastAPI, WebSockets, plain JavaScript, SQLite, ffmpeg, the AssemblyAI Voice Agent API and a Pillow-based illustration engine. Ideas for where this goes: bedtime stories, classroom storytelling, language practice, accessibility and creative writing.
Category tags: