
Claption is a containerized video captioning app built for the AMD Developer Hackathon ACT II Video Captioning track. It processes short video clips by sampling frames with FFmpeg, generating a grounded visual fact sheet with Fireworks AI, and then rewriting that factual summary into four required caption styles: formal, sarcastic, humorous-tech, and humorous-non-tech. To improve leaderboard performance, Claption separates factual understanding from tone generation, then uses an internal LLM judge loop to score captions for accuracy, tone match, humor quality, and hallucination risk. Weak captions are automatically repaired before final export. The project includes a Next.js demo app, batch CLI, Docker container, sample outputs, and judge-ready setup instructions.
13 Jul 2026