VoxFrame: Multimodal Narrative Synthesis Engine

Created by team CognitiveFrames on July 10, 2026

Whisper Groq AI/ML API Gemini AI AMD Developer Cloud

Video Captioning

VoxFrame is a multimodal narrative synthesis system built for the AMD Developer Hackathon ACT II Track 2 challenge. It addresses common video-captioning failures such as hallucinated details and inconsistent tone by combining structured scene grounding with style-aware caption generation. The pipeline downloads the source video, extracts adaptive keyframes with FFmpeg, optionally transcribes speech with Groq Whisper, and then uses AIMLAPI-connected Gemini models to build a verified scene summary from the images. That scene summary is used to generate four distinct caption styles: formal, sarcastic, humorous_tech, and humorous_non_tech. A local audit and rubric-based scoring pass check for realism, tone compliance, and style fit, while low-scoring outputs can be repaired or refined before final export. The project is packaged as a Docker image and served through a FastAPI-powered web dashboard for easy local and cloud deployment.

Category tags:

Social Media, Writing, Video, Content, Communication

Github Presentation Demo

Explore more applications

Quarantine

An AI agent that writes and runs real code in throwaway gVisor sandboxes on Vultr: no network, no secrets, hard caps, destroyed after each run. Every run ends with a signed containment receipt proving what the code could and couldn't touch.

Quarantine

SLATE: Receipts for Every Agent Action

SLATE is a browser agent that works inside a throwaway microVM on Vultr. Every step is checked by a second model, hash-chained and signed with Ed25519, and a person approves the final action. If it is not on the slate, it did not happen.

NoBanks

VULTRQwen3NVIDIAClaude Code

testtinggg

good tingood tingood tingood tingood tingood tingood tingood tingood tingood tingood tin

LFG

Detonation Chamber

Run an untrusted npm/PyPI package, GitHub repo, or URL in a sealed, disposable Vultr sandbox. Watch what it does and get a verdict based on its actual behaviour. Every escape attempt is contained and recorded.

Builders Nepal

Containment Foreman - sandboxed agent runtime

A human-gated foreman that plans AI agent tasks, dispatches each step to a disposable, network-less Docker sandbox, and returns verifiable receipts with SHA-256 artifacts, resource caps and zero host access.

Schultzenator

Tayyab Ali

Upcoming AI Hackathons
For Innovators & Creators

Explore more applications

Quarantine

An AI agent that writes and runs real code in throwaway gVisor sandboxes on Vultr: no network, no secrets, hard caps, destroyed after each run. Every run ends with a signed containment receipt proving what the code could and couldn't touch.

Quarantine

SLATE: Receipts for Every Agent Action

SLATE is a browser agent that works inside a throwaway microVM on Vultr. Every step is checked by a second model, hash-chained and signed with Ed25519, and a person approves the final action. If it is not on the slate, it did not happen.

NoBanks

VULTRQwen3NVIDIAClaude Code

testtinggg

good tingood tingood tingood tingood tingood tingood tingood tingood tingood tingood tin

LFG

Detonation Chamber

Run an untrusted npm/PyPI package, GitHub repo, or URL in a sealed, disposable Vultr sandbox. Watch what it does and get a verdict based on its actual behaviour. Every escape attempt is contained and recorded.

Builders Nepal

Containment Foreman - sandboxed agent runtime

A human-gated foreman that plans AI agent tasks, dispatches each step to a disposable, network-less Docker sandbox, and returns verifiable receipts with SHA-256 artifacts, resource caps and zero host access.

Schultzenator