EchoSphere bridges the emotional gap in human-machine voice interaction by combining real-time client-side acoustic prosody parsing, immersive 3D spatial audio positioning, and agentic workflows powered by Google's Gemma model, hosted on high-performance AMD infrastructure. # The Problem Traditional conversational AI is tone-deaf and flat. Voice assistants convert human speech straight into text, stripping away vital acoustic nuances like whispering, urgency, and emotional cadence, while completely lacking spatial presence. # The Architecture & Key Features 1. On-Device Edge & 3D Spatial Audio (Frontend): Using the native WebAudio API, EchoSphere calculates Root Mean Square (RMS) energy and Zero-Crossing Rate (ZCR) against a dynamic rolling noise floor to classify vocal states (Whisper, Alert, Spikes) instantly in the browser. It also features 3D spatial audio positioning, dynamically mapping and rendering AI voice responses across an immersive 3D soundstage. 2. Evolus & Gemma Integration: The structured prosody payload is passed through an Evolus agentic workflow that orchestrates context and routes the prompt directly to Google’s Gemma model. 3. AMD Instinct™ & ROCm™ Backend: Model inference is hosted and accelerated on cloud-accessible AMD Instinct™ GPUs using the open-source AMD ROCm™ software stack, ensuring high-throughput, low-latency execution that adapts instantly to the user's vocal delivery. # Hackathon Impact EchoSphere delivers true emotional intelligence and spatial immersion to next-gen AI agents, perfectly blending Gemma's intelligence, Evolus routing, 3D spatial audio, and AMD's powerful hardware stack.
Category tags: