VoiceDesk AI is a real time voice support agent that feels like calling a helpdesk, except the agent can actually see what you see. A user opens the web app, starts a call, and talks to an AI assistant with a photorealistic avatar that speaks back with lip sync and sub second response times.The agent watches the user's shared screen so it understands the actual problem instead of relying on a vague description. When a user says their account is blocked, the agent reads the error on screen, confirms the issue, and calls a tool to unblock the account directly. Once the issue is resolved, it sends a ticket summary by email so there is a record of the session.Under the hood the agent runs as a LiveKit worker built from independently chosen best in class providers: AssemblyAI for streaming speech to text with end of turn detection, Groq running a vision capable Qwen model for fast reasoning over both speech and screen frames, Deepgram Aura for low latency text to speech, Silero for voice activity detection, and Beyond Presence for the avatar. The frontend is a Next.js app that publishes the user's microphone and screen and renders the avatar in the browser.VoiceDesk AI shows what a modular voice pipeline can do beyond simple question answering: a support agent that sees, listens, reasons, and takes real action on a user's behalf.
Category tags: