VoicePilot — Multilingual AI Voice Front Desk

Vercel
application badge
Created by team VoicePilot on September 27, 2026

Small businesses across Southeast Asia lose customers to clunky booking forms and phone lines nobody answers — and the people calling in rarely stick to one language. VoicePilot is a voice-first AI front desk, built entirely on AssemblyAI's Voice Agent API over a single WebSocket connection, that lets a real small business (our demo shop, Sunrise Car Wash) take phone bookings the way its customers actually talk: English, Mandarin, Cantonese and Malay, freely mixed, sometimes in the same sentence. The caller can ask about prices, hours or services (answered only from the business's own data, never invented), book an appointment, correct a misheard name mid-call, reschedule or cancel — and interrupt the agent at any point the way a real phone call works. Every write (booking, reschedule, cancellation) is re-read from the store immediately after it happens and reported back to the caller as "Verified in system," so nothing is ever silently lost or duplicated. An Owner View gives the business a live table of every booking and every tool call, and an auto-generated call summary closes out each conversation. Under the hood, one AssemblyAI WebSocket connection handles speech-to-text, the LLM reasoning, text-to-speech and turn-taking/barge-in — the frontend never touches interruption logic itself. Seven JSON-Schema tools (check availability, book, look up, reschedule, cancel, fetch business info, save call summary) are wired through the documented tool-calling flow, with session config, turn-detection tuning and tool-call traffic all inspectable live via a developer debug view. It's a small, honest demo of how a "boring" business problem — nobody answering the phone — can be solved with a genuinely multilingual voice agent instead of another form nobody fills in.

Category tags: