SynapVocal: Realtime Voice Bridge

Certain medical conditions such as dysarthria, cerebral palsy, ALS, Down syndrome, or stroke can make a person's speech slow, slurred, or broken. This makes them difficult to understand for both human listeners and standard automated speech recognition systems. SynapVocal serves as a voice bridge solution that puts the user in control through a confirm-before-speak approach. The system operates in four steps. First, the browser streams audio from the microphone in real time to the AssemblyAI Universal-3.6 Pro model. Second, once a sentence ends, Gemini reads the transcript, listens to the sentence's audio, and analyzes the user's previous sentences to offer three alternative options of what the user likely meant. Third, the user confirms, selects, or edits the most accurate option. Nothing is spoken aloud before the user approves it. Finally, Deepgram Aura-2 speaks the confirmed sentence clearly to the listener. This approach has proven effective. Based on testing on the TORGO database for unique sentences from speakers with dysarthria, the best choice offered by the system yielded 426 exactly right sentences out of 680, a significant improvement compared to 324 sentences when relying solely on standard speech recognition.