AutoCopilot is a mission-critical Voice AI diagnostic copilot engineered for industrial commercial fleet operators and technicians. When heavy-duty haulers and logistics vehicles face unexpected engine or powertrain malfunctions on highways, inspecting 500-page paper service manuals or manually entering Diagnostic Trouble Codes (DTCs) while operating is hazardous and impractical. AutoCopilot introduces hands-free voice interaction powered by AssemblyAI Streaming Speech-to-Text and LeMUR reasoning engine. Key Features & Workflow: 1. Real-Time Hands-Free Voice Diagnosis: Drivers and technicians speak natural-language fault descriptions into the cockpit microphone. AssemblyAI's streaming WebSocket transcribes continuous acoustic audio with sub-second latency and diesel noise filtering. 2. Root-Cause Analysis (RCA) with AssemblyAI LeMUR: AutoCopilot orchestrates AssemblyAI LeMUR (Claude 3.5 Sonnet) to analyze extracted DTC codes (such as P0300, P0171, U0100) alongside vehicle symptoms, delivering immediate step-by-step triage protocols. 3. Telemetry Grounding via Synthetic CAN Bus: Diagnostic reasoning is continuously cross-referenced with live sensor streams, including engine RPM, coolant temperature, oil pressure, and brake pneumatic lines. 4. Instant Emergency Work Orders: Automatically synthesizes ISO 26262-compliant emergency triage records and dispatches maintenance assistance with a single voice confirmation. Architecture & Accomplishments: Built with Python 3.12, asyncio event pipelines, AssemblyAI real-time API, and an interactive Streamlit cockpit deployed on Google Cloud / Firebase Hosting. AutoCopilot achieves end-to-end voice-to-report latency under 1.2s with 100% OBD-II and SAE J1939 test benchmark validation.
Category tags: