VoiceVLA

VoiceVLA directly addresses Intel's challenge brief, "Bimanual VLA Manipulation with Multi-Modal Reasoning — setting up a dinner table," by fusing physical motor control, multilingual speech understanding, and edge-based visual perception into a single embodied intelligence architecture. Key Pillars High-Fidelity Physics (MuJoCo): Setting a dining table demands precise spatial reasoning, synchronized dual-arm trajectory planning, and delicate force management to handle fragile glassware and cutlery. VoiceVLA utilizes the MuJoCo physics engine to simulate realistic contact dynamics and joint constraints, ensuring fluid, collision-free bimanual execution. Real-Time Voice Intelligence (Speechmatics): Human-robot interaction is powered by Speechmatics, supporting real-time voice processing across the top 10 world languages—explicitly including natural Hinglish code-switching (fluidly blending Hindi and English). Users can issue flexible, conversational spoken commands during task execution without adhering to rigid syntaxes. Edge Quality Inspection (Anomalib v2.6.0 + Intel OpenVINO 2026.3): Before placing dining items, VoiceVLA performs real-time visual defect detection using an anomaly pipeline powered by Anomalib v2.6.0 and accelerated with Intel OpenVINO 2026.3. This identifies surface defects, hairline cracks, or smudges directly on local edge hardware without cloud latency penalties. By combining physics-driven bimanual simulation, broad multilingual voice interaction, and local computer vision, VoiceVLA delivers a production-ready solution for Intel's multi-modal manipulation benchmark.