BimanualIQ

BimanualIQ is a voice-controlled Physical AI system designed for intelligent two-arm robotic manipulation. It combines natural-language understanding, visual perception, multimodal reasoning, motion planning, and coordinated execution to let users control two robotic arms through simple spoken instructions. In the core demo, a user can say, “Set the table for two, and do not use the red cup,” and BimanualIQ interprets the request, detects objects in the scene, builds a task plan, assigns actions to each arm, and completes the table-setting workflow inside MuJoCo. The system uses Speechmatics for real-time speech recognition, camera observations for scene understanding, and a VLA-based reasoning layer for translating intent into physical actions. A bimanual coordinator decides when the arms should work independently, perform handoffs, stabilize objects, or execute synchronized movements. BimanualIQ also monitors execution continuously, allowing it to detect failed grasps, misplaced objects, unexpected disturbances, and new voice commands, then replan without restarting the entire task. OpenVINO optimizes perception and AI inference for Intel Core Ultra Series 2/3 hardware, while seeded simulation tests measure task completion, robustness, latency, and generalization across randomized environments. The result is a practical, adaptive, and reproducible platform for conversational bimanual robotics. It demonstrates how spoken intent can become physical action.