ManipulaX

This project is an end-to-end Physical AI system for bimanual robotic manipulation, built for the Intel Physical AI Online Challenge. It uses two simulated SO-101 robot arms in MuJoCo to understand natural-language instructions, interpret camera observations, reason about the current scene, and execute multi-step manipulation tasks for setting up a dinner table. The system combines vision-language-action reasoning with coordinated dual-arm control, enabling actions such as opening a drawer, retrieving utensils, picking up and placing a plate or mug, and performing complementary actions between both arms. The environment supports randomized scene conditions to evaluate robustness across different object placements and physical or visual variations. The inference pipeline is designed for Intel Core Ultra hardware, using OpenVINO for model optimization and efficient edge inference while maintaining task performance. The project also includes reproducible simulation, evaluation, benchmarking, and demonstration workflows.