@shms1w312

Developed for the AssemblyAI Voice Agent Hackathon, the Voice-Controlled Robot Arm is a hands-free instrument assistant designed for sterile or hands-occupied settings like operating rooms, where manually searching instrument trays wastes time and risks contamination. The system operates across five core stages: a speech stream utilizing AssemblyAI live transcription, Natural Language Understanding (NLU) for item and correction detection, a Finite State Machine (FSM) to track arm state, closed-loop robot control, and physical simulation in CoppeliaSim. Key technical highlights include closed-loop control that continuously monitors actual joint angles rather than executing blind commands, fuzzy matching (edit-distance matching) to handle imperfect speech-to-text transcriptions, and self-correction logic that allows the robotic arm to abandon a held item mid-task, return it home, and fetch a newly requested item without resetting the system.

💻 Online Hackathon | ⏳ Build: 48 hours | 📅 September 25–27, 2026 The official IBM Bob 2.0 hackathon. Build what's next in AI-assisted development, alongside the developers and experts shaping it. ⭐ Get help from experts throughout the event 🤝 Join a team or build solo 💰 Prize pool: $12,000 🧑🏻‍💻 Register before the Kick-Off Stream to start building with Bob

🌎 Online Hackathon | 💻 Month-long challenge | Dates: Sep 1–30, 2026 | 🏆 $10,000 Prize Pool ($5k cash + $5k in AAI credits) A month-long online challenge run by lablab.ai together with AssemblyAI, the Voice AI infrastructure company for builders. Every participant builds on AssemblyAI. You can join at any point — registration stays open for the whole build window, so you can start on day one or pick the project up halfway through and still submit. 🌍 Fully online hackathon. Join and build from anywhere in the world.