Benjamin You@realbenjaminyou

SignPulseAI is a real-time multimodal AI application designed to help bridge communication gaps for people who may have difficulty hearing. The application combines hand gestures or sign-language input captured through a camera with spoken input captured through a microphone. The system uses MediaPipe Hand Landmarker for real-time hand landmark detection and processes the visual input together with speech information through a low-latency AI pipeline. Gemini Multimodal AI is used to interpret the combined visual and language context and determine the intended meaning. The interpreted result is presented as readable text in real time through a live user interface. Users can see the camera feed, gesture detection, and generated text while interacting with the application. The core workflow is: Camera + Microphone → Hand Gesture & Speech Input → Computer Vision → Gemini Multimodal AI → Interpretation → Real-Time Text Output. SignPulseAI focuses on accessibility, real-time interaction, and multimodal communication. Instead of relying only on visual gesture recognition, the system combines gesture and spoken context to improve interpretation and provide meaningful text output. The project was developed by Team Algorithmic Vanguard for the AI Factory Hackathon 2026 using native.builder as the primary application-building platform, with Gemini Multimodal AI, MediaPipe, Speechmatics, Supabase, React, and Vite as supporting technologies.

🌎 Online Hackathon | 💻 Online Build: Sept 26 - Oct 5, 2026 A virtual, global hackathon. Build from anywhere in the world. Dark Factory is the official hackathon of WeAreDevelopers World Congress North America, presented by BAND, but you don't need to be in San Jose to take part. For one week, you build a software factory in BAND Desktop: a band of coding agents that plans work, implements it and checks its own results. 🎟️ Bonus for sign-ups: you are eligible for a free ticket to WeAreDevelopers World Congress North America in San Jose (Sep 23–25). If you do go, stop by the BAND booth: a surprise is waiting for you.

🌎 Hybrid Hackathon | 💻 Online Build: September 10–16, 2026 | 📍 On-site: September 15–17, 2026 The official hackathon of AI Infra Summit — co-organized by Kisaco Research and lablab.ai. Build production-grade AI applications on the modern AI infrastructure stack, alongside 8,000+ attendees, researchers, founders, and infra leaders. 📍 On-site Venue (September 15–17): Santa Clara Convention Center 5001 Great America Pkwy, Santa Clara, CA 📍 On-site participation is by invitation only. Travel and accommodation expenses will not be covered.

🌎 Online Hackathon | 📅 August 3–10, 2026| 💻 Powered by native.builder The official native.builder hackathon, hosted by NativelyAI and lablab.ai. Join founders, developers, designers, and builders to create real AI-native applications powered by native.builder: from idea to deployed product, fully in the cloud. 💻 This hackathon is fully online. No travel required.