
1
1
Bangladesh
1 year of experience
AI Engineer & solo builder focused on ROCm-native AI agents, RAG, and high-performance inference on AMD MI300X. Full-stack developer passionate about open source, building fast, grounded, enterprise-ready AI systems from model to deployment. Building and shipping in public.
.png&w=828&q=75)
GroundedROCm is a 100% ROCm-native grounded retrieval engine powered by Qwen2.5-0.5B on AMD MI300X delivering verified JSON answers with zero hallucinations. Traditional search suffers from CUDA dependencies, high latency, API costs, and hallucinations. We solve it with a 5-stage local pipeline: Planner (Qwen2.5-0.5B via http://llama.cpp with fast-path for simple queries), Search Layer (Tavily / Qdrant / JSONL pluggable), Evidence Engine (deduplication + BM25 + compression), Synthesizer (warm http://llama.cpp server with schema-constrained JSON, max 96 tokens), and Guardrails (JSON repair + number/name grounding + URL validation). Result: 15MB binary via http://llama.cpp, small Docker size, ∼0.6s latency on MI300X, 98% grounding accuracy, 100% source validity, zero CUDA, zero external cost, instantly switchable to internal Qdrant for enterprise deployment.
1 Dec 2026