AMD ROCm Grounded Web Agent
GroundedROCm is a 100% ROCm-native grounded retrieval engine powered by Qwen2.5-0.5B on AMD MI300X delivering verified JSON answers with zero hallucinations. Traditional search suffers from CUDA dependencies, high latency, API costs, and hallucinations. We solve it with a 5-stage local pipeline: Planner (Qwen2.5-0.5B via http://llama.cpp with fast-path for simple queries), Search Layer (Tavily / Qdrant / JSONL pluggable), Evidence Engine (deduplication + BM25 + compression), Synthesizer (warm http://llama.cpp server with schema-constrained JSON, max 96 tokens), and Guardrails (JSON repair + number/name grounding + URL validation). Result: 15MB binary via http://llama.cpp, small Docker size, ∼0.6s latency on MI300X, 98% grounding accuracy, 100% source validity, zero CUDA, zero external cost, instantly switchable to internal Qdrant for enterprise deployment.
.png&w=640&q=75)