Team Idea
RAG Evolution Factory — an autonomous AI platform powered by IBM Bob 2.0 that orchestrates the full lifecycle of enterprise RAG agents: build, monitor, autopsy, and self-heal.
My technical foundation is an already-working multi-tenant RAG SaaS (FastAPI + Next.js), featuring a native Eval Lab (categorical failure analysis), a bidirectional MCP server/client, 52-permission RBAC, SSO OIDC, and full observability.
During the hackathon, IBM Bob 2.0 takes the role of Lead AI Engineer across 4 capabilities:
1. Factory: Autonomous generation and configuration of business RAG agents.
2. Guardian: Continuous quality monitoring and detection of Recall/NDCG drops.
3. Autopsy: Failure isolation (subagents) to identify the exact root cause (chunking, retrieval, prompt, hallucination).
4. ChangeLab: Autonomous fix experimentation, Eval Lab benchmarks, and A/B validation.
The existing codebase is ready — IBM Bob 2.0 comes in to close the engineering loop.