
Problem & Challenge: As AI coding assistants become standard, a new challenge has emerged in software development: developers frequently ship AI-generated code without fully understanding it or thoroughly testing edge cases. This leads to high developer confidence backed only by AI output rather than hands-on verification. Conversely, less experienced developers often feel nervous and underconfident when committing low-risk code, wasting senior engineering cycles on routine reviews. Traditional static analysis tools check syntax, but they cannot detect developer cognitive disconnects or blind reliance on AI tools. Solution & Target Users: Gut Check is an intelligent developer dashboard that bridges the gap between developer self-assessment, AI code generation, and actual pull request complexity. Designed for engineering teams, tech leads, and QA managers, Gut Check compares stated confidence and manual testing efforts directly against automated git diff analysis. User Interaction & Workflow: When submitting a PR, developers complete a quick "gut check" rating their confidence (1–5 scale) and detailing their testing steps. Gut Check parses the PR diff—analyzing branch complexity, unvetted AI logic, modified critical paths, and test coverage—and computes a calibration verdict: Overconfident Blind Spot (AI Risk): High confidence (e.g., 5/5) paired with complex AI-generated logic, new conditional branches, and 0 manual or automated tests. Underconfident: Low confidence paired with straightforward, low-risk changes (e.g., minor CSS updates), reassuring the developer. Calibrated: Developer confidence accurately reflects verified code quality and real test coverage. Creativity & Uniqueness: Gut Check takes a novel, human-centric approach to software reliability. Instead of only auditing code line-by-line, it evaluates developer calibration in the age of AI. By explicitly cross-referencing subjective inputs ("Stated Testing" and "Dev Confidence") with technical diff metrics, Gut Check pinpoints AI over-reliance before code reaches production. Effectiveness & Efficiency: Gut Check streamlines code reviews through a high-contrast, dark-mode dashboard built for fast visual scanning. Reviewers instantly spot high-risk PRs where developers relied heavily on AI without adequate testing, bypassing low-risk changes. With minimal visual noise, clear status badges, and precise line-by-line rationale, Gut Check delivers high actionable insight with zero cognitive clutter.
27 Sep 2026