SpecCheck — Requirement Traceability

Software teams often have requirements written in a PRD and working code in a repository, but it can be difficult to quickly determine whether each requirement is actually supported by implementation evidence and tests. This creates a gap between what a project says it should do and what can be demonstrated from the codebase. SpecCheck addresses this problem by providing a requirement-to-test traceability workflow demonstrated against ResumePilot AI. It starts with the project requirements, extracts and structures them, searches the codebase for implementation evidence, verifies the evidence using strict criteria, generates tests, and produces a final traceability report. The workflow uses five IBM Bob custom modes: Spec Reader, Evidence Finder, Strict Verifier, Test Writer, and Trace Reporter. Each mode has a focused responsibility in the verification pipeline. The resulting reports connect individual requirements with evidence, verification decisions, tests, and traceability information. The primary users are software developers, engineering teams, reviewers, and technical project teams who need a reproducible way to inspect whether implemented software satisfies written requirements. A user can provide a project with its requirements and then follow the generated reports to understand what is supported, what requires further verification, and where weaknesses exist. What makes SpecCheck distinctive is its focus on traceability rather than simply generating code or tests. It creates an evidence chain from requirement to implementation evidence, verification, and test coverage. This helps separate claims supported by the codebase from claims that require additional investigation. In the current project, the workflow expanded the original requirements into 18 traceable requirements and produced offline tests for the SpecCheck workflow. The repository records 62 tests, with 50 passing and 12 expected failures documenting identified defects. The project also documents issues such as clean-checkout harness failures, ground-truth file rewriting, verification weaknesses, and inconsistencies between documented and executed evaluation cases. SpecCheck does not modify the ResumePilot AI application code. Instead, it provides a structured verification and traceability layer around the existing project.