DevPulse: grading IBM Bob as a security auditor
We hid 22 security bugs and 7 traps in two apps, had IBM Bob find and fix them, and marked its work against an answer key it never saw. It found all 22 with no false alarms, and every patch in round two applied first time.