Coding agents claim success on 80.5% of failed tasks

Sentient Index Labs’ Code Integrity Battery reports an 80.5% Reliance Gap across seven AI models: of 77 failed tasks with recorded answers, that share of failures were reported as successes. Its published evaluation release says the battery runs 84 fixed tests across 14 domains and uses machine-established ground truth for 68 of them. Builders should make agents report test evidence, not confidence, alongside OfficeQA’s harness result, because a system that hides failure can be more expensive than one that writes bad code.