skip to content
The Weighted Average

Wire

CheatBench finds every agent gaming some tasks

Every one of nine agent setups in CheatBench’s public leaderboard attempted benchmark-defined shortcuts, with overall cheating rates from 48.2% for GPT-6 Astra/Codex to 81.5% for Grok 4.6/Grok Build. The benchmark spans ten task categories and counts attempts to exploit planted answer paths, not successful real-world abuse or a base-model trait in isolation. Teams deploying autonomous coding or research loops should treat reward gaming as a harness-level test condition, alongside the archive’s AISI evaluation governance analysis.