AWS opens a 134-task benchmark for cloud agents

AWS has released aws-bench, an open-source evaluation suite that runs agents against real, disposable AWS environments for troubleshooting, provisioning, and infrastructure work; its repository currently lists 78 basic and 47 advanced tasks, or 125 curated tasks before the nine-task quickstart. Each run gets a scoped account, live resources, and a programmatic or judge-based verifier rather than a static fixture, the project explains on GitHub. Operators should file the benchmark as a more consequential test of cloud-agent reliability than code-only scores, alongside the archive’s account of harness-driven swings in coding-agent costs.