Optima benchmarks models on a team's own workflows

Artificial Analysis has launched Optima, a platform that lets teams run their own datasets, agent traces or workflow descriptions across multiple models and compare quality, time and cost per task. In its launch documentation, the company says early testers found finance and accounting agents that could cut cost by 10x without a meaningful quality drop; rubric evaluation costs $0.125 per criterion per model and pairwise evaluation $0.375 per comparison. That makes the benchmark itself cheap enough to repeat, and gives teams a better starting point than picking a model from a public leaderboard—especially for the agent-reliability gap already showing up in workflow tests.