← All benchmarks

OSWorld 2 August 2026 with Anthropic fixes, 500-step binary

Agents

Strict completion on the full 108-task August 2026 OSWorld 2 release with subsequent author task fixes and Anthropic-reported setup and grading fixes. Uses 500 actions, 1080p screenshots and five independent runs per task; not directly comparable with earlier releases or assumed identical to the unmodified August 8 release.

Top models (higher is better)