OSWorld 2.1 Offline, 500-step Binary Accuracy
Agents · 2026-09-16
OSWorld 2.1 offline 82-task subset runnable without internet, binary accuracy with 500 steps. Kept separate from earlier releases and the full task set.
Top models (higher is better)
| Model | Score |
|---|---|
| Claude Opus 5 | 48.6 |