The Agent Company
Agents · 2024-12-18
A benchmark for LLM agents performing consequential real-world professional tasks in a simulated software company environment using web, code, programs, and coworker communication.
Top models (higher is better)
| Model | Score |
|---|---|
| Sonnet 4 | 43.2 |
| Claude 3.7 Sonnet | 40.2 |
| Claude 3.5 Sonnet (Oct 2024) | 34.4 |
| Gemini 2.0 Flash 001 | 19.0 |