Cresta-Bench
Agents
Cresta-Bench measures how reliably a model runs a contact-center AI agent: four synthetic agents for real-estate lending, a senior-health callback line, a health-plan provider line, and airline support take calls from an LLM-simulated caller across 181 private test cases. Cresta runs each case three times per model and grades runs with deterministic tool-call checks plus LLM judges. The score is pass^3, the share of cases whose three runs all pass, computed per agent and averaged across the four agents.
Top models (higher is better)
| Model | Score |
|---|---|
| Claude Opus 5.5 | 82.6 |
| Claude Sonnet 5.5 | 78.0 |
| GPT-6 Sol | 77.9 |
| Gemini 3.8 Flash | 76.1 |
| GPT-5.4 | 65.1 |
| Gemini 3.6 Flash | 50.2 |
| GPT-5.2 | 49.5 |
| Qwen3.8-Max | 48.7 |
| GLM-5.3 | 43.1 |
| GPT-5.6 Luna | 38.8 |
| Kimi K3 | 34.9 |
| GPT-6 Luna | 32.7 |
| DeepSeek V4.1 Flash 1017 | 32.6 |
| Claude Haiku 5.5 | 20.1 |