Vending-Bench (days until sales stop)
Games · 2025-02-20
Mean simulated days until sales stopped in the original Vending-Bench long-horizon vending business simulation.
Top models (higher is better)
| Model | Score |
|---|---|
| GPT-5 | 363 |
| Sonnet 4.5 | 350 |
| Grok 4 | 324 |
| Gemini 3 Pro Preview | 239 |
| Kimi K2 Thinking | 190 |
| gpt-oss-120b | 187 |
| Gemini Robotics-ER 1.5 | 165 |
| GPT-5.1 | 136 |
| Opus 4 | 132 |
| Qwen3-235B-A22B | 120 |
| o3 | 112 |
| Claude 3.7 Sonnet | 112 |
| Claude 3.5 Sonnet (Oct 2024) | 102 |
| GPT-5 Mini | 96.0 |
| o3-mini | 86.0 |
| Sonnet 4 | 80.0 |
| GPT-4o Mini | 71.0 |
| Gemini 2.5 Pro Preview 03-25 | 68.0 |
| Human (Vending-Bench) | 67.0 |
| GPT-4o | 65.0 |
| Gemini 2.0 Flash | 50.0 |
| Gemini 1.5 Pro | 35.0 |
| Gemini 2.0 Pro Experimental | 25.0 |
| Gemini 1.5 Flash | 15.0 |
| Haiku 3.5 | 8.0 |
| Llama 4 Maverick | 1.0 |