PropensityBench
Safety · 2025-11-25
PropensityBench measures the rate at which an agent chooses harmful actions over safe alternatives under pressure. Lower harmful-action rates indicate safer behavior.
Top models (lower is better)
| Model | Score |
|---|---|
| o3 | 10.5 |
| Sonnet 4 | 12.2 |
| O4 Mini | 15.8 |
| Qwen2.5 32B | 22.9 |
| o3-mini | 33.2 |
| GPT-5.2 | 34.4 |
| GPT-4o (2024-11-20) | 46.1 |
| Gemini 3 Pro Preview | 52.9 |
| Llama 3.1 70B | 55.4 |
| Llama 3.1 8B Instruct | 66.5 |
| Gemini 2.5 Flash | 68.0 |
| Qwen3 8B | 75.2 |
| Gemini 2.0 Flash 001 | 77.8 |
| Gemini 2.5 Pro | 79.0 |