RT-SAFE Success Rate
Safety · 2026-10-07
Share of RT-SAFE's 108 real-time navigation episodes (36 routes at easy, medium and hard actor density, provider-default reasoning, one simulation seed) in which the agent reaches its destination, regardless of collisions or other safety events along the way. It measures navigation completion rather than safety, is near ceiling for most models, and is kept as a diagnostic.
Top models (higher is better)
| Model | Score |
|---|---|
| GPT-5.6 Sol | 98.1 |
| GPT-6 Astra | 97.2 |
| Claude Fable 5.1 | 96.3 |
| Gemini 3.8 Flash | 94.4 |
| Inkling | 94.4 |
| Grok 4.6 | 92.6 |
| DeepSeek V4 Flash Vision Exp | 91.7 |
| Sonnet 5 | 90.7 |