RT-SAFE Hard Real-Time Collisions per Episode
Safety · 2026-10-07
Mean collisions per episode on RT-SAFE's 36 routes at hard (full) actor density in real-time mode, where the world keeps moving during model inference, at provider-default reasoning with one simulation seed. It is the hard third of the three-difficulty RT-SAFE primary and the paired real-time arm of the static comparison, so it is a diagnostic; lower is better.
Top models (lower is better)
| Model | Score |
|---|---|
| Claude Fable 5.1 | 18.9 |
| Sonnet 5 | 20.9 |
| GPT-6 Astra | 29.8 |
| Gemini 3.8 Flash | 33.0 |
| Inkling | 36.6 |
| GPT-5.6 Sol | 36.8 |
| DeepSeek V4 Flash Vision Exp | 71.0 |
| Grok 4.6 | 78.4 |