WorldAuditBench Temporal Consistency
Multimodal · 2026-09-30
The 40 WorldAuditBench tasks whose implanted anomaly belongs to the temporal consistency family: changes in an object's existence, attributes or behavior over time that require revisiting. A multimodal agent explores the scene with first-person views under a 40-action budget, using MCP tools to move, look, interact, recall earlier frames and report, and receives an anomaly-type hint and an in-context example; a GPT-6 Astra judge checks the report and its cited evidence against the task rubric. The score is the percentage of these tasks whose target anomaly is correctly identified.
Top models (higher is better)
| Model | Score |
|---|---|
| Claude Opus 5 | 12.5 |
| Gemini 3.8 Flash | 12.5 |
| GPT-6 Astra | 12.5 |
| Muse Spark 1.3 | 5.0 |
| Qwen3.8 Flash | 2.5 |