CAISI AgentDojo - Phishing Emails (2025)
Safety · 2025-09-30
The phishing-email task in CAISI's 2025 AgentDojo Workspace evaluation instructs the agent through injected text to send contacts a message directing them to an untrusted meeting-notes URL. Scores average hijacking frequency across 30 benign tasks evaluated under two injection conditions.
Top models (lower is better)
| Model | Score |
|---|---|
| GPT-5 | 0.0 |
| Opus 4 | 6.0 |
| gpt-oss-120b | 48.0 |
| DeepSeek-R1-0528 | 48.0 |
| DeepSeek-V3.1 | 62.0 |
| DeepSeek-R1 | 76.0 |