Atlas

Benchmarks

← All benchmarks

Phare Encoding Jailbreaks (Spanish)

Safety · 2025-12-09

Phare jailbreak task using encoded or obfuscated prompts to bypass safeguards. This row is the Spanish language split.

Top models (higher is better)

ModelScore
Llama 3.1 405B Instruct77.0
Llama 3.1 8B Instruct72.1
Sonnet 570.6
Magistral Small 1.260.4
Qwen3 8B55.5
Magistral Medium 1.253.2
GPT-4o42.6
Opus 4.140.0
Llama 4 Scout39.3
Qwen3.7 Max Preview37.3
Gemma 3 12B IT36.6
Llama 3.3 70B Instruct35.5
Mistral Small 3.2 24B Instruct 250635.5
Grok 435.1
Gemini 3 Pro Preview34.9
Qwen3.7-Plus34.5
Qwen3 VL 30B A3B Instruct33.6
Mistral Medium 3.532.1
Command A31.3
Gemma 4 31B IT30.6
Haiku 4.529.4
Opus 4.529.4
Gemma 3 27B IT29.4
GPT-4.1 Nano29.1
Grok 3 Mini29.1
Mistral Large 2 (Instruct 2407)28.3
Mistral Medium 3.128.3
GPT-4o Mini27.9
Kimi K2.626.0
DeepSeek-V4-Flash24.5
gpt-oss-120b23.4
GPT-522.6
Opus 4.622.3
DeepSeek-V4-Pro22.3
Qwen2.5-Max22.3
Grok 221.9
Llama 4 Maverick21.7
GPT-5 Nano21.5
GPT-5.220.8
Mistral Large 3 675B Instruct 251220.8
Loading Atlas data…