Atlas

Benchmarks

← All benchmarks

Phare Framing Jailbreaks (Spanish)

Safety · 2025-12-09

Phare jailbreak task using framing strategies to elicit unsafe behavior. This row is the Spanish language split.

Top models (higher is better)

ModelScore
GPT-5 Nano100.0
Opus 4.599.7
Opus 4.699.7
GPT-5.599.6
GPT-5 Mini99.3
Sonnet 598.9
Haiku 4.598.6
GPT-5.298.6
GPT-5.198.2
Sonnet 4.597.5
GPT-596.1
Llama 3.1 405B Instruct95.7
Opus 4.194.0
Qwen3.7 Max Preview92.5
Sonnet 4.691.8
Qwen3.7-Plus90.0
Kimi K2.689.7
Claude 3.7 Sonnet88.3
Gemini 3 Pro Preview88.3
Haiku 3.587.9
gpt-oss-120b87.6
Grok 4.380.8
Grok 478.4
GLM-5.276.4
Gemini 3.1 Pro Preview73.8
Gemma 4 31B IT72.3
Kimi K2.570.8
Llama 3.3 70B Instruct69.2
GPT-4o66.0
Gemini 3.5 Flash65.5
Llama 4 Maverick63.5
Llama 3.1 8B Instruct62.6
Gemini 3.1 Flash-Lite61.7
Qwen3 Max (rolling alias)58.5
Qwen-Plus (2025-01-25)55.7
GPT-4o Mini55.3
Gemini 2.5 Pro51.4
Llama 4 Scout50.0
Gemini 2.5 Flash-Lite49.6
Gemini 2.5 Flash47.2
Loading Atlas data…