LLM Sycophancy Balanced 198 Total Inconsistency
Safety · 2026-09-30
Sycophantic plus contrarian contradiction rate over all 198 affective case pairs in complete runs of the balanced cohort. Low raw inconsistency can result from abstention.
Top models (lower is better)
| Model | Score |
|---|---|
| Hy3 | 1.0 |
| Gemini 3.5 Flash-Lite | 1.5 |
| Grok 4.5 | 3.0 |
| GPT-5.6 Luna | 5.1 |
| Gemini 3.6 Flash | 5.1 |
| Qwen3.7 Flash | 5.6 |
| GPT-5.6 Terra | 8.1 |
| Sonnet 5 | 15.7 |
| Doubao Seed 2.1 Pro | 18.7 |
| GPT-5.6 Sol | 18.7 |
| Inkling | 19.2 |
| Kimi K3 | 20.7 |
| GLM-5.2 | 21.7 |