Global PIQA - Non-Parallel (Log-Likelihood Accuracy)
General QA · 2025-10-28
Global PIQA's non-parallel split contains locally authored physical-commonsense questions with two answer options. This definition compares answer-option log likelihoods without requiring the model to generate a choice token.
Top models (higher is better)
| Model | Score |
|---|---|
| Gemma 3 12B PT | 64.2 |
| Llama 3.1 70B | 64.0 |
| Gemma 2 27B | 63.4 |
| Gemma 2 9B | 60.5 |
| Qwen2.5 72B | 60.2 |
| Qwen2.5 32B | 57.7 |
| Llama 3.1 8B | 56.9 |
| Mixtral 8x7B | 56.2 |
| Falcon 40B | 53.6 |
| Mistral 7B v0.1 Base | 53.3 |
| Falcon 7B | 49.8 |
| Gemma 3 270M | 49.8 |