BALROG — TextWorld (LLM)

Name: BALROG — TextWorld (LLM)
Published: 2024-11-20

Games · 2024-11-20

Mean per-episode progress (0-100) on TextWorld interactive-fiction games (Treasure Hunter, The Cooking Game and Coin Collector), text-only, in BALROG's language-only track with a zero-shot agent. One of the six environments averaged into the BALROG leaderboard score; the episode count depends on the submission's protocol version.

Top models (higher is better)

Model	Score
Gemini 3.1 Pro Preview	75.7
Claude Opus 5	71.6
GPT-5.6 Sol	63.5
Grok 4	62.9
Gemini 3 Pro Preview	60.2
Opus 4.5	59.0
GPT-6 Astra	54.5
Gemini 3 Flash Preview	50.2
Gemini 2.5 Pro Experimental 03-25	49.2
Haiku 4.5	49.0
Claude 3.5 Sonnet (Oct 2024)	42.1
GPT-4o (2024-05-13)	39.3
Grok 3 (API)	32.5
GPT-5	30.6
Gemini 2.5 Flash	29.6
GPT-5.6 Terra	27.8
DeepSeek-R1	21.8
GPT-5.6 Luna	18.2
Haiku 3.5	18.0
Qwen2 VL 72B Instruct	16.5
Llama 3.1 70B Instruct	15.0
GPT-4o Mini	12.3
Reka Flash 3	11.6
Llama 3.2 90B Vision Instruct	11.2
Qwen2.5 72B Instruct	11.2
DeepSeek-R1-Distill-Qwen-32B	10.6
Llama 3.3 70B Instruct	9.0
Llama 3.2 11B Vision Instruct	6.7
Llama 3.1 8B Instruct	6.1
Mistral NeMo Instruct 2407	4.5
Qwen2.5 7B Instruct	3.9
Llama 3.2 3B Instruct	3.5
Llama 3.2 1B Instruct	3.3
Phi-4	2.5
Qwen2 VL 7B Instruct	1.6
Gemini 1.5 Flash 002	0.0
Gemini 1.5 Pro 002	0.0