Atlas

Models

← All models

Code Llama Instruct 70B

Meta · 2024-01-29 · 69B parameters

Code Llama Instruct 70B is Meta's instruction-tuned 70-billion-parameter Code Llama model released in January 2024. Unlike the smaller Instruct variants, it uses a 4,096-token context window rather than the 100K long-context configuration supported by the base model, while retaining the underlying Llama 2 70B architecture and standard RoPE with a 10,000 base period. It targets natural-language-driven code generation and programming assistance.

Benchmark scores

BenchmarkScore
Arena Text — English (No Style Control)1096
Arena Text — Exclude Ties (No Style Control)873
Arena Text — Exclude Ties (Style Controlled)958
Arena Text — Hard Prompts (No Style Control)1052
Arena Text — Hard Prompts English (No Style Control)1079
Arena Text — Instruction Following (No Style Control)1024
Arena Text — Non-English (No Style Control)992
Arena Text — Non-English (Style Controlled)1062
Arena Text — Software & IT Services (No Style Control)1059
Arena Text — Writing, Literature & Language (No Style Control)1015
LMArena Text Arena Elo1119
LMArena Text Arena English Elo1152
LMArena Text Arena Hard Prompts Elo1159
LMArena Text Arena Hard Prompts English Elo1183
LMArena Text Arena Industry: Writing, Literature & Language Elo1054
LMArena Text Arena Instruction Following Elo1097
LMArena Text Arena Occupational Software & IT Services Elo1162
LMArena Text Overall No Style Control Elo1057
Loading Atlas data…