Atlas

Models

← All models

Vicuna 13B v1.3

LMSYS · 2023-06-22 · 13B parameters

Vicuna 13B v1.3 is LMSYS's autoregressive chat assistant, produced by supervised instruction fine-tuning Meta's LLaMA 1 13B on about 125,000 user-shared conversations collected from ShareGPT. The v1.3 release used twice as much ShareGPT data as earlier Vicuna versions, provided merged weights rather than delta weights, and supports a 2,048-token context window.

Benchmark scores

BenchmarkScore
AlpacaEval 2.0 (length-controlled win rate)10.8
AlpacaEval 2.0 (raw win rate)7.1
BBH (Open LLM Leaderboard v2)33.8
BoolQ80.8
Capability92.6
GPQA (Open LLM Leaderboard v2)26.8
GSM8K22.6
IFEval (Open LLM Leaderboard v2)33.4
MATH Level 5 (Open LLM Leaderboard v2)1.4
MMLU-Pro (Open LLM Leaderboard v2)22.4
MuSR (Open LLM Leaderboard v2)37.3
Loading Atlas data…