Vicuna 13B v1.5
LMSYS · 2023-08-01 · 13B parameters
Vicuna 13B v1.5 is LMSYS's autoregressive chat assistant, produced by supervised instruction fine-tuning Llama 2 on about 125,000 user-shared conversations from ShareGPT. The v1.5 release switched Vicuna's base model to Llama 2; this checkpoint has a 4,096-token context window, while LMSYS released a separate 16K variant using linear RoPE scaling.
Benchmark scores
| Benchmark | Score |
|---|---|
| EQ-Bench v2 | 67.4 |
| EQ-Bench v2 + MAGI-Hard Combined | 48.1 |
| MAGI-Hard | 28.8 |