Vicuna 33B v1.3
LMSYS · 2023-06-22 · 32.5B parameters
Vicuna 33B v1.3 is LMSYS's largest Vicuna v1.3 chat model, an autoregressive Transformer produced by supervised instruction fine-tuning LLaMA 1 on about 125,000 user-shared ShareGPT conversations. The v1.3 release used twice the ShareGPT data of earlier Vicuna versions and published merged weights directly rather than deltas.
Benchmark scores
| Benchmark | Score |
|---|---|
| AlpacaEval 2.0 (length-controlled win rate) | 17.6 |
| AlpacaEval 2.0 (raw win rate) | 12.7 |
| Capability | 102.6 |
| EQ-Bench v2 | 67.1 |
| EQ-Bench v2 + MAGI-Hard Combined | 49.4 |
| MAGI-Hard | 31.7 |