Qwen 72B Chat
Alibaba · 2023-11-30 · 72.3B parameters
Qwen-72B-Chat is Alibaba's chat-tuned model built from the first-generation Qwen-72B base checkpoint and released November 30, 2023. Its base model was pretrained on over 3 trillion tokens of Chinese, English, other multilingual text, code, and mathematics; the chat model was aligned using supervised fine-tuning and RLHF and supports a 32K-token context window. Alibaba reported that the Qwen-72B base model outperformed LLaMA 2-70B on all compared tasks and GPT-3.5 on 7 of 10 tasks.
Benchmark scores
| Benchmark | Score |
|---|---|
| Artificial Analysis Intelligence Index | 3.4 |
| EQ-Bench v2 | 80.7 |
| EQ-Bench v2 + MAGI-Hard Combined | 70.5 |
| MAGI-Hard | 60.4 |