Atlas

Models

← All models

Qwen1.5 1.8B Chat

Alibaba · 2024-02-04 · 1.8B parameters

Qwen1.5-1.8B-Chat is Alibaba's aligned chat checkpoint in the Qwen1.5 family, announced on February 4, 2024. It is a dense decoder-only Transformer with 1,836,828,672 parameters and a 32,768-token context window; Qwen states that the chat models were post-trained with supervised fine-tuning and direct preference optimization. Its text-only chat template supports system, user, and assistant roles.

Benchmark scores

BenchmarkScore
AlpacaEval 2.0 (length-controlled win rate)2.6
AlpacaEval 2.0 (raw win rate)3.7
BBH (Open LLM Leaderboard v2)32.6
Capability82.0
EQ-Bench v224.1
EQ-Bench v2 + MAGI-Hard Combined27.8
GPQA (Open LLM Leaderboard v2)29.8
IFEval (Open LLM Leaderboard v2)20.2
MAGI-Hard31.6
MATH Level 5 (Open LLM Leaderboard v2)2.0
MMLU-Pro (Open LLM Leaderboard v2)18.0
MuSR (Open LLM Leaderboard v2)42.6
Loading Atlas data…