Atlas

Models

← All models

Qwen1.5 7B

Alibaba · 2024-02-04 · 7.7B parameters

Qwen1.5-7B is Alibaba's 7-billion-parameter base language model from the Qwen1.5 family, released February 4, 2024. It is a dense Transformer decoder with multilingual coverage and up to 32K tokens of context, and was the first Qwen generation to ship with native Hugging Face Transformers integration. The base model is intended for downstream fine-tuning, while its chat counterpart Qwen1.5-7B-Chat is aligned for direct conversational use.

Benchmark scores

BenchmarkScore
BBH (Open LLM Leaderboard v2)45.6
Capability103.5
GPQA (Open LLM Leaderboard v2)29.9
IFEval (Open LLM Leaderboard v2)26.8
MATH Level 5 (Open LLM Leaderboard v2)9.3
MedMCQA (Open Medical-LLM)50.2
MedQA 4-options (Open Medical-LLM)48.9
MMLU62.6
MMLU Anatomy (Open Medical-LLM)49.6
MMLU Clinical Knowledge (Open Medical-LLM)66.0
MMLU College Biology (Open Medical-LLM)68.8
MMLU College Medicine (Open Medical-LLM)60.7
MMLU Medical Genetics (Open Medical-LLM)69.0
MMLU Professional Medicine (Open Medical-LLM)59.6
MMLU-Pro (Open LLM Leaderboard v2)29.2
MuSR (Open LLM Leaderboard v2)41.0
PubMedQA (Open Medical-LLM)67.8
Loading Atlas data…