Atlas

Models

← All models

Falcon 7B

Technology Innovation Institute · 2023-04-24 · 7.2B parameters

Falcon 7B is TII's (Technology Innovation Institute) 7B causal decoder-only base language model, trained on 1.5 trillion tokens of RefinedWeb plus curated corpora and released in early 2023 under the Apache 2.0 license. Its architecture features multi-query attention, FlashAttention, and parallel attention/MLP blocks optimized for inference efficiency, and it served as the foundation for the Falcon-7B-Instruct instruction-tuned variant.

Benchmark scores

BenchmarkScore
BBH (Open LLM Leaderboard v2)32.9
Capability71.8
Epoch Capabilities Index (ECI)93.6
Global PIQA - Non-Parallel (Log-Likelihood Accuracy)49.8
Global PIQA - Parallel (Log-Likelihood Accuracy)21.8
GPQA (Open LLM Leaderboard v2)24.5
IFEval (Open LLM Leaderboard v2)18.2
LAMBADA74.9
MATH Level 5 (Open LLM Leaderboard v2)1.0
MedMCQA (Open Medical-LLM)27.2
MedQA 4-options (Open Medical-LLM)27.9
MMLU Anatomy (Open Medical-LLM)25.2
MMLU Clinical Knowledge (Open Medical-LLM)21.9
MMLU College Biology (Open Medical-LLM)27.8
MMLU College Medicine (Open Medical-LLM)24.9
MMLU Medical Genetics (Open Medical-LLM)30.0
MMLU Professional Medicine (Open Medical-LLM)17.6
MMLU-Pro (Open LLM Leaderboard v2)11.3
MuSR (Open LLM Leaderboard v2)37.8
PubMedQA (Open Medical-LLM)66.2
Loading Atlas data…