Atlas

Models

← All models

Falcon 40B

Technology Innovation Institute · 2023-05-25 · 41.8B parameters

Falcon 40B is TII's 40B causal decoder-only base language model trained on 1 trillion tokens of RefinedWeb and curated corpora, released in 2023 under the Apache 2.0 license. It shares the same decoder architecture as the rest of the Falcon series — featuring multi-query attention and FlashAttention — and was one of the largest permissively licensed open-weight models at the time of its release.

Benchmark scores

BenchmarkScore
BBH (BIG-Bench Hard)37.1
BBH (Open LLM Leaderboard v2)40.2
Capability96.2
Epoch Capabilities Index (ECI)103
Global PIQA - Non-Parallel (Log-Likelihood Accuracy)53.6
Global PIQA - Parallel (Log-Likelihood Accuracy)24.5
GPQA (Open LLM Leaderboard v2)27.3
IFEval (Open LLM Leaderboard v2)25.0
LAMBADA77.3
MATH Level 5 (Open LLM Leaderboard v2)1.8
MMLU-Pro (Open LLM Leaderboard v2)25.0
MuSR (Open LLM Leaderboard v2)36.3
OpenBookQA56.6
Loading Atlas data…