Falcon 180B
Technology Innovation Institute · 2023-09-06 · 179.5B parameters
Falcon 180B is TII's 180B causal decoder-only base language model, trained on 3.5 trillion tokens of RefinedWeb and curated corpora and released in September 2023 under the Falcon-180B commercial license. It was the largest openly available language model at the time of its release.
Benchmark scores
| Benchmark | Score |
|---|---|
| Capability | 112.5 |
| Epoch Capabilities Index (ECI) | 111 |
| GSM8K | 54.4 |
| HellaSwag (Unspecified Scoring Protocol) | 89.0 |
| LAMBADA | 79.8 |
| MMLU | 70.6 |
| OpenBookQA | 64.2 |
| PIQA | 84.9 |
| WinoGrande | 87.1 |