Falcon2-11B
Technology Innovation Institute · 2024-05-13 · 11.1B parameters
Falcon2-11B is TII's 11B foundation language model and the first release in the Falcon 2 series, trained in four documented stages of 4.5T, 250B, 250B, and 500B tokens drawn from RefinedWeb and curated multilingual corpora and released in May 2024. It improves over the original Falcon series with rotary positional embeddings and was released alongside a multimodal vision-language companion model, both as open-weight releases.