Mistral 7B v0.1 Base
Mistral AI · 2023-09-27 · 7.2B parameters
Mistral 7B v0.1 Base is Mistral AI's first open pretrained model, released on September 27, 2023. The Apache-2.0 checkpoint has an 8,192-token context length, grouped-query attention, and a 4,096-token sliding-attention window whose stacked layers propagate information beyond each local window; Mistral lists the model as retired on March 30, 2025.