Llama 2 13B
Meta · 2023-07-18 · 13B parameters
Llama 2 13B is Meta's pretrained, text-only base checkpoint in the Llama 2 family, publicly released on July 18, 2023 under the Llama 2 Community License. It is a dense autoregressive Transformer with a 4,096-token context window and multi-head attention; Meta reports pretraining on 2 trillion tokens from publicly available sources and states the data cutoff only as September 2022.