Command R7B (Dec 2024)
Cohere · 2024-12-13 · 8B parameters
Cohere Labs Command R7B is a December 2024 open-weight multilingual model from Cohere and Cohere Labs with exactly 8,028,033,024 checkpoint parameters, marketed as 7B, and aligned through supervised fine-tuning and preference training for retrieval-augmented generation, multi-step tool use, reasoning, summarization, question answering, and code across 23 languages. Its 32-layer decoder-only Transformer interleaves three 4,096-token sliding-window grouped-query-attention layers using RoPE for each global-attention layer without positional embeddings. The current checkpoint configuration declares 132,096 maximum positions, while Cohere’s model card and hosted documentation document a 128,000-token context window.