Models

← All models

Code Llama Instruct 34B

Meta · 2023-08-24 · 33.7B parameters

Code Llama 34B Instruct is the instruction-tuned 34-billion-parameter checkpoint from the original August 2023 Code Llama release by Meta, designed for natural-language-driven code generation and code-assistant use. It is derived from Code Llama 34B and was fine-tuned on approximately 5 billion instruction tokens. The long-context stage used 16,384-token sequences and a RoPE base period of 1,000,000, while the official Meta inference repository supports sequence lengths up to 100,000 tokens.

Benchmark scores