DeepSeek-Coder-Base 33B
DeepSeek · 2023-11-02 · 33.3B parameters
DeepSeek-Coder-Base 33B is the largest dense base model in the original DeepSeek-Coder series from DeepSeek, with 33 billion parameters pre-trained on a project-level code corpus with a 16K context window. Released in November 2023, it supports code generation, completion, and infilling across 87 programming languages and was among the strongest open-weight code models at the time. It is the uninstructed foundation model for the DeepSeek-Coder-Instruct-33B variant.
Benchmark scores
| Benchmark | Score |
|---|---|
| ARC AI2 | 42.2 |
| BigCodeBench Complete | 46.6 |
| BigCodeBench-Hard Complete | 19.6 |
| Capability | 89.2 |
| Epoch Capabilities Index (ECI) | 94.8 |
| GSM8K | 35.4 |
| MMLU | 39.4 |
| WinoGrande | 62.0 |