MBPP+
Code · 2023-05-02
MBPP+ is an extended-test version of the MBPP code-generation benchmark. It measures pass@1 with stricter test suites than the original MBPP.
Top models (higher is better)
| Model | Score |
|---|---|
| Ternary Bonsai 2 27B (GGUF) | 83.1 |
Code · 2023-05-02
MBPP+ is an extended-test version of the MBPP code-generation benchmark. It measures pass@1 with stricter test suites than the original MBPP.
| Model | Score |
|---|---|
| Ternary Bonsai 2 27B (GGUF) | 83.1 |