MBPP pass@10 is an AI benchmark used to evaluate model capabilities. Review its overview, metrics, official resources, and model leaderboard results on DataLearnerAI.
Browse the latest scores, model modes, release dates, and parameter sizes for MBPP pass@10.
Data sourced primarily from official releases (GitHub, Hugging Face, papers), then benchmark leaderboards, then third-party evaluators. Learn about our data methodology
| Rank | Model | License | |||
|---|---|---|---|---|---|
 CodeLLaMA-Python-34B Standard Mode | 76.40 | 2023-08-24 | 34B | Free Commercial | |
CodeLLaMA-34B Standard Mode | 76.20 | 2023-08-24 | 34B | Free Commercial | |
CodeLLaMA-Instruct-34B Standard Mode | 74.60 | 2023-08-24 | 34B | Free Commercial | |
4 | CodeLLaMA-Python-13B Standard Mode | 74.00 | 2023-08-24 | 13B | Free Commercial |
5 | CodeLLaMA-13B Standard Mode | 71.70 | 2023-08-24 | 13B | Free Commercial |
6 | CodeLLaMA-Instruct-13B Standard Mode | 71.20 | 2023-08-24 | 13B | Free Commercial |
7 | CodeLLaMA-Python-7B Standard Mode | 70.30 | 2023-08-24 | 7B | Free Commercial |
8 | CodeLLaMA-7B Standard Mode | 66.70 | 2023-08-24 | 7B | Free Commercial |
9 | LLaMA2 70B Standard Mode | 66.20 | 2023-07-18 | 70B | Free Commercial |
10 | CodeLLaMA-Instruct-7B Standard Mode | 65.40 | 2023-08-24 | 7B | Free Commercial |
11 | LLaMA2 34B Standard Mode | 56.90 | 2023-07-18 | 34B | Free Commercial |
12 | LLaMA2 13B Standard Mode | 48.10 | 2023-07-18 | 13B | Free Commercial |
13 | LLaMA2 7B Standard Mode | 41.80 | 2023-07-18 | 7B | Free Commercial |
