MBPP
更新于 2026-04-03
1,587 次浏览
问题数量
974
发布机构
个人
评测类别
编程与软件工程
评测指标
—
支持语言
英文
难度等级
—
简介
一个包含 974 个简单的 Python 编程问题的基准，用于评估模型生成代码的能力。
相关资源
MBPP Model Score Leaderboard
Source: DataLearnerAI
Data sourced primarily from official releases (GitHub, Hugging Face, papers), then benchmark leaderboards, then third-party evaluators. Learn about our data methodology
模式说明:
normal
thinking
low
medium
high
deeper thinking
parallel_thinking
图表加载中...
Latest MBPP model rankings and full benchmark leaderboard
Browse the latest scores, model modes, release dates, and parameter sizes for MBPP.
Model release cutoff:
MBPP详细排名数据表格
| 排名 | 模型 | |||
|---|---|---|---|---|
| 1 | Llama3.1-405B Instruct Standard Mode | 88.60 | 2024-07-23 | 4050 |
| 2 | Gemini 1.5 Pro Standard Mode | 87.80 | 2024-02-15 | 未知 |
| 3 | Llama3.3-70B-Instruct Standard Mode | 87.60 | 2024-12-06 | 700 |
| 4 | GPT-4o mini Standard Mode | 87.20 | 2024-07-18 | 未知 |
| 5 | Llama3.1-70B-Instruct Standard Mode | 86.00 | 2024-07-23 | 700 |
| 6 | Claude 3.5 Haiku Standard Mode | 85.60 | 2024-10-22 | 未知 |
| 7 | Qwen2.5-72B Standard Mode | 84.70 | 2024-09-18 | 727 |
| 8 | Qwen2.5-32B Standard Mode | 84.00 | 2024-09-18 | 320 |
| 9 | Hunyuan-A13B-Instruct Standard Mode | 83.86 | 2025-06-27 | 800 |
| 10 | Qwen2.5-Max Standard Mode | 80.60 | 2025-01-28 | 未知 |
| 11 | Codestral 25.01 Standard Mode | 80.20 | 2025-01-13 | 未知 |
| 12 | Codestral Standard Mode | 78.20 | 2024-05-29 | 220 |
| 13 | Llama 4 Maverick Standard Mode | 77.60 | 2025-04-05 | 4000 |
| 14 | Qwen2.5-7B Standard Mode | 74.90 | 2024-09-18 | 70 |
| 15 | Mistral-Small-3.1-24B-Instruct-2503 Standard Mode | 74.71 | 2025-03-17 | 240 |
| 16 | Gemma 3 - 27B (IT) Standard Mode | 74.40 | 2025-03-12 | 270 |
| 17 | C4AI Aya Vision 32B Standard Mode | 70.43 | 2025-03-04 | 320 |
| 18 | Llama3.1-8B-Instruct Standard Mode | 69.40 | 2024-07-23 | 80 |
| 19 | Llama 4 Scout Standard Mode | 67.80 | 2025-04-05 | 1090 |
| 20 | Phi-4-mini-instruct (3.8B) Standard Mode | 65.30 | 2025-02-27 | 38 |
| 21 | Moonlight-16B-A3B-Instruct Standard Mode | 63.80 | 2025-02-23 | 160 |
| 22 | Gemma2-27B Standard Mode | 62.60 | 2024-05-14 | 270 |
| 23 | Gemma 2 - 9B Standard Mode | 62.20 | 2024-06-27 | 90 |
| 24 | Qwen2.5-3B Standard Mode | 57.10 | 2024-09-18 | 30 |
| 25 | Llama3.1-8B Standard Mode | 53.90 | 2024-07-23 | 80 |
| 26 | Mistral-7B-Instruct-v0.3 Standard Mode | 51.10 | 2024-05-22 | 70 |
| 27 | Llama-3.2-3B Standard Mode | 48.70 | 2024-09-18 | 32 |
| 28 | Amazon Nova Pro Standard Mode | 0.00 | 2024-12-03 | 未知 |