DataLearner logoDataLearnerAI
AI Tech Blogs
Leaderboards
Benchmarks
Models
Resources
Tool Directory

加载中...

DataLearner logoDataLearner AI

A knowledge platform focused on LLM benchmarking, datasets, and practical instruction with continuously updated capability maps.

产品

  • Leaderboards
  • 模型对比
  • Datasets

资源

  • Tutorials
  • Editorial
  • Tool directory

关于

  • 关于我们
  • 隐私政策
  • 数据收集方法
  • 联系我们

© 2026 DataLearner AI. DataLearner curates industry data and case studies so researchers, enterprises, and developers can rely on trustworthy intelligence.

隐私政策服务条款
Back to Main Leaderboard

大模型代码编程能力评测排行榜

本页面提供大模型代码编程能力评测排行榜，涵盖 SWE-Bench、LiveCodeBench、HumanEval 等数据集，对 GPT、Claude、Qwen、DeepSeek 等模型进行对比。

Updated on: 2025/10/12 20:54:51

Benchmark switcher

Pick the leaderboard to sync both chart and table

SWE-bench VerifiedLiveCodeBenchHumanEval

More benchmark coverage

Browse the benchmark catalog by category and language

More Benchmarks

Filters

All3B and below7B13B34B65B100B and above
AllReasoning ModelsFoundation ModelsInstruction/Chat ModelsCoding Models

LLM Performance Results

Data source: DataLearnerAI
RankModelSWE-bench VerifiedLiveCodeBenchHumanEvalParams (B)License
1Claude Sonnet 4.582.000.000.00—不开源
2Claude Opus 4.580.900.000.00—不开源
3Claude Opus 4.680.800.000.00—不开源
4Claude Sonnet 480.200.000.00—不开源
5GPT-5.280.000.000.00—不开源
6Claude Opus 4.179.400.000.00—不开源
7Claude Sonnet 4.577.200.000.00—不开源
8GPT-5.1-Codex-Max76.800.000.00—不开源
9Kimi K2.576.8085.000.0010000BFree commercial
10GPT-5.176.300.000.00—不开源
11Gemini 3.0 Pro (Preview 11-2025)76.2092.000.00—不开源
12Qwen3-Max-Thinking75.3085.900.0010000B不开源
13o3-pro75.000.000.00—不开源
14M2.174.800.000.002300BFree commercial
15GPT-5 Codex74.500.000.00—不开源
16Claude Opus 4.174.5065.000.00—不开源
17Claude Opus 4.174.500.000.00—不开源
18Step 3.5 Flash74.4086.400.001960BFree commercial
19GLM-4.773.800.000.003580BFree commercial
20Grok 4 Heavy73.500.000.00—不开源
21Haiku 4.573.300.000.00—不开源
22DeepSeek V3.273.100.000.006710BFree commercial
23GPT-572.800.000.00—不开源
24Claude Sonnet 472.700.000.00—不开源
25Claude Opus 472.5056.600.00—不开源
26Grok 4 Code72.000.000.00—不开源
27Kimi K2 Thinking71.300.000.0010400BFree commercial
28Grok Code Fast 170.800.000.00—不开源
29Qwen3-Coder-Next70.600.000.0080BFree commercial
30GPT-5.1 Codex70.4085.500.00—不开源
31Claude Sonnet 3.770.300.000.00—不开源
32DeepSeek V3.270.2083.300.006710BFree commercial
33Qwen3 Max (Preview)69.6057.500.00—不开源
34MiniMax M269.400.000.002300BFree commercial
35Kimi K2 090569.200.000.0010000BFree commercial
36Kimi K2 090569.200.000.0010000BFree commercial
37OpenAI o369.100.000.00—不开源
38Gemini 3.0 Flash68.700.000.00—不开源
39DeepSeek-V3.1 Terminus68.4074.900.006710BFree commercial
40OpenAI o4 - mini68.100.000.00—不开源
41GLM-4.668.0084.500.003550BFree commercial
42GLM-4.668.0056.000.003550BFree commercial
43DeepSeek V3.2-Exp67.800.000.006710BFree commercial
44Gemini 2.5-Pro67.200.000.00—不开源
45Qwen3-Coder-480B-A35B67.000.000.004800BFree commercial
46DeepSeek-V3.166.0056.400.006710BFree commercial
47Claude Sonnet 4.564.8059.000.00—不开源
48GLM-4.564.2072.900.003550BFree commercial
49Gemini 2.5 Pro Experimental 03-2563.8070.400.00—不开源
50Gemini-2.5-Pro-Preview-05-0663.2077.100.00—不开源
51Devstral Medium61.600.000.00—不开源
52Haiku 4.560.6051.000.00—不开源
53GPT OSS 120B60.100.000.00117BFree commercial
54GLM-4.7-Flash59.200.000.00310BFree commercial
55Grok 458.6082.000.00—不开源
56DeepSeek-R1-052857.6073.300.006710BFree commercial
57GLM-4.5-Air57.6070.700.001060BFree commercial
58MiniMax-M1-80k56.0065.000.004560BFree commercial
59MiniMax-M1-40k55.6062.300.004560BFree commercial
60GPT-4.154.6040.500.00—不开源
61Gemini 2.5 Flash-Preview-09-202554.000.000.00—不开源
62Devstral Small 1.153.600.000.00240BFree commercial
63Kimi K251.8053.700.0010000BFree commercial
64Qwen3-Coder-Flash51.600.000.00305BFree commercial
65Gemini 2.5 Flash50.0041.100.00—不开源
66OpenAI o3-mini (high)49.3069.5097.60—不开源
67DeepSeek-R149.2065.900.006710BFree commercial
68Claude 3.5 Sonnet New49.0038.7093.70—不开源
69OpenAI o148.9071.000.00—不开源
70Gemini 2.5 Flash48.9055.400.00—不开源
71Devstral Small 1.046.800.000.00240BFree commercial
72OpenAI o3-mini40.800.000.00—不开源
73DeepSeek-V3-032438.8049.200.006710BFree commercial
74GPT-4.538.0046.400.00—不开源
75Qwen3-235B-A22B34.4070.700.002350BFree commercial
76GPT OSS 20B34.000.000.00210BFree commercial
77GPT-4o31.0035.1090.00—不开源
78Gemini 2.5 Flash-Lite27.6034.300.00—不开源
79GPT-4.1 mini23.600.000.00—不开源
80Qwen3-30B-A3B-250722.000.000.00305BFree commercial
81Gemini 2.0 Flash Experimental21.4029.100.00—不开源
82OpenAI o30.0075.800.00—不开源
83Pangu Embedded0.0067.100.0070BFree commercial
84Qwen3-32B0.0065.700.00320BFree commercial
85Kimi-k1.6-IOI0.0065.900.00—不开源
86Claude Sonnet 40.0066.000.00—不开源
87Step30.0067.100.003210BFree commercial
88DeepSeek-V3.10.0074.800.006710BFree commercial
89Qwen3-235B-A22B-Thinking-25070.0074.100.002350BFree commercial
90Qwen3-235B-A22B-Thinking0.0074.100.00305BFree commercial
91DeepSeek V3.2-Exp0.0074.100.006710BFree commercial
92Kimi-k1.6-IOI-high0.0073.800.00—不开源
93Claude Sonnet 4.50.0071.000.00—不开源
94Qwen3-235B-A22B0.0070.700.002350BFree commercial
95Grok 30.0070.600.00—不开源
96OpenAI o3-mini (medium)0.0067.400.00—不开源
97QwQ-Max-Preview0.0065.600.00—Free commercial
98GLM-4-9B-Chat0.0051.800.0090BFree commercial
99Gemma 3 - 12B (IT)0.0024.600.00120BFree commercial
100Gemini 2.0 Flash-Lite0.0028.900.00—不开源
101Qwen3-30B-A3B0.0029.000.00305BFree commercial
102Llama 4 Scout Instruct0.0032.800.001090BFree commercial
103Qwen3-4B-25070.0035.100.0040BFree commercial
104GPT-4o(2025-03-27)0.0035.800.00—不开源
105ERNIE-4.5-300B-A47B0.0038.800.003000BFree commercial
106ERNIE-4.5-VL-424B-A47B-Base0.0038.800.004240BFree commercial
107Qwen3-30B-A3B-25070.0043.200.00305BFree commercial
108Llama 4 Maverick Instruct0.0043.400.004000BFree commercial
109Claude Sonnet 40.0048.500.00—不开源
110Llama 4 Behemoth Instruct0.0049.400.0020000BFree commercial
111Qwen3-235B-A22B-25070.0051.800.002350BFree commercial
112MiniMax M20.0083.000.002300BFree commercial
113DeepSeek V3.2-Exp0.0055.000.006710BFree commercial
114GPT-5-mini0.0055.000.00—不开源
115Qwen3-4B-Thinking-25070.0055.200.0040BFree commercial
116Magistral-Small-25060.0055.840.00240BFree commercial
117Qwen3-Next0.0056.600.00800BFree commercial
118Hunyuan-7B0.0057.000.0070BFree commercial
119Qwen3-8B0.0057.500.0080BFree commercial
120Magistral-Medium-25060.0059.360.00—不开源
121Pangu Pro MoE0.0059.600.00719BFree commercial
122Qwen3-8B0.0061.800.0080BFree commercial
123Haiku 4.50.0062.000.00—不开源
124Hunyuan-A13B-Instruct0.0063.900.00800BFree commercial
125Hunyuan-T10.0064.900.00—不开源
126Qwen2.5-Max0.000.0073.20—不开源
127Grok 20.000.0088.402690BFree commercial
128Claude 3.5 Haiku0.000.0088.10—不开源
129Gemma 3 - 27B (IT)0.0029.7087.80270BFree commercial
130GPT-4o mini0.000.0087.20—不开源
131Codestral 25.010.0037.9086.60—不开源
132Claude3-Opus0.000.0084.90—不开源
133Codestral0.0031.5081.10220BNon-commercial
134Llama3.1-70B-Instruct0.0033.3080.50700BFree commercial
135Phi-4-mini-instruct (3.8B)0.000.0074.4038BFree commercial
136Grok-1.50.000.0074.10—不开源
137Llama3.3-70B-Instruct0.0033.3088.40700BFree commercial
138Llama3.1-8B-Instruct0.000.0066.5080BFree commercial
139C4AI Aya Vision 32B0.000.0062.20320BNon-commercial
140Qwen2.5-72B0.000.0059.10727BFree commercial
141Qwen2.5-7B0.000.0057.9070BFree commercial
142Moonlight-16B-A3B-Instruct0.000.0048.10160BFree commercial
143Qwen2.5-3B0.000.0042.1030BFree commercial
144Gemma 2 - 9B0.000.0037.8090BFree commercial
145Llama3.1-8B0.000.0033.5080BFree commercial
146Mistral-7B-Instruct-v0.30.000.0029.3070BFree commercial
147Llama-3.2-3B0.000.0028.0032BFree commercial
148Gemini 2.5 Deep Think0.0087.600.00—不开源
149Grok-3 - Reasoning Beta0.0079.400.00—不开源
150DeepSeek-V3.1 Terminus0.0080.000.006710BFree commercial
151Grok 4 Fast0.0080.000.00—不开源
152Gemini 2.5 Pro Deep Think0.0080.400.00—不开源
153Grok 4.1 Fast0.0082.000.00—不开源
154GLM-4.60.0082.800.003550BFree commercial
155QwQ-32B0.000.0019.00325BFree commercial
156Kimi K2 Thinking0.0083.100.0010400BFree commercial
157GLM-4.70.0084.900.003580BFree commercial
158Claude Opus 4.50.0087.000.00—不开源
159Gemini 2.5-Pro0.0077.100.00—不开源
160OpenAI o1-mini0.0052.0092.40—不开源
161Claude 3.5 Sonnet0.000.0092.00—不开源
162Hunyuan-TurboS0.0032.0091.00—不开源
163GPT-4o(2024-11-20)0.000.0090.20—不开源
164Gemini 1.5 Pro0.000.0089.00—不开源
165Llama3.1-405B Instruct0.0030.2089.004050BFree commercial
166Amazon Nova Pro0.000.0089.00—不开源
167DeepSeek-V30.0034.6089.006810BFree commercial
168Mistral-Small-3.1-24B-Instruct-25030.000.0088.41240BFree commercial
169Qwen2.5-32B0.0051.2088.40320BFree commercial
1
Claude Sonnet 4.5
SWE-bench Verified82.00
LiveCodeBench0.00
HumanEval0.00
不开源
2
Claude Opus 4.5
SWE-bench Verified80.90
LiveCodeBench0.00
HumanEval0.00
不开源
3
Claude Opus 4.6
SWE-bench Verified80.80
LiveCodeBench0.00
HumanEval0.00
不开源
4
Claude Sonnet 4
SWE-bench Verified80.20
LiveCodeBench0.00
HumanEval0.00
不开源
5
GPT-5.2
SWE-bench Verified80.00
LiveCodeBench0.00
HumanEval0.00
不开源
6
Claude Opus 4.1
SWE-bench Verified79.40
LiveCodeBench0.00
HumanEval0.00
不开源
7
Claude Sonnet 4.5
SWE-bench Verified77.20
LiveCodeBench0.00
HumanEval0.00
不开源
8
GPT-5.1-Codex-Max
SWE-bench Verified76.80
LiveCodeBench0.00
HumanEval0.00
不开源
9
Kimi K2.5
10000B
SWE-bench Verified76.80
LiveCodeBench85.00
HumanEval0.00
Free commercial
10
GPT-5.1
SWE-bench Verified76.30
LiveCodeBench0.00
HumanEval0.00
不开源
11
Gemini 3.0 Pro (Preview 11-2025)
SWE-bench Verified76.20
LiveCodeBench92.00
HumanEval0.00
不开源
12
Qwen3-Max-Thinking
10000B
SWE-bench Verified75.30
LiveCodeBench85.90
HumanEval0.00
不开源
13
o3-pro
SWE-bench Verified75.00
LiveCodeBench0.00
HumanEval0.00
不开源
14
M2.1
2300B
SWE-bench Verified74.80
LiveCodeBench0.00
HumanEval0.00
Free commercial
15
GPT-5 Codex
SWE-bench Verified74.50
LiveCodeBench0.00
HumanEval0.00
不开源
16
Claude Opus 4.1
SWE-bench Verified74.50
LiveCodeBench65.00
HumanEval0.00
不开源
17
Claude Opus 4.1
SWE-bench Verified74.50
LiveCodeBench0.00
HumanEval0.00
不开源
18
Step 3.5 Flash
1960B
SWE-bench Verified74.40
LiveCodeBench86.40
HumanEval0.00
Free commercial
19
GLM-4.7
3580B
SWE-bench Verified73.80
LiveCodeBench0.00
HumanEval0.00
Free commercial
20
Grok 4 Heavy
SWE-bench Verified73.50
LiveCodeBench0.00
HumanEval0.00
不开源
21
Haiku 4.5
SWE-bench Verified73.30
LiveCodeBench0.00
HumanEval0.00
不开源
22
DeepSeek V3.2
6710B
SWE-bench Verified73.10
LiveCodeBench0.00
HumanEval0.00
Free commercial
23
GPT-5
SWE-bench Verified72.80
LiveCodeBench0.00
HumanEval0.00
不开源
24
Claude Sonnet 4
SWE-bench Verified72.70
LiveCodeBench0.00
HumanEval0.00
不开源
25
Claude Opus 4
SWE-bench Verified72.50
LiveCodeBench56.60
HumanEval0.00
不开源
26
Grok 4 Code
SWE-bench Verified72.00
LiveCodeBench0.00
HumanEval0.00
不开源
27
Kimi K2 Thinking
10400B
SWE-bench Verified71.30
LiveCodeBench0.00
HumanEval0.00
Free commercial
28
Grok Code Fast 1
SWE-bench Verified70.80
LiveCodeBench0.00
HumanEval0.00
不开源
29
Qwen3-Coder-Next
80B
SWE-bench Verified70.60
LiveCodeBench0.00
HumanEval0.00
Free commercial
30
GPT-5.1 Codex
SWE-bench Verified70.40
LiveCodeBench85.50
HumanEval0.00
不开源
31
Claude Sonnet 3.7
SWE-bench Verified70.30
LiveCodeBench0.00
HumanEval0.00
不开源
32
DeepSeek V3.2
6710B
SWE-bench Verified70.20
LiveCodeBench83.30
HumanEval0.00
Free commercial
33
Qwen3 Max (Preview)
SWE-bench Verified69.60
LiveCodeBench57.50
HumanEval0.00
不开源
34
MiniMax M2
2300B
SWE-bench Verified69.40
LiveCodeBench0.00
HumanEval0.00
Free commercial
35
Kimi K2 0905
10000B
SWE-bench Verified69.20
LiveCodeBench0.00
HumanEval0.00
Free commercial
36
Kimi K2 0905
10000B
SWE-bench Verified69.20
LiveCodeBench0.00
HumanEval0.00
Free commercial
37
OpenAI o3
SWE-bench Verified69.10
LiveCodeBench0.00
HumanEval0.00
不开源
38
Gemini 3.0 Flash
SWE-bench Verified68.70
LiveCodeBench0.00
HumanEval0.00
不开源
39
DeepSeek-V3.1 Terminus
6710B
SWE-bench Verified68.40
LiveCodeBench74.90
HumanEval0.00
Free commercial
40
OpenAI o4 - mini
SWE-bench Verified68.10
LiveCodeBench0.00
HumanEval0.00
不开源
41
GLM-4.6
3550B
SWE-bench Verified68.00
LiveCodeBench84.50
HumanEval0.00
Free commercial
42
GLM-4.6
3550B
SWE-bench Verified68.00
LiveCodeBench56.00
HumanEval0.00
Free commercial
43
DeepSeek V3.2-Exp
6710B
SWE-bench Verified67.80
LiveCodeBench0.00
HumanEval0.00
Free commercial
44
Gemini 2.5-Pro
SWE-bench Verified67.20
LiveCodeBench0.00
HumanEval0.00
不开源
45
Qwen3-Coder-480B-A35B
4800B
SWE-bench Verified67.00
LiveCodeBench0.00
HumanEval0.00
Free commercial
46
DeepSeek-V3.1
6710B
SWE-bench Verified66.00
LiveCodeBench56.40
HumanEval0.00
Free commercial
47
Claude Sonnet 4.5
SWE-bench Verified64.80
LiveCodeBench59.00
HumanEval0.00
不开源
48
GLM-4.5
3550B
SWE-bench Verified64.20
LiveCodeBench72.90
HumanEval0.00
Free commercial
49
Gemini 2.5 Pro Experimental 03-25
SWE-bench Verified63.80
LiveCodeBench70.40
HumanEval0.00
不开源
50
Gemini-2.5-Pro-Preview-05-06
SWE-bench Verified63.20
LiveCodeBench77.10
HumanEval0.00
不开源
51
Devstral Medium
SWE-bench Verified61.60
LiveCodeBench0.00
HumanEval0.00
不开源
52
Haiku 4.5
SWE-bench Verified60.60
LiveCodeBench51.00
HumanEval0.00
不开源
53
GPT OSS 120B
117B
SWE-bench Verified60.10
LiveCodeBench0.00
HumanEval0.00
Free commercial
54
GLM-4.7-Flash
310B
SWE-bench Verified59.20
LiveCodeBench0.00
HumanEval0.00
Free commercial
55
Grok 4
SWE-bench Verified58.60
LiveCodeBench82.00
HumanEval0.00
不开源
56
DeepSeek-R1-0528
6710B
SWE-bench Verified57.60
LiveCodeBench73.30
HumanEval0.00
Free commercial
57
GLM-4.5-Air
1060B
SWE-bench Verified57.60
LiveCodeBench70.70
HumanEval0.00
Free commercial
58
MiniMax-M1-80k
4560B
SWE-bench Verified56.00
LiveCodeBench65.00
HumanEval0.00
Free commercial
59
MiniMax-M1-40k
4560B
SWE-bench Verified55.60
LiveCodeBench62.30
HumanEval0.00
Free commercial
60
GPT-4.1
SWE-bench Verified54.60
LiveCodeBench40.50
HumanEval0.00
不开源
61
Gemini 2.5 Flash-Preview-09-2025
SWE-bench Verified54.00
LiveCodeBench0.00
HumanEval0.00
不开源
62
Devstral Small 1.1
240B
SWE-bench Verified53.60
LiveCodeBench0.00
HumanEval0.00
Free commercial
63
Kimi K2
10000B
SWE-bench Verified51.80
LiveCodeBench53.70
HumanEval0.00
Free commercial
64
Qwen3-Coder-Flash
305B
SWE-bench Verified51.60
LiveCodeBench0.00
HumanEval0.00
Free commercial
65
Gemini 2.5 Flash
SWE-bench Verified50.00
LiveCodeBench41.10
HumanEval0.00
不开源
66
OpenAI o3-mini (high)
SWE-bench Verified49.30
LiveCodeBench69.50
HumanEval97.60
不开源
67
DeepSeek-R1
6710B
SWE-bench Verified49.20
LiveCodeBench65.90
HumanEval0.00
Free commercial
68
Claude 3.5 Sonnet New
SWE-bench Verified49.00
LiveCodeBench38.70
HumanEval93.70
不开源
69
OpenAI o1
SWE-bench Verified48.90
LiveCodeBench71.00
HumanEval0.00
不开源
70
Gemini 2.5 Flash
SWE-bench Verified48.90
LiveCodeBench55.40
HumanEval0.00
不开源
71
Devstral Small 1.0
240B
SWE-bench Verified46.80
LiveCodeBench0.00
HumanEval0.00
Free commercial
72
OpenAI o3-mini
SWE-bench Verified40.80
LiveCodeBench0.00
HumanEval0.00
不开源
73
DeepSeek-V3-0324
6710B
SWE-bench Verified38.80
LiveCodeBench49.20
HumanEval0.00
Free commercial
74
GPT-4.5
SWE-bench Verified38.00
LiveCodeBench46.40
HumanEval0.00
不开源
75
Qwen3-235B-A22B
2350B
SWE-bench Verified34.40
LiveCodeBench70.70
HumanEval0.00
Free commercial
76
GPT OSS 20B
210B
SWE-bench Verified34.00
LiveCodeBench0.00
HumanEval0.00
Free commercial
77
GPT-4o
SWE-bench Verified31.00
LiveCodeBench35.10
HumanEval90.00
不开源
78
Gemini 2.5 Flash-Lite
SWE-bench Verified27.60
LiveCodeBench34.30
HumanEval0.00
不开源
79
GPT-4.1 mini
SWE-bench Verified23.60
LiveCodeBench0.00
HumanEval0.00
不开源
80
Qwen3-30B-A3B-2507
305B
SWE-bench Verified22.00
LiveCodeBench0.00
HumanEval0.00
Free commercial
81
Gemini 2.0 Flash Experimental
SWE-bench Verified21.40
LiveCodeBench29.10
HumanEval0.00
不开源
82
OpenAI o3
SWE-bench Verified0.00
LiveCodeBench75.80
HumanEval0.00
不开源
83
Pangu Embedded
70B
SWE-bench Verified0.00
LiveCodeBench67.10
HumanEval0.00
Free commercial
84
Qwen3-32B
320B
SWE-bench Verified0.00
LiveCodeBench65.70
HumanEval0.00
Free commercial
85
Kimi-k1.6-IOI
SWE-bench Verified0.00
LiveCodeBench65.90
HumanEval0.00
不开源
86
Claude Sonnet 4
SWE-bench Verified0.00
LiveCodeBench66.00
HumanEval0.00
不开源
87
Step3
3210B
SWE-bench Verified0.00
LiveCodeBench67.10
HumanEval0.00
Free commercial
88
DeepSeek-V3.1
6710B
SWE-bench Verified0.00
LiveCodeBench74.80
HumanEval0.00
Free commercial
89
Qwen3-235B-A22B-Thinking-2507
2350B
SWE-bench Verified0.00
LiveCodeBench74.10
HumanEval0.00
Free commercial
90
Qwen3-235B-A22B-Thinking
305B
SWE-bench Verified0.00
LiveCodeBench74.10
HumanEval0.00
Free commercial
91
DeepSeek V3.2-Exp
6710B
SWE-bench Verified0.00
LiveCodeBench74.10
HumanEval0.00
Free commercial
92
Kimi-k1.6-IOI-high
SWE-bench Verified0.00
LiveCodeBench73.80
HumanEval0.00
不开源
93
Claude Sonnet 4.5
SWE-bench Verified0.00
LiveCodeBench71.00
HumanEval0.00
不开源
94
Qwen3-235B-A22B
2350B
SWE-bench Verified0.00
LiveCodeBench70.70
HumanEval0.00
Free commercial
95
Grok 3
SWE-bench Verified0.00
LiveCodeBench70.60
HumanEval0.00
不开源
96
OpenAI o3-mini (medium)
SWE-bench Verified0.00
LiveCodeBench67.40
HumanEval0.00
不开源
97
QwQ-Max-Preview
SWE-bench Verified0.00
LiveCodeBench65.60
HumanEval0.00
Free commercial
98
GLM-4-9B-Chat
90B
SWE-bench Verified0.00
LiveCodeBench51.80
HumanEval0.00
Free commercial
99
Gemma 3 - 12B (IT)
120B
SWE-bench Verified0.00
LiveCodeBench24.60
HumanEval0.00
Free commercial
100
Gemini 2.0 Flash-Lite
SWE-bench Verified0.00
LiveCodeBench28.90
HumanEval0.00
不开源
101
Qwen3-30B-A3B
305B
SWE-bench Verified0.00
LiveCodeBench29.00
HumanEval0.00
Free commercial
102
Llama 4 Scout Instruct
1090B
SWE-bench Verified0.00
LiveCodeBench32.80
HumanEval0.00
Free commercial
103
Qwen3-4B-2507
40B
SWE-bench Verified0.00
LiveCodeBench35.10
HumanEval0.00
Free commercial
104
GPT-4o(2025-03-27)
SWE-bench Verified0.00
LiveCodeBench35.80
HumanEval0.00
不开源
105
ERNIE-4.5-300B-A47B
3000B
SWE-bench Verified0.00
LiveCodeBench38.80
HumanEval0.00
Free commercial
106
ERNIE-4.5-VL-424B-A47B-Base
4240B
SWE-bench Verified0.00
LiveCodeBench38.80
HumanEval0.00
Free commercial
107
Qwen3-30B-A3B-2507
305B
SWE-bench Verified0.00
LiveCodeBench43.20
HumanEval0.00
Free commercial
108
Llama 4 Maverick Instruct
4000B
SWE-bench Verified0.00
LiveCodeBench43.40
HumanEval0.00
Free commercial
109
Claude Sonnet 4
SWE-bench Verified0.00
LiveCodeBench48.50
HumanEval0.00
不开源
110
Llama 4 Behemoth Instruct
20000B
SWE-bench Verified0.00
LiveCodeBench49.40
HumanEval0.00
Free commercial
111
Qwen3-235B-A22B-2507
2350B
SWE-bench Verified0.00
LiveCodeBench51.80
HumanEval0.00
Free commercial
112
MiniMax M2
2300B
SWE-bench Verified0.00
LiveCodeBench83.00
HumanEval0.00
Free commercial
113
DeepSeek V3.2-Exp
6710B
SWE-bench Verified0.00
LiveCodeBench55.00
HumanEval0.00
Free commercial
114
GPT-5-mini
SWE-bench Verified0.00
LiveCodeBench55.00
HumanEval0.00
不开源
115
Qwen3-4B-Thinking-2507
40B
SWE-bench Verified0.00
LiveCodeBench55.20
HumanEval0.00
Free commercial
116
Magistral-Small-2506
240B
SWE-bench Verified0.00
LiveCodeBench55.84
HumanEval0.00
Free commercial
117
Qwen3-Next
800B
SWE-bench Verified0.00
LiveCodeBench56.60
HumanEval0.00
Free commercial
118
Hunyuan-7B
70B
SWE-bench Verified0.00
LiveCodeBench57.00
HumanEval0.00
Free commercial
119
Qwen3-8B
80B
SWE-bench Verified0.00
LiveCodeBench57.50
HumanEval0.00
Free commercial
120
Magistral-Medium-2506
SWE-bench Verified0.00
LiveCodeBench59.36
HumanEval0.00
不开源
121
Pangu Pro MoE
719B
SWE-bench Verified0.00
LiveCodeBench59.60
HumanEval0.00
Free commercial
122
Qwen3-8B
80B
SWE-bench Verified0.00
LiveCodeBench61.80
HumanEval0.00
Free commercial
123
Haiku 4.5
SWE-bench Verified0.00
LiveCodeBench62.00
HumanEval0.00
不开源
124
Hunyuan-A13B-Instruct
800B
SWE-bench Verified0.00
LiveCodeBench63.90
HumanEval0.00
Free commercial
125
Hunyuan-T1
SWE-bench Verified0.00
LiveCodeBench64.90
HumanEval0.00
不开源
126
Qwen2.5-Max
SWE-bench Verified0.00
LiveCodeBench0.00
HumanEval73.20
不开源
127
Grok 2
2690B
SWE-bench Verified0.00
LiveCodeBench0.00
HumanEval88.40
Free commercial
128
Claude 3.5 Haiku
SWE-bench Verified0.00
LiveCodeBench0.00
HumanEval88.10
不开源
129
Gemma 3 - 27B (IT)
270B
SWE-bench Verified0.00
LiveCodeBench29.70
HumanEval87.80
Free commercial
130
GPT-4o mini
SWE-bench Verified0.00
LiveCodeBench0.00
HumanEval87.20
不开源
131
Codestral 25.01
SWE-bench Verified0.00
LiveCodeBench37.90
HumanEval86.60
不开源
132
Claude3-Opus
SWE-bench Verified0.00
LiveCodeBench0.00
HumanEval84.90
不开源
133
Codestral
220B
SWE-bench Verified0.00
LiveCodeBench31.50
HumanEval81.10
Non-commercial
134
Llama3.1-70B-Instruct
700B
SWE-bench Verified0.00
LiveCodeBench33.30
HumanEval80.50
Free commercial
135
Phi-4-mini-instruct (3.8B)
38B
SWE-bench Verified0.00
LiveCodeBench0.00
HumanEval74.40
Free commercial
136
Grok-1.5
SWE-bench Verified0.00
LiveCodeBench0.00
HumanEval74.10
不开源
137
Llama3.3-70B-Instruct
700B
SWE-bench Verified0.00
LiveCodeBench33.30
HumanEval88.40
Free commercial
138
Llama3.1-8B-Instruct
80B
SWE-bench Verified0.00
LiveCodeBench0.00
HumanEval66.50
Free commercial
139
C4AI Aya Vision 32B
320B
SWE-bench Verified0.00
LiveCodeBench0.00
HumanEval62.20
Non-commercial
140
Qwen2.5-72B
727B
SWE-bench Verified0.00
LiveCodeBench0.00
HumanEval59.10
Free commercial
141
Qwen2.5-7B
70B
SWE-bench Verified0.00
LiveCodeBench0.00
HumanEval57.90
Free commercial
142
Moonlight-16B-A3B-Instruct
160B
SWE-bench Verified0.00
LiveCodeBench0.00
HumanEval48.10
Free commercial
143
Qwen2.5-3B
30B
SWE-bench Verified0.00
LiveCodeBench0.00
HumanEval42.10
Free commercial
144
Gemma 2 - 9B
90B
SWE-bench Verified0.00
LiveCodeBench0.00
HumanEval37.80
Free commercial
145
Llama3.1-8B
80B
SWE-bench Verified0.00
LiveCodeBench0.00
HumanEval33.50
Free commercial
146
Mistral-7B-Instruct-v0.3
70B
SWE-bench Verified0.00
LiveCodeBench0.00
HumanEval29.30
Free commercial
147
Llama-3.2-3B
32B
SWE-bench Verified0.00
LiveCodeBench0.00
HumanEval28.00
Free commercial
148
Gemini 2.5 Deep Think
SWE-bench Verified0.00
LiveCodeBench87.60
HumanEval0.00
不开源
149
Grok-3 - Reasoning Beta
SWE-bench Verified0.00
LiveCodeBench79.40
HumanEval0.00
不开源
150
DeepSeek-V3.1 Terminus
6710B
SWE-bench Verified0.00
LiveCodeBench80.00
HumanEval0.00
Free commercial
151
Grok 4 Fast
SWE-bench Verified0.00
LiveCodeBench80.00
HumanEval0.00
不开源
152
Gemini 2.5 Pro Deep Think
SWE-bench Verified0.00
LiveCodeBench80.40
HumanEval0.00
不开源
153
Grok 4.1 Fast
SWE-bench Verified0.00
LiveCodeBench82.00
HumanEval0.00
不开源
154
GLM-4.6
3550B
SWE-bench Verified0.00
LiveCodeBench82.80
HumanEval0.00
Free commercial
155
QwQ-32B
325B
SWE-bench Verified0.00
LiveCodeBench0.00
HumanEval19.00
Free commercial
156
Kimi K2 Thinking
10400B
SWE-bench Verified0.00
LiveCodeBench83.10
HumanEval0.00
Free commercial
157
GLM-4.7
3580B
SWE-bench Verified0.00
LiveCodeBench84.90
HumanEval0.00
Free commercial
158
Claude Opus 4.5
SWE-bench Verified0.00
LiveCodeBench87.00
HumanEval0.00
不开源
159
Gemini 2.5-Pro
SWE-bench Verified0.00
LiveCodeBench77.10
HumanEval0.00
不开源
160
OpenAI o1-mini
SWE-bench Verified0.00
LiveCodeBench52.00
HumanEval92.40
不开源
161
Claude 3.5 Sonnet
SWE-bench Verified0.00
LiveCodeBench0.00
HumanEval92.00
不开源
162
Hunyuan-TurboS
SWE-bench Verified0.00
LiveCodeBench32.00
HumanEval91.00
不开源
163
GPT-4o(2024-11-20)
SWE-bench Verified0.00
LiveCodeBench0.00
HumanEval90.20
不开源
164
Gemini 1.5 Pro
SWE-bench Verified0.00
LiveCodeBench0.00
HumanEval89.00
不开源
165
Llama3.1-405B Instruct
4050B
SWE-bench Verified0.00
LiveCodeBench30.20
HumanEval89.00
Free commercial
166
Amazon Nova Pro
SWE-bench Verified0.00
LiveCodeBench0.00
HumanEval89.00
不开源
167
DeepSeek-V3
6810B
SWE-bench Verified0.00
LiveCodeBench34.60
HumanEval89.00
Free commercial
168
Mistral-Small-3.1-24B-Instruct-2503
240B
SWE-bench Verified0.00
LiveCodeBench0.00
HumanEval88.41
Free commercial
169
Qwen2.5-32B
320B
SWE-bench Verified0.00
LiveCodeBench51.20
HumanEval88.40
Free commercial