加载中...

大模型代码编程能力评测排行榜

本页面提供大模型代码编程能力评测排行榜，涵盖 SWE-Bench、LiveCodeBench、HumanEval 等数据集，对 GPT、Claude、Qwen、DeepSeek 等模型进行对比。

Updated on: 2025/10/12 20:54:51

Benchmark switcher

Pick the leaderboard to sync both chart and table

SWE-bench Verified LiveCodeBench HumanEval

More benchmark coverage

Browse the benchmark catalog by category and language

More Benchmarks

Filters

Model Size

All 3B and below 7B 13B 34B 65B 100B and above

Model Type

All Reasoning Models Foundation Models Instruction/Chat Models Coding Models

LLM Performance Results

Data source: DataLearnerAI

Rank	Model	SWE-bench Verified	LiveCodeBench	HumanEval	Params (B)	License
1	Claude Sonnet 4.5	82.00	0.00	0.00	—	不开源
2	Claude Opus 4.5	80.90	0.00	0.00	—	不开源
3	Claude Opus 4.6	80.80	0.00	0.00	—	不开源
4	Claude Sonnet 4	80.20	0.00	0.00	—	不开源
5	GPT-5.2	80.00	0.00	0.00	—	不开源
6	Claude Opus 4.1	79.40	0.00	0.00	—	不开源
7	Claude Sonnet 4.5	77.20	0.00	0.00	—	不开源
8	GPT-5.1-Codex-Max	76.80	0.00	0.00	—	不开源
9	Kimi K2.5	76.80	85.00	0.00	10000B	Free commercial
10	GPT-5.1	76.30	0.00	0.00	—	不开源
11	Gemini 3.0 Pro (Preview 11-2025)	76.20	92.00	0.00	—	不开源
12	Qwen3-Max-Thinking	75.30	85.90	0.00	10000B	不开源
13	o3-pro	75.00	0.00	0.00	—	不开源
14	M2.1	74.80	0.00	0.00	2300B	Free commercial
15	GPT-5 Codex	74.50	0.00	0.00	—	不开源
16	Claude Opus 4.1	74.50	65.00	0.00	—	不开源
17	Claude Opus 4.1	74.50	0.00	0.00	—	不开源
18	Step 3.5 Flash	74.40	86.40	0.00	1960B	Free commercial
19	GLM-4.7	73.80	0.00	0.00	3580B	Free commercial
20	Grok 4 Heavy	73.50	0.00	0.00	—	不开源
21	Haiku 4.5	73.30	0.00	0.00	—	不开源
22	DeepSeek V3.2	73.10	0.00	0.00	6710B	Free commercial
23	GPT-5	72.80	0.00	0.00	—	不开源
24	Claude Sonnet 4	72.70	0.00	0.00	—	不开源
25	Claude Opus 4	72.50	56.60	0.00	—	不开源
26	Grok 4 Code	72.00	0.00	0.00	—	不开源
27	Kimi K2 Thinking	71.30	0.00	0.00	10400B	Free commercial
28	Grok Code Fast 1	70.80	0.00	0.00	—	不开源
29	Qwen3-Coder-Next	70.60	0.00	0.00	80B	Free commercial
30	GPT-5.1 Codex	70.40	85.50	0.00	—	不开源
31	Claude Sonnet 3.7	70.30	0.00	0.00	—	不开源
32	DeepSeek V3.2	70.20	83.30	0.00	6710B	Free commercial
33	Qwen3 Max (Preview)	69.60	57.50	0.00	—	不开源
34	MiniMax M2	69.40	0.00	0.00	2300B	Free commercial
35	Kimi K2 0905	69.20	0.00	0.00	10000B	Free commercial
36	Kimi K2 0905	69.20	0.00	0.00	10000B	Free commercial
37	OpenAI o3	69.10	0.00	0.00	—	不开源
38	Gemini 3.0 Flash	68.70	0.00	0.00	—	不开源
39	DeepSeek-V3.1 Terminus	68.40	74.90	0.00	6710B	Free commercial
40	OpenAI o4 - mini	68.10	0.00	0.00	—	不开源
41	GLM-4.6	68.00	84.50	0.00	3550B	Free commercial
42	GLM-4.6	68.00	56.00	0.00	3550B	Free commercial
43	DeepSeek V3.2-Exp	67.80	0.00	0.00	6710B	Free commercial
44	Gemini 2.5-Pro	67.20	0.00	0.00	—	不开源
45	Qwen3-Coder-480B-A35B	67.00	0.00	0.00	4800B	Free commercial
46	DeepSeek-V3.1	66.00	56.40	0.00	6710B	Free commercial
47	Claude Sonnet 4.5	64.80	59.00	0.00	—	不开源
48	GLM-4.5	64.20	72.90	0.00	3550B	Free commercial
49	Gemini 2.5 Pro Experimental 03-25	63.80	70.40	0.00	—	不开源
50	Gemini-2.5-Pro-Preview-05-06	63.20	77.10	0.00	—	不开源
51	Devstral Medium	61.60	0.00	0.00	—	不开源
52	Haiku 4.5	60.60	51.00	0.00	—	不开源
53	GPT OSS 120B	60.10	0.00	0.00	117B	Free commercial
54	GLM-4.7-Flash	59.20	0.00	0.00	310B	Free commercial
55	Grok 4	58.60	82.00	0.00	—	不开源
56	DeepSeek-R1-0528	57.60	73.30	0.00	6710B	Free commercial
57	GLM-4.5-Air	57.60	70.70	0.00	1060B	Free commercial
58	MiniMax-M1-80k	56.00	65.00	0.00	4560B	Free commercial
59	MiniMax-M1-40k	55.60	62.30	0.00	4560B	Free commercial
60	GPT-4.1	54.60	40.50	0.00	—	不开源
61	Gemini 2.5 Flash-Preview-09-2025	54.00	0.00	0.00	—	不开源
62	Devstral Small 1.1	53.60	0.00	0.00	240B	Free commercial
63	Kimi K2	51.80	53.70	0.00	10000B	Free commercial
64	Qwen3-Coder-Flash	51.60	0.00	0.00	305B	Free commercial
65	Gemini 2.5 Flash	50.00	41.10	0.00	—	不开源
66	OpenAI o3-mini (high)	49.30	69.50	97.60	—	不开源
67	DeepSeek-R1	49.20	65.90	0.00	6710B	Free commercial
68	Claude 3.5 Sonnet New	49.00	38.70	93.70	—	不开源
69	OpenAI o1	48.90	71.00	0.00	—	不开源
70	Gemini 2.5 Flash	48.90	55.40	0.00	—	不开源
71	Devstral Small 1.0	46.80	0.00	0.00	240B	Free commercial
72	OpenAI o3-mini	40.80	0.00	0.00	—	不开源
73	DeepSeek-V3-0324	38.80	49.20	0.00	6710B	Free commercial
74	GPT-4.5	38.00	46.40	0.00	—	不开源
75	Qwen3-235B-A22B	34.40	70.70	0.00	2350B	Free commercial
76	GPT OSS 20B	34.00	0.00	0.00	210B	Free commercial
77	GPT-4o	31.00	35.10	90.00	—	不开源
78	Gemini 2.5 Flash-Lite	27.60	34.30	0.00	—	不开源
79	GPT-4.1 mini	23.60	0.00	0.00	—	不开源
80	Qwen3-30B-A3B-2507	22.00	0.00	0.00	305B	Free commercial
81	Gemini 2.0 Flash Experimental	21.40	29.10	0.00	—	不开源
82	OpenAI o3	0.00	75.80	0.00	—	不开源
83	Pangu Embedded	0.00	67.10	0.00	70B	Free commercial
84	Qwen3-32B	0.00	65.70	0.00	320B	Free commercial
85	Kimi-k1.6-IOI	0.00	65.90	0.00	—	不开源
86	Claude Sonnet 4	0.00	66.00	0.00	—	不开源
87	Step3	0.00	67.10	0.00	3210B	Free commercial
88	DeepSeek-V3.1	0.00	74.80	0.00	6710B	Free commercial
89	Qwen3-235B-A22B-Thinking-2507	0.00	74.10	0.00	2350B	Free commercial
90	Qwen3-235B-A22B-Thinking	0.00	74.10	0.00	305B	Free commercial
91	DeepSeek V3.2-Exp	0.00	74.10	0.00	6710B	Free commercial
92	Kimi-k1.6-IOI-high	0.00	73.80	0.00	—	不开源
93	Claude Sonnet 4.5	0.00	71.00	0.00	—	不开源
94	Qwen3-235B-A22B	0.00	70.70	0.00	2350B	Free commercial
95	Grok 3	0.00	70.60	0.00	—	不开源
96	OpenAI o3-mini (medium)	0.00	67.40	0.00	—	不开源
97	QwQ-Max-Preview	0.00	65.60	0.00	—	Free commercial
98	GLM-4-9B-Chat	0.00	51.80	0.00	90B	Free commercial
99	Gemma 3 - 12B (IT)	0.00	24.60	0.00	120B	Free commercial
100	Gemini 2.0 Flash-Lite	0.00	28.90	0.00	—	不开源
101	Qwen3-30B-A3B	0.00	29.00	0.00	305B	Free commercial
102	Llama 4 Scout Instruct	0.00	32.80	0.00	1090B	Free commercial
103	Qwen3-4B-2507	0.00	35.10	0.00	40B	Free commercial
104	GPT-4o(2025-03-27)	0.00	35.80	0.00	—	不开源
105	ERNIE-4.5-300B-A47B	0.00	38.80	0.00	3000B	Free commercial
106	ERNIE-4.5-VL-424B-A47B-Base	0.00	38.80	0.00	4240B	Free commercial
107	Qwen3-30B-A3B-2507	0.00	43.20	0.00	305B	Free commercial
108	Llama 4 Maverick Instruct	0.00	43.40	0.00	4000B	Free commercial
109	Claude Sonnet 4	0.00	48.50	0.00	—	不开源
110	Llama 4 Behemoth Instruct	0.00	49.40	0.00	20000B	Free commercial
111	Qwen3-235B-A22B-2507	0.00	51.80	0.00	2350B	Free commercial
112	MiniMax M2	0.00	83.00	0.00	2300B	Free commercial
113	DeepSeek V3.2-Exp	0.00	55.00	0.00	6710B	Free commercial
114	GPT-5-mini	0.00	55.00	0.00	—	不开源
115	Qwen3-4B-Thinking-2507	0.00	55.20	0.00	40B	Free commercial
116	Magistral-Small-2506	0.00	55.84	0.00	240B	Free commercial
117	Qwen3-Next	0.00	56.60	0.00	800B	Free commercial
118	Hunyuan-7B	0.00	57.00	0.00	70B	Free commercial
119	Qwen3-8B	0.00	57.50	0.00	80B	Free commercial
120	Magistral-Medium-2506	0.00	59.36	0.00	—	不开源
121	Pangu Pro MoE	0.00	59.60	0.00	719B	Free commercial
122	Qwen3-8B	0.00	61.80	0.00	80B	Free commercial
123	Haiku 4.5	0.00	62.00	0.00	—	不开源
124	Hunyuan-A13B-Instruct	0.00	63.90	0.00	800B	Free commercial
125	Hunyuan-T1	0.00	64.90	0.00	—	不开源
126	Qwen2.5-Max	0.00	0.00	73.20	—	不开源
127	Grok 2	0.00	0.00	88.40	2690B	Free commercial
128	Claude 3.5 Haiku	0.00	0.00	88.10	—	不开源
129	Gemma 3 - 27B (IT)	0.00	29.70	87.80	270B	Free commercial
130	GPT-4o mini	0.00	0.00	87.20	—	不开源
131	Codestral 25.01	0.00	37.90	86.60	—	不开源
132	Claude3-Opus	0.00	0.00	84.90	—	不开源
133	Codestral	0.00	31.50	81.10	220B	Non-commercial
134	Llama3.1-70B-Instruct	0.00	33.30	80.50	700B	Free commercial
135	Phi-4-mini-instruct (3.8B)	0.00	0.00	74.40	38B	Free commercial
136	Grok-1.5	0.00	0.00	74.10	—	不开源
137	Llama3.3-70B-Instruct	0.00	33.30	88.40	700B	Free commercial
138	Llama3.1-8B-Instruct	0.00	0.00	66.50	80B	Free commercial
139	C4AI Aya Vision 32B	0.00	0.00	62.20	320B	Non-commercial
140	Qwen2.5-72B	0.00	0.00	59.10	727B	Free commercial
141	Qwen2.5-7B	0.00	0.00	57.90	70B	Free commercial
142	Moonlight-16B-A3B-Instruct	0.00	0.00	48.10	160B	Free commercial
143	Qwen2.5-3B	0.00	0.00	42.10	30B	Free commercial
144	Gemma 2 - 9B	0.00	0.00	37.80	90B	Free commercial
145	Llama3.1-8B	0.00	0.00	33.50	80B	Free commercial
146	Mistral-7B-Instruct-v0.3	0.00	0.00	29.30	70B	Free commercial
147	Llama-3.2-3B	0.00	0.00	28.00	32B	Free commercial
148	Gemini 2.5 Deep Think	0.00	87.60	0.00	—	不开源
149	Grok-3 - Reasoning Beta	0.00	79.40	0.00	—	不开源
150	DeepSeek-V3.1 Terminus	0.00	80.00	0.00	6710B	Free commercial
151	Grok 4 Fast	0.00	80.00	0.00	—	不开源
152	Gemini 2.5 Pro Deep Think	0.00	80.40	0.00	—	不开源
153	Grok 4.1 Fast	0.00	82.00	0.00	—	不开源
154	GLM-4.6	0.00	82.80	0.00	3550B	Free commercial
155	QwQ-32B	0.00	0.00	19.00	325B	Free commercial
156	Kimi K2 Thinking	0.00	83.10	0.00	10400B	Free commercial
157	GLM-4.7	0.00	84.90	0.00	3580B	Free commercial
158	Claude Opus 4.5	0.00	87.00	0.00	—	不开源
159	Gemini 2.5-Pro	0.00	77.10	0.00	—	不开源
160	OpenAI o1-mini	0.00	52.00	92.40	—	不开源
161	Claude 3.5 Sonnet	0.00	0.00	92.00	—	不开源
162	Hunyuan-TurboS	0.00	32.00	91.00	—	不开源
163	GPT-4o(2024-11-20)	0.00	0.00	90.20	—	不开源
164	Gemini 1.5 Pro	0.00	0.00	89.00	—	不开源
165	Llama3.1-405B Instruct	0.00	30.20	89.00	4050B	Free commercial
166	Amazon Nova Pro	0.00	0.00	89.00	—	不开源
167	DeepSeek-V3	0.00	34.60	89.00	6810B	Free commercial
168	Mistral-Small-3.1-24B-Instruct-2503	0.00	0.00	88.41	240B	Free commercial
169	Qwen2.5-32B	0.00	51.20	88.40	320B	Free commercial

Claude Sonnet 4.5

SWE-bench Verified82.00

LiveCodeBench0.00

HumanEval0.00

不开源

Claude Opus 4.5

SWE-bench Verified80.90

LiveCodeBench0.00

HumanEval0.00

不开源

Claude Opus 4.6

SWE-bench Verified80.80

LiveCodeBench0.00

HumanEval0.00

不开源

Claude Sonnet 4

SWE-bench Verified80.20

LiveCodeBench0.00

HumanEval0.00

不开源

GPT-5.2

SWE-bench Verified80.00

LiveCodeBench0.00

HumanEval0.00

不开源

Claude Opus 4.1

SWE-bench Verified79.40

LiveCodeBench0.00

HumanEval0.00

不开源

Claude Sonnet 4.5

SWE-bench Verified77.20

LiveCodeBench0.00

HumanEval0.00

不开源

GPT-5.1-Codex-Max

SWE-bench Verified76.80

LiveCodeBench0.00

HumanEval0.00

不开源

Kimi K2.5

10000B

SWE-bench Verified76.80

LiveCodeBench85.00

HumanEval0.00

Free commercial

GPT-5.1

SWE-bench Verified76.30

LiveCodeBench0.00

HumanEval0.00

不开源

Gemini 3.0 Pro (Preview 11-2025)

SWE-bench Verified76.20

LiveCodeBench92.00

HumanEval0.00

不开源

Qwen3-Max-Thinking

10000B

SWE-bench Verified75.30

LiveCodeBench85.90

HumanEval0.00

不开源

o3-pro

SWE-bench Verified75.00

LiveCodeBench0.00

HumanEval0.00

不开源

M2.1

2300B

SWE-bench Verified74.80

LiveCodeBench0.00

HumanEval0.00

Free commercial

GPT-5 Codex

SWE-bench Verified74.50

LiveCodeBench0.00

HumanEval0.00

不开源

Claude Opus 4.1

SWE-bench Verified74.50

LiveCodeBench65.00

HumanEval0.00

不开源

Claude Opus 4.1

SWE-bench Verified74.50

LiveCodeBench0.00

HumanEval0.00

不开源

Step 3.5 Flash

1960B

SWE-bench Verified74.40

LiveCodeBench86.40

HumanEval0.00

Free commercial

GLM-4.7

3580B

SWE-bench Verified73.80

LiveCodeBench0.00

HumanEval0.00

Free commercial

Grok 4 Heavy

SWE-bench Verified73.50

LiveCodeBench0.00

HumanEval0.00

不开源

Haiku 4.5

SWE-bench Verified73.30

LiveCodeBench0.00

HumanEval0.00

不开源

DeepSeek V3.2

6710B

SWE-bench Verified73.10

LiveCodeBench0.00

HumanEval0.00

Free commercial

GPT-5

SWE-bench Verified72.80

LiveCodeBench0.00

HumanEval0.00

不开源

Claude Sonnet 4

SWE-bench Verified72.70

LiveCodeBench0.00

HumanEval0.00

不开源

Claude Opus 4

SWE-bench Verified72.50

LiveCodeBench56.60

HumanEval0.00

不开源

Grok 4 Code

SWE-bench Verified72.00

LiveCodeBench0.00

HumanEval0.00

不开源

Kimi K2 Thinking

10400B

SWE-bench Verified71.30

LiveCodeBench0.00

HumanEval0.00

Free commercial

Grok Code Fast 1

SWE-bench Verified70.80

LiveCodeBench0.00

HumanEval0.00

不开源

Qwen3-Coder-Next

80B

SWE-bench Verified70.60

LiveCodeBench0.00

HumanEval0.00

Free commercial

GPT-5.1 Codex

SWE-bench Verified70.40

LiveCodeBench85.50

HumanEval0.00

不开源

Claude Sonnet 3.7

SWE-bench Verified70.30

LiveCodeBench0.00

HumanEval0.00

不开源

DeepSeek V3.2

6710B

SWE-bench Verified70.20

LiveCodeBench83.30

HumanEval0.00

Free commercial

Qwen3 Max (Preview)

SWE-bench Verified69.60

LiveCodeBench57.50

HumanEval0.00

不开源

MiniMax M2

2300B

SWE-bench Verified69.40

LiveCodeBench0.00

HumanEval0.00

Free commercial

Kimi K2 0905

10000B

SWE-bench Verified69.20

LiveCodeBench0.00

HumanEval0.00

Free commercial

Kimi K2 0905

10000B

SWE-bench Verified69.20

LiveCodeBench0.00

HumanEval0.00

Free commercial

OpenAI o3

SWE-bench Verified69.10

LiveCodeBench0.00

HumanEval0.00

不开源

Gemini 3.0 Flash

SWE-bench Verified68.70

LiveCodeBench0.00

HumanEval0.00

不开源

DeepSeek-V3.1 Terminus

6710B

SWE-bench Verified68.40

LiveCodeBench74.90

HumanEval0.00

Free commercial

OpenAI o4 - mini

SWE-bench Verified68.10

LiveCodeBench0.00

HumanEval0.00

不开源

GLM-4.6

3550B

SWE-bench Verified68.00

LiveCodeBench84.50

HumanEval0.00

Free commercial

GLM-4.6

3550B

SWE-bench Verified68.00

LiveCodeBench56.00

HumanEval0.00

Free commercial

DeepSeek V3.2-Exp

6710B

SWE-bench Verified67.80

LiveCodeBench0.00

HumanEval0.00

Free commercial

Gemini 2.5-Pro

SWE-bench Verified67.20

LiveCodeBench0.00

HumanEval0.00

不开源

Qwen3-Coder-480B-A35B

4800B

SWE-bench Verified67.00

LiveCodeBench0.00

HumanEval0.00

Free commercial

DeepSeek-V3.1

6710B

SWE-bench Verified66.00

LiveCodeBench56.40

HumanEval0.00

Free commercial

Claude Sonnet 4.5

SWE-bench Verified64.80

LiveCodeBench59.00

HumanEval0.00

不开源

GLM-4.5

3550B

SWE-bench Verified64.20

LiveCodeBench72.90

HumanEval0.00

Free commercial

Gemini 2.5 Pro Experimental 03-25

SWE-bench Verified63.80

LiveCodeBench70.40

HumanEval0.00

不开源

Gemini-2.5-Pro-Preview-05-06

SWE-bench Verified63.20

LiveCodeBench77.10

HumanEval0.00

不开源

Devstral Medium

SWE-bench Verified61.60

LiveCodeBench0.00

HumanEval0.00

不开源

Haiku 4.5

SWE-bench Verified60.60

LiveCodeBench51.00

HumanEval0.00

不开源

GPT OSS 120B

117B

SWE-bench Verified60.10

LiveCodeBench0.00

HumanEval0.00

Free commercial

GLM-4.7-Flash

310B

SWE-bench Verified59.20

LiveCodeBench0.00

HumanEval0.00

Free commercial

Grok 4

SWE-bench Verified58.60

LiveCodeBench82.00

HumanEval0.00

不开源

DeepSeek-R1-0528

6710B

SWE-bench Verified57.60

LiveCodeBench73.30

HumanEval0.00

Free commercial

GLM-4.5-Air

1060B

SWE-bench Verified57.60

LiveCodeBench70.70

HumanEval0.00

Free commercial

MiniMax-M1-80k

4560B

SWE-bench Verified56.00

LiveCodeBench65.00

HumanEval0.00

Free commercial

MiniMax-M1-40k

4560B

SWE-bench Verified55.60

LiveCodeBench62.30

HumanEval0.00

Free commercial

GPT-4.1

SWE-bench Verified54.60

LiveCodeBench40.50

HumanEval0.00

不开源

Gemini 2.5 Flash-Preview-09-2025

SWE-bench Verified54.00

LiveCodeBench0.00

HumanEval0.00

不开源

Devstral Small 1.1

240B

SWE-bench Verified53.60

LiveCodeBench0.00

HumanEval0.00

Free commercial

Kimi K2

10000B

SWE-bench Verified51.80

LiveCodeBench53.70

HumanEval0.00

Free commercial

Qwen3-Coder-Flash

305B

SWE-bench Verified51.60

LiveCodeBench0.00

HumanEval0.00

Free commercial

Gemini 2.5 Flash

SWE-bench Verified50.00

LiveCodeBench41.10

HumanEval0.00

不开源

OpenAI o3-mini (high)

SWE-bench Verified49.30

LiveCodeBench69.50

HumanEval97.60

不开源

DeepSeek-R1

6710B

SWE-bench Verified49.20

LiveCodeBench65.90

HumanEval0.00

Free commercial

Claude 3.5 Sonnet New

SWE-bench Verified49.00

LiveCodeBench38.70

HumanEval93.70

不开源

OpenAI o1

SWE-bench Verified48.90

LiveCodeBench71.00

HumanEval0.00

不开源

Gemini 2.5 Flash

SWE-bench Verified48.90

LiveCodeBench55.40

HumanEval0.00

不开源

Devstral Small 1.0

240B

SWE-bench Verified46.80

LiveCodeBench0.00

HumanEval0.00

Free commercial

OpenAI o3-mini

SWE-bench Verified40.80

LiveCodeBench0.00

HumanEval0.00

不开源

DeepSeek-V3-0324

6710B

SWE-bench Verified38.80

LiveCodeBench49.20

HumanEval0.00

Free commercial

GPT-4.5

SWE-bench Verified38.00

LiveCodeBench46.40

HumanEval0.00

不开源

Qwen3-235B-A22B

2350B

SWE-bench Verified34.40

LiveCodeBench70.70

HumanEval0.00

Free commercial

GPT OSS 20B

210B

SWE-bench Verified34.00

LiveCodeBench0.00

HumanEval0.00

Free commercial

GPT-4o

SWE-bench Verified31.00

LiveCodeBench35.10

HumanEval90.00

不开源

Gemini 2.5 Flash-Lite

SWE-bench Verified27.60

LiveCodeBench34.30

HumanEval0.00

不开源

GPT-4.1 mini

SWE-bench Verified23.60

LiveCodeBench0.00

HumanEval0.00

不开源

Qwen3-30B-A3B-2507

305B

SWE-bench Verified22.00

LiveCodeBench0.00

HumanEval0.00

Free commercial

Gemini 2.0 Flash Experimental

SWE-bench Verified21.40

LiveCodeBench29.10

HumanEval0.00

不开源

OpenAI o3

SWE-bench Verified0.00

LiveCodeBench75.80

HumanEval0.00

不开源

Pangu Embedded

70B

SWE-bench Verified0.00

LiveCodeBench67.10

HumanEval0.00

Free commercial

Qwen3-32B

320B

SWE-bench Verified0.00

LiveCodeBench65.70

HumanEval0.00

Free commercial

Kimi-k1.6-IOI

SWE-bench Verified0.00

LiveCodeBench65.90

HumanEval0.00

不开源

Claude Sonnet 4

SWE-bench Verified0.00

LiveCodeBench66.00

HumanEval0.00

不开源

Step3

3210B

SWE-bench Verified0.00

LiveCodeBench67.10

HumanEval0.00

Free commercial

DeepSeek-V3.1

6710B

SWE-bench Verified0.00

LiveCodeBench74.80

HumanEval0.00

Free commercial

Qwen3-235B-A22B-Thinking-2507

2350B

SWE-bench Verified0.00

LiveCodeBench74.10

HumanEval0.00

Free commercial

Qwen3-235B-A22B-Thinking

305B

SWE-bench Verified0.00

LiveCodeBench74.10

HumanEval0.00

Free commercial

DeepSeek V3.2-Exp

6710B

SWE-bench Verified0.00

LiveCodeBench74.10

HumanEval0.00

Free commercial

Kimi-k1.6-IOI-high

SWE-bench Verified0.00

LiveCodeBench73.80

HumanEval0.00

不开源

Claude Sonnet 4.5

SWE-bench Verified0.00

LiveCodeBench71.00

HumanEval0.00

不开源

Qwen3-235B-A22B

2350B

SWE-bench Verified0.00

LiveCodeBench70.70

HumanEval0.00

Free commercial

Grok 3

SWE-bench Verified0.00

LiveCodeBench70.60

HumanEval0.00

不开源

OpenAI o3-mini (medium)

SWE-bench Verified0.00

LiveCodeBench67.40

HumanEval0.00

不开源

QwQ-Max-Preview

SWE-bench Verified0.00

LiveCodeBench65.60

HumanEval0.00

Free commercial

GLM-4-9B-Chat

90B

SWE-bench Verified0.00

LiveCodeBench51.80

HumanEval0.00

Free commercial

Gemma 3 - 12B (IT)

120B

SWE-bench Verified0.00

LiveCodeBench24.60

HumanEval0.00

Free commercial

100

Gemini 2.0 Flash-Lite

SWE-bench Verified0.00

LiveCodeBench28.90

HumanEval0.00

不开源

101

Qwen3-30B-A3B

305B

SWE-bench Verified0.00

LiveCodeBench29.00

HumanEval0.00

Free commercial

102

Llama 4 Scout Instruct

1090B

SWE-bench Verified0.00

LiveCodeBench32.80

HumanEval0.00

Free commercial

103

Qwen3-4B-2507

40B

SWE-bench Verified0.00

LiveCodeBench35.10

HumanEval0.00

Free commercial

104

GPT-4o(2025-03-27)

SWE-bench Verified0.00

LiveCodeBench35.80

HumanEval0.00

不开源

105

ERNIE-4.5-300B-A47B

3000B

SWE-bench Verified0.00

LiveCodeBench38.80

HumanEval0.00

Free commercial

106

ERNIE-4.5-VL-424B-A47B-Base

4240B

SWE-bench Verified0.00

LiveCodeBench38.80

HumanEval0.00

Free commercial

107

Qwen3-30B-A3B-2507

305B

SWE-bench Verified0.00

LiveCodeBench43.20

HumanEval0.00

Free commercial

108

Llama 4 Maverick Instruct

4000B

SWE-bench Verified0.00

LiveCodeBench43.40

HumanEval0.00

Free commercial

109

Claude Sonnet 4

SWE-bench Verified0.00

LiveCodeBench48.50

HumanEval0.00

不开源

110

Llama 4 Behemoth Instruct

20000B

SWE-bench Verified0.00

LiveCodeBench49.40

HumanEval0.00

Free commercial

111

Qwen3-235B-A22B-2507

2350B

SWE-bench Verified0.00

LiveCodeBench51.80

HumanEval0.00

Free commercial

112

MiniMax M2

2300B

SWE-bench Verified0.00

LiveCodeBench83.00

HumanEval0.00

Free commercial

113

DeepSeek V3.2-Exp

6710B

SWE-bench Verified0.00

LiveCodeBench55.00

HumanEval0.00

Free commercial

114

GPT-5-mini

SWE-bench Verified0.00

LiveCodeBench55.00

HumanEval0.00

不开源

115

Qwen3-4B-Thinking-2507

40B

SWE-bench Verified0.00

LiveCodeBench55.20

HumanEval0.00

Free commercial

116

Magistral-Small-2506

240B

SWE-bench Verified0.00

LiveCodeBench55.84

HumanEval0.00

Free commercial

117

Qwen3-Next

800B

SWE-bench Verified0.00

LiveCodeBench56.60

HumanEval0.00

Free commercial

118

Hunyuan-7B

70B

SWE-bench Verified0.00

LiveCodeBench57.00

HumanEval0.00

Free commercial

119

Qwen3-8B

80B

SWE-bench Verified0.00

LiveCodeBench57.50

HumanEval0.00

Free commercial

120

Magistral-Medium-2506

SWE-bench Verified0.00

LiveCodeBench59.36

HumanEval0.00

不开源

121

Pangu Pro MoE

719B

SWE-bench Verified0.00

LiveCodeBench59.60

HumanEval0.00

Free commercial

122

Qwen3-8B

80B

SWE-bench Verified0.00

LiveCodeBench61.80

HumanEval0.00

Free commercial

123

Haiku 4.5

SWE-bench Verified0.00

LiveCodeBench62.00

HumanEval0.00

不开源

124

Hunyuan-A13B-Instruct

800B

SWE-bench Verified0.00

LiveCodeBench63.90

HumanEval0.00

Free commercial

125

Hunyuan-T1

SWE-bench Verified0.00

LiveCodeBench64.90

HumanEval0.00

不开源

126

Qwen2.5-Max

SWE-bench Verified0.00

LiveCodeBench0.00

HumanEval73.20

不开源

127

Grok 2

2690B

SWE-bench Verified0.00

LiveCodeBench0.00

HumanEval88.40

Free commercial

128

Claude 3.5 Haiku

SWE-bench Verified0.00

LiveCodeBench0.00

HumanEval88.10

不开源

129

Gemma 3 - 27B (IT)

270B

SWE-bench Verified0.00

LiveCodeBench29.70

HumanEval87.80

Free commercial

130

GPT-4o mini

SWE-bench Verified0.00

LiveCodeBench0.00

HumanEval87.20

不开源

131

Codestral 25.01

SWE-bench Verified0.00

LiveCodeBench37.90

HumanEval86.60

不开源

132

Claude3-Opus

SWE-bench Verified0.00

LiveCodeBench0.00

HumanEval84.90

不开源

133

Codestral

220B

SWE-bench Verified0.00

LiveCodeBench31.50

HumanEval81.10

Non-commercial

134

Llama3.1-70B-Instruct

700B

SWE-bench Verified0.00

LiveCodeBench33.30

HumanEval80.50

Free commercial

135

Phi-4-mini-instruct (3.8B)

38B

SWE-bench Verified0.00

LiveCodeBench0.00

HumanEval74.40

Free commercial

136

Grok-1.5

SWE-bench Verified0.00

LiveCodeBench0.00

HumanEval74.10

不开源

137

Llama3.3-70B-Instruct

700B

SWE-bench Verified0.00

LiveCodeBench33.30

HumanEval88.40

Free commercial

138

Llama3.1-8B-Instruct

80B

SWE-bench Verified0.00

LiveCodeBench0.00

HumanEval66.50

Free commercial

139

C4AI Aya Vision 32B

320B

SWE-bench Verified0.00

LiveCodeBench0.00

HumanEval62.20

Non-commercial

140

Qwen2.5-72B

727B

SWE-bench Verified0.00

LiveCodeBench0.00

HumanEval59.10

Free commercial

141

Qwen2.5-7B

70B

SWE-bench Verified0.00

LiveCodeBench0.00

HumanEval57.90

Free commercial

142

Moonlight-16B-A3B-Instruct

160B

SWE-bench Verified0.00

LiveCodeBench0.00

HumanEval48.10

Free commercial

143

Qwen2.5-3B

30B

SWE-bench Verified0.00

LiveCodeBench0.00

HumanEval42.10

Free commercial

144

Gemma 2 - 9B

90B

SWE-bench Verified0.00

LiveCodeBench0.00

HumanEval37.80

Free commercial

145

Llama3.1-8B

80B

SWE-bench Verified0.00

LiveCodeBench0.00

HumanEval33.50

Free commercial

146

Mistral-7B-Instruct-v0.3

70B

SWE-bench Verified0.00

LiveCodeBench0.00

HumanEval29.30

Free commercial

147

Llama-3.2-3B

32B

SWE-bench Verified0.00

LiveCodeBench0.00

HumanEval28.00

Free commercial

148

Gemini 2.5 Deep Think

SWE-bench Verified0.00

LiveCodeBench87.60

HumanEval0.00

不开源

149

Grok-3 - Reasoning Beta

SWE-bench Verified0.00

LiveCodeBench79.40

HumanEval0.00

不开源

150

DeepSeek-V3.1 Terminus

6710B

SWE-bench Verified0.00

LiveCodeBench80.00

HumanEval0.00

Free commercial

151

Grok 4 Fast

SWE-bench Verified0.00

LiveCodeBench80.00

HumanEval0.00

不开源

152

Gemini 2.5 Pro Deep Think

SWE-bench Verified0.00

LiveCodeBench80.40

HumanEval0.00

不开源

153

Grok 4.1 Fast

SWE-bench Verified0.00

LiveCodeBench82.00

HumanEval0.00

不开源

154

GLM-4.6

3550B

SWE-bench Verified0.00

LiveCodeBench82.80

HumanEval0.00

Free commercial

155

QwQ-32B

325B

SWE-bench Verified0.00

LiveCodeBench0.00

HumanEval19.00

Free commercial

156

Kimi K2 Thinking

10400B

SWE-bench Verified0.00

LiveCodeBench83.10

HumanEval0.00

Free commercial

157

GLM-4.7

3580B

SWE-bench Verified0.00

LiveCodeBench84.90

HumanEval0.00

Free commercial

158

Claude Opus 4.5

SWE-bench Verified0.00

LiveCodeBench87.00

HumanEval0.00

不开源

159

Gemini 2.5-Pro

SWE-bench Verified0.00

LiveCodeBench77.10

HumanEval0.00

不开源

160

OpenAI o1-mini

SWE-bench Verified0.00

LiveCodeBench52.00

HumanEval92.40

不开源

161

Claude 3.5 Sonnet

SWE-bench Verified0.00

LiveCodeBench0.00

HumanEval92.00

不开源

162

Hunyuan-TurboS

SWE-bench Verified0.00

LiveCodeBench32.00

HumanEval91.00

不开源

163

GPT-4o(2024-11-20)

SWE-bench Verified0.00

LiveCodeBench0.00

HumanEval90.20

不开源

164

Gemini 1.5 Pro

SWE-bench Verified0.00

LiveCodeBench0.00

HumanEval89.00

不开源

165

Llama3.1-405B Instruct

4050B

SWE-bench Verified0.00

LiveCodeBench30.20

HumanEval89.00

Free commercial

166

Amazon Nova Pro

SWE-bench Verified0.00

LiveCodeBench0.00

HumanEval89.00

不开源

167

DeepSeek-V3

6810B

SWE-bench Verified0.00

LiveCodeBench34.60

HumanEval89.00

Free commercial

168

Mistral-Small-3.1-24B-Instruct-2503

240B

SWE-bench Verified0.00

LiveCodeBench0.00

HumanEval88.41

Free commercial

169

Qwen2.5-32B

320B

SWE-bench Verified0.00

LiveCodeBench51.20

HumanEval88.40

Free commercial

加载中...

Back to Main Leaderboard

大模型代码编程能力评测排行榜

本页面提供大模型代码编程能力评测排行榜，涵盖 SWE-Bench、LiveCodeBench、HumanEval 等数据集，对 GPT、Claude、Qwen、DeepSeek 等模型进行对比。

Updated on: 2025/10/12 20:54:51

Benchmark switcher

Pick the leaderboard to sync both chart and table

SWE-bench Verified LiveCodeBench HumanEval

More benchmark coverage

Browse the benchmark catalog by category and language

More Benchmarks

Filters

Model Size

All 3B and below 7B 13B 34B 65B 100B and above

Model Type

All Reasoning Models Foundation Models Instruction/Chat Models Coding Models

LLM Performance Results

Data source: DataLearnerAI

Rank	Model	SWE-bench Verified	LiveCodeBench	HumanEval	Params (B)	License
1	Claude Sonnet 4.5	82.00	0.00	0.00	—	不开源
2	Claude Opus 4.5	80.90	0.00	0.00	—	不开源
3	Claude Opus 4.6	80.80	0.00	0.00	—	不开源
4	Claude Sonnet 4	80.20	0.00	0.00	—	不开源
5	GPT-5.2	80.00	0.00	0.00	—	不开源
6	Claude Opus 4.1	79.40	0.00	0.00	—	不开源
7	Claude Sonnet 4.5	77.20	0.00	0.00	—	不开源
8	GPT-5.1-Codex-Max	76.80	0.00	0.00	—	不开源
9	Kimi K2.5	76.80	85.00	0.00	10000B	Free commercial
10	GPT-5.1	76.30	0.00	0.00	—	不开源
11	Gemini 3.0 Pro (Preview 11-2025)	76.20	92.00	0.00	—	不开源
12	Qwen3-Max-Thinking	75.30	85.90	0.00	10000B	不开源
13	o3-pro	75.00	0.00	0.00	—	不开源
14	M2.1	74.80	0.00	0.00	2300B	Free commercial
15	GPT-5 Codex	74.50	0.00	0.00	—	不开源
16	Claude Opus 4.1	74.50	65.00	0.00	—	不开源
17	Claude Opus 4.1	74.50	0.00	0.00	—	不开源
18	Step 3.5 Flash	74.40	86.40	0.00	1960B	Free commercial
19	GLM-4.7	73.80	0.00	0.00	3580B	Free commercial
20	Grok 4 Heavy	73.50	0.00	0.00	—	不开源
21	Haiku 4.5	73.30	0.00	0.00	—	不开源
22	DeepSeek V3.2	73.10	0.00	0.00	6710B	Free commercial
23	GPT-5	72.80	0.00	0.00	—	不开源
24	Claude Sonnet 4	72.70	0.00	0.00	—	不开源
25	Claude Opus 4	72.50	56.60	0.00	—	不开源
26	Grok 4 Code	72.00	0.00	0.00	—	不开源
27	Kimi K2 Thinking	71.30	0.00	0.00	10400B	Free commercial
28	Grok Code Fast 1	70.80	0.00	0.00	—	不开源
29	Qwen3-Coder-Next	70.60	0.00	0.00	80B	Free commercial
30	GPT-5.1 Codex	70.40	85.50	0.00	—	不开源
31	Claude Sonnet 3.7	70.30	0.00	0.00	—	不开源
32	DeepSeek V3.2	70.20	83.30	0.00	6710B	Free commercial
33	Qwen3 Max (Preview)	69.60	57.50	0.00	—	不开源
34	MiniMax M2	69.40	0.00	0.00	2300B	Free commercial
35	Kimi K2 0905	69.20	0.00	0.00	10000B	Free commercial
36	Kimi K2 0905	69.20	0.00	0.00	10000B	Free commercial
37	OpenAI o3	69.10	0.00	0.00	—	不开源
38	Gemini 3.0 Flash	68.70	0.00	0.00	—	不开源
39	DeepSeek-V3.1 Terminus	68.40	74.90	0.00	6710B	Free commercial
40	OpenAI o4 - mini	68.10	0.00	0.00	—	不开源
41	GLM-4.6	68.00	84.50	0.00	3550B	Free commercial
42	GLM-4.6	68.00	56.00	0.00	3550B	Free commercial
43	DeepSeek V3.2-Exp	67.80	0.00	0.00	6710B	Free commercial
44	Gemini 2.5-Pro	67.20	0.00	0.00	—	不开源
45	Qwen3-Coder-480B-A35B	67.00	0.00	0.00	4800B	Free commercial
46	DeepSeek-V3.1	66.00	56.40	0.00	6710B	Free commercial
47	Claude Sonnet 4.5	64.80	59.00	0.00	—	不开源
48	GLM-4.5	64.20	72.90	0.00	3550B	Free commercial
49	Gemini 2.5 Pro Experimental 03-25	63.80	70.40	0.00	—	不开源
50	Gemini-2.5-Pro-Preview-05-06	63.20	77.10	0.00	—	不开源
51	Devstral Medium	61.60	0.00	0.00	—	不开源
52	Haiku 4.5	60.60	51.00	0.00	—	不开源
53	GPT OSS 120B	60.10	0.00	0.00	117B	Free commercial
54	GLM-4.7-Flash	59.20	0.00	0.00	310B	Free commercial
55	Grok 4	58.60	82.00	0.00	—	不开源
56	DeepSeek-R1-0528	57.60	73.30	0.00	6710B	Free commercial
57	GLM-4.5-Air	57.60	70.70	0.00	1060B	Free commercial
58	MiniMax-M1-80k	56.00	65.00	0.00	4560B	Free commercial
59	MiniMax-M1-40k	55.60	62.30	0.00	4560B	Free commercial
60	GPT-4.1	54.60	40.50	0.00	—	不开源
61	Gemini 2.5 Flash-Preview-09-2025	54.00	0.00	0.00	—	不开源
62	Devstral Small 1.1	53.60	0.00	0.00	240B	Free commercial
63	Kimi K2	51.80	53.70	0.00	10000B	Free commercial
64	Qwen3-Coder-Flash	51.60	0.00	0.00	305B	Free commercial
65	Gemini 2.5 Flash	50.00	41.10	0.00	—	不开源
66	OpenAI o3-mini (high)	49.30	69.50	97.60	—	不开源
67	DeepSeek-R1	49.20	65.90	0.00	6710B	Free commercial
68	Claude 3.5 Sonnet New	49.00	38.70	93.70	—	不开源
69	OpenAI o1	48.90	71.00	0.00	—	不开源
70	Gemini 2.5 Flash	48.90	55.40	0.00	—	不开源
71	Devstral Small 1.0	46.80	0.00	0.00	240B	Free commercial
72	OpenAI o3-mini	40.80	0.00	0.00	—	不开源
73	DeepSeek-V3-0324	38.80	49.20	0.00	6710B	Free commercial
74	GPT-4.5	38.00	46.40	0.00	—	不开源
75	Qwen3-235B-A22B	34.40	70.70	0.00	2350B	Free commercial
76	GPT OSS 20B	34.00	0.00	0.00	210B	Free commercial
77	GPT-4o	31.00	35.10	90.00	—	不开源
78	Gemini 2.5 Flash-Lite	27.60	34.30	0.00	—	不开源
79	GPT-4.1 mini	23.60	0.00	0.00	—	不开源
80	Qwen3-30B-A3B-2507	22.00	0.00	0.00	305B	Free commercial
81	Gemini 2.0 Flash Experimental	21.40	29.10	0.00	—	不开源
82	OpenAI o3	0.00	75.80	0.00	—	不开源
83	Pangu Embedded	0.00	67.10	0.00	70B	Free commercial
84	Qwen3-32B	0.00	65.70	0.00	320B	Free commercial
85	Kimi-k1.6-IOI	0.00	65.90	0.00	—	不开源
86	Claude Sonnet 4	0.00	66.00	0.00	—	不开源
87	Step3	0.00	67.10	0.00	3210B	Free commercial
88	DeepSeek-V3.1	0.00	74.80	0.00	6710B	Free commercial
89	Qwen3-235B-A22B-Thinking-2507	0.00	74.10	0.00	2350B	Free commercial
90	Qwen3-235B-A22B-Thinking	0.00	74.10	0.00	305B	Free commercial
91	DeepSeek V3.2-Exp	0.00	74.10	0.00	6710B	Free commercial
92	Kimi-k1.6-IOI-high	0.00	73.80	0.00	—	不开源
93	Claude Sonnet 4.5	0.00	71.00	0.00	—	不开源
94	Qwen3-235B-A22B	0.00	70.70	0.00	2350B	Free commercial
95	Grok 3	0.00	70.60	0.00	—	不开源
96	OpenAI o3-mini (medium)	0.00	67.40	0.00	—	不开源
97	QwQ-Max-Preview	0.00	65.60	0.00	—	Free commercial
98	GLM-4-9B-Chat	0.00	51.80	0.00	90B	Free commercial
99	Gemma 3 - 12B (IT)	0.00	24.60	0.00	120B	Free commercial
100	Gemini 2.0 Flash-Lite	0.00	28.90	0.00	—	不开源
101	Qwen3-30B-A3B	0.00	29.00	0.00	305B	Free commercial
102	Llama 4 Scout Instruct	0.00	32.80	0.00	1090B	Free commercial
103	Qwen3-4B-2507	0.00	35.10	0.00	40B	Free commercial
104	GPT-4o(2025-03-27)	0.00	35.80	0.00	—	不开源
105	ERNIE-4.5-300B-A47B	0.00	38.80	0.00	3000B	Free commercial
106	ERNIE-4.5-VL-424B-A47B-Base	0.00	38.80	0.00	4240B	Free commercial
107	Qwen3-30B-A3B-2507	0.00	43.20	0.00	305B	Free commercial
108	Llama 4 Maverick Instruct	0.00	43.40	0.00	4000B	Free commercial
109	Claude Sonnet 4	0.00	48.50	0.00	—	不开源
110	Llama 4 Behemoth Instruct	0.00	49.40	0.00	20000B	Free commercial
111	Qwen3-235B-A22B-2507	0.00	51.80	0.00	2350B	Free commercial
112	MiniMax M2	0.00	83.00	0.00	2300B	Free commercial
113	DeepSeek V3.2-Exp	0.00	55.00	0.00	6710B	Free commercial
114	GPT-5-mini	0.00	55.00	0.00	—	不开源
115	Qwen3-4B-Thinking-2507	0.00	55.20	0.00	40B	Free commercial
116	Magistral-Small-2506	0.00	55.84	0.00	240B	Free commercial
117	Qwen3-Next	0.00	56.60	0.00	800B	Free commercial
118	Hunyuan-7B	0.00	57.00	0.00	70B	Free commercial
119	Qwen3-8B	0.00	57.50	0.00	80B	Free commercial
120	Magistral-Medium-2506	0.00	59.36	0.00	—	不开源
121	Pangu Pro MoE	0.00	59.60	0.00	719B	Free commercial
122	Qwen3-8B	0.00	61.80	0.00	80B	Free commercial
123	Haiku 4.5	0.00	62.00	0.00	—	不开源
124	Hunyuan-A13B-Instruct	0.00	63.90	0.00	800B	Free commercial
125	Hunyuan-T1	0.00	64.90	0.00	—	不开源
126	Qwen2.5-Max	0.00	0.00	73.20	—	不开源
127	Grok 2	0.00	0.00	88.40	2690B	Free commercial
128	Claude 3.5 Haiku	0.00	0.00	88.10	—	不开源
129	Gemma 3 - 27B (IT)	0.00	29.70	87.80	270B	Free commercial
130	GPT-4o mini	0.00	0.00	87.20	—	不开源
131	Codestral 25.01	0.00	37.90	86.60	—	不开源
132	Claude3-Opus	0.00	0.00	84.90	—	不开源
133	Codestral	0.00	31.50	81.10	220B	Non-commercial
134	Llama3.1-70B-Instruct	0.00	33.30	80.50	700B	Free commercial
135	Phi-4-mini-instruct (3.8B)	0.00	0.00	74.40	38B	Free commercial
136	Grok-1.5	0.00	0.00	74.10	—	不开源
137	Llama3.3-70B-Instruct	0.00	33.30	88.40	700B	Free commercial
138	Llama3.1-8B-Instruct	0.00	0.00	66.50	80B	Free commercial
139	C4AI Aya Vision 32B	0.00	0.00	62.20	320B	Non-commercial
140	Qwen2.5-72B	0.00	0.00	59.10	727B	Free commercial
141	Qwen2.5-7B	0.00	0.00	57.90	70B	Free commercial
142	Moonlight-16B-A3B-Instruct	0.00	0.00	48.10	160B	Free commercial
143	Qwen2.5-3B	0.00	0.00	42.10	30B	Free commercial
144	Gemma 2 - 9B	0.00	0.00	37.80	90B	Free commercial
145	Llama3.1-8B	0.00	0.00	33.50	80B	Free commercial
146	Mistral-7B-Instruct-v0.3	0.00	0.00	29.30	70B	Free commercial
147	Llama-3.2-3B	0.00	0.00	28.00	32B	Free commercial
148	Gemini 2.5 Deep Think	0.00	87.60	0.00	—	不开源
149	Grok-3 - Reasoning Beta	0.00	79.40	0.00	—	不开源
150	DeepSeek-V3.1 Terminus	0.00	80.00	0.00	6710B	Free commercial
151	Grok 4 Fast	0.00	80.00	0.00	—	不开源
152	Gemini 2.5 Pro Deep Think	0.00	80.40	0.00	—	不开源
153	Grok 4.1 Fast	0.00	82.00	0.00	—	不开源
154	GLM-4.6	0.00	82.80	0.00	3550B	Free commercial
155	QwQ-32B	0.00	0.00	19.00	325B	Free commercial
156	Kimi K2 Thinking	0.00	83.10	0.00	10400B	Free commercial
157	GLM-4.7	0.00	84.90	0.00	3580B	Free commercial
158	Claude Opus 4.5	0.00	87.00	0.00	—	不开源
159	Gemini 2.5-Pro	0.00	77.10	0.00	—	不开源
160	OpenAI o1-mini	0.00	52.00	92.40	—	不开源
161	Claude 3.5 Sonnet	0.00	0.00	92.00	—	不开源
162	Hunyuan-TurboS	0.00	32.00	91.00	—	不开源
163	GPT-4o(2024-11-20)	0.00	0.00	90.20	—	不开源
164	Gemini 1.5 Pro	0.00	0.00	89.00	—	不开源
165	Llama3.1-405B Instruct	0.00	30.20	89.00	4050B	Free commercial
166	Amazon Nova Pro	0.00	0.00	89.00	—	不开源
167	DeepSeek-V3	0.00	34.60	89.00	6810B	Free commercial
168	Mistral-Small-3.1-24B-Instruct-2503	0.00	0.00	88.41	240B	Free commercial
169	Qwen2.5-32B	0.00	51.20	88.40	320B	Free commercial

Claude Sonnet 4.5

SWE-bench Verified82.00

LiveCodeBench0.00

HumanEval0.00

不开源

Claude Opus 4.5

SWE-bench Verified80.90

LiveCodeBench0.00

HumanEval0.00

不开源

Claude Opus 4.6

SWE-bench Verified80.80

LiveCodeBench0.00

HumanEval0.00

不开源

Claude Sonnet 4

SWE-bench Verified80.20

LiveCodeBench0.00

HumanEval0.00

不开源

GPT-5.2

SWE-bench Verified80.00

LiveCodeBench0.00

HumanEval0.00

不开源

Claude Opus 4.1

SWE-bench Verified79.40

LiveCodeBench0.00

HumanEval0.00

不开源

Claude Sonnet 4.5

SWE-bench Verified77.20

LiveCodeBench0.00

HumanEval0.00

不开源

GPT-5.1-Codex-Max

SWE-bench Verified76.80

LiveCodeBench0.00

HumanEval0.00

不开源

Kimi K2.5

10000B

SWE-bench Verified76.80

LiveCodeBench85.00

HumanEval0.00

Free commercial

GPT-5.1

SWE-bench Verified76.30

LiveCodeBench0.00

HumanEval0.00

不开源

Gemini 3.0 Pro (Preview 11-2025)

SWE-bench Verified76.20

LiveCodeBench92.00

HumanEval0.00

不开源

Qwen3-Max-Thinking

10000B

SWE-bench Verified75.30

LiveCodeBench85.90

HumanEval0.00

不开源

o3-pro

SWE-bench Verified75.00

LiveCodeBench0.00

HumanEval0.00

不开源

M2.1

2300B

SWE-bench Verified74.80

LiveCodeBench0.00

HumanEval0.00

Free commercial

GPT-5 Codex

SWE-bench Verified74.50

LiveCodeBench0.00

HumanEval0.00

不开源

Claude Opus 4.1

SWE-bench Verified74.50

LiveCodeBench65.00

HumanEval0.00

不开源

Claude Opus 4.1

SWE-bench Verified74.50

LiveCodeBench0.00

HumanEval0.00

不开源

Step 3.5 Flash

1960B

SWE-bench Verified74.40

LiveCodeBench86.40

HumanEval0.00

Free commercial

GLM-4.7

3580B

SWE-bench Verified73.80

LiveCodeBench0.00

HumanEval0.00

Free commercial

Grok 4 Heavy

SWE-bench Verified73.50

LiveCodeBench0.00

HumanEval0.00

不开源

Haiku 4.5

SWE-bench Verified73.30

LiveCodeBench0.00

HumanEval0.00

不开源

DeepSeek V3.2

6710B

SWE-bench Verified73.10

LiveCodeBench0.00

HumanEval0.00

Free commercial

GPT-5

SWE-bench Verified72.80

LiveCodeBench0.00

HumanEval0.00

不开源

Claude Sonnet 4

SWE-bench Verified72.70

LiveCodeBench0.00

HumanEval0.00

不开源

Claude Opus 4

SWE-bench Verified72.50

LiveCodeBench56.60

HumanEval0.00

不开源

Grok 4 Code

SWE-bench Verified72.00

LiveCodeBench0.00

HumanEval0.00

不开源

Kimi K2 Thinking

10400B

SWE-bench Verified71.30

LiveCodeBench0.00

HumanEval0.00

Free commercial

Grok Code Fast 1

SWE-bench Verified70.80

LiveCodeBench0.00

HumanEval0.00

不开源

Qwen3-Coder-Next

80B

SWE-bench Verified70.60

LiveCodeBench0.00

HumanEval0.00

Free commercial

GPT-5.1 Codex

SWE-bench Verified70.40

LiveCodeBench85.50

HumanEval0.00

不开源

Claude Sonnet 3.7

SWE-bench Verified70.30

LiveCodeBench0.00

HumanEval0.00

不开源

DeepSeek V3.2

6710B

SWE-bench Verified70.20

LiveCodeBench83.30

HumanEval0.00

Free commercial

Qwen3 Max (Preview)

SWE-bench Verified69.60

LiveCodeBench57.50

HumanEval0.00

不开源

MiniMax M2

2300B

SWE-bench Verified69.40

LiveCodeBench0.00

HumanEval0.00

Free commercial

Kimi K2 0905

10000B

SWE-bench Verified69.20

LiveCodeBench0.00

HumanEval0.00

Free commercial

Kimi K2 0905

10000B

SWE-bench Verified69.20

LiveCodeBench0.00

HumanEval0.00

Free commercial

OpenAI o3

SWE-bench Verified69.10

LiveCodeBench0.00

HumanEval0.00

不开源

Gemini 3.0 Flash

SWE-bench Verified68.70

LiveCodeBench0.00

HumanEval0.00

不开源

DeepSeek-V3.1 Terminus

6710B

SWE-bench Verified68.40

LiveCodeBench74.90

HumanEval0.00

Free commercial

OpenAI o4 - mini

SWE-bench Verified68.10

LiveCodeBench0.00

HumanEval0.00

不开源

GLM-4.6

3550B

SWE-bench Verified68.00

LiveCodeBench84.50

HumanEval0.00

Free commercial

GLM-4.6

3550B

SWE-bench Verified68.00

LiveCodeBench56.00

HumanEval0.00

Free commercial

DeepSeek V3.2-Exp

6710B

SWE-bench Verified67.80

LiveCodeBench0.00

HumanEval0.00

Free commercial

Gemini 2.5-Pro

SWE-bench Verified67.20

LiveCodeBench0.00

HumanEval0.00

不开源

Qwen3-Coder-480B-A35B

4800B

SWE-bench Verified67.00

LiveCodeBench0.00

HumanEval0.00

Free commercial

DeepSeek-V3.1

6710B

SWE-bench Verified66.00

LiveCodeBench56.40

HumanEval0.00

Free commercial

Claude Sonnet 4.5

SWE-bench Verified64.80

LiveCodeBench59.00

HumanEval0.00

不开源

GLM-4.5

3550B

SWE-bench Verified64.20

LiveCodeBench72.90

HumanEval0.00

Free commercial

Gemini 2.5 Pro Experimental 03-25

SWE-bench Verified63.80

LiveCodeBench70.40

HumanEval0.00

不开源

Gemini-2.5-Pro-Preview-05-06

SWE-bench Verified63.20

LiveCodeBench77.10

HumanEval0.00

不开源

Devstral Medium

SWE-bench Verified61.60

LiveCodeBench0.00

HumanEval0.00

不开源

Haiku 4.5

SWE-bench Verified60.60

LiveCodeBench51.00

HumanEval0.00

不开源

GPT OSS 120B

117B

SWE-bench Verified60.10

LiveCodeBench0.00

HumanEval0.00

Free commercial

GLM-4.7-Flash

310B

SWE-bench Verified59.20

LiveCodeBench0.00

HumanEval0.00

Free commercial

Grok 4

SWE-bench Verified58.60

LiveCodeBench82.00

HumanEval0.00

不开源

DeepSeek-R1-0528

6710B

SWE-bench Verified57.60

LiveCodeBench73.30

HumanEval0.00

Free commercial

GLM-4.5-Air

1060B

SWE-bench Verified57.60

LiveCodeBench70.70

HumanEval0.00

Free commercial

MiniMax-M1-80k

4560B

SWE-bench Verified56.00

LiveCodeBench65.00

HumanEval0.00

Free commercial

MiniMax-M1-40k

4560B

SWE-bench Verified55.60

LiveCodeBench62.30

HumanEval0.00

Free commercial

GPT-4.1

SWE-bench Verified54.60

LiveCodeBench40.50

HumanEval0.00

不开源

Gemini 2.5 Flash-Preview-09-2025

SWE-bench Verified54.00

LiveCodeBench0.00

HumanEval0.00

不开源

Devstral Small 1.1

240B

SWE-bench Verified53.60

LiveCodeBench0.00

HumanEval0.00

Free commercial

Kimi K2

10000B

SWE-bench Verified51.80

LiveCodeBench53.70

HumanEval0.00

Free commercial

Qwen3-Coder-Flash

305B

SWE-bench Verified51.60

LiveCodeBench0.00

HumanEval0.00

Free commercial

Gemini 2.5 Flash

SWE-bench Verified50.00

LiveCodeBench41.10

HumanEval0.00

不开源

OpenAI o3-mini (high)

SWE-bench Verified49.30

LiveCodeBench69.50

HumanEval97.60

不开源

DeepSeek-R1

6710B

SWE-bench Verified49.20

LiveCodeBench65.90

HumanEval0.00

Free commercial

Claude 3.5 Sonnet New

SWE-bench Verified49.00

LiveCodeBench38.70

HumanEval93.70

不开源

OpenAI o1

SWE-bench Verified48.90

LiveCodeBench71.00

HumanEval0.00

不开源

Gemini 2.5 Flash

SWE-bench Verified48.90

LiveCodeBench55.40

HumanEval0.00

不开源

Devstral Small 1.0

240B

SWE-bench Verified46.80

LiveCodeBench0.00

HumanEval0.00

Free commercial

OpenAI o3-mini

SWE-bench Verified40.80

LiveCodeBench0.00

HumanEval0.00

不开源

DeepSeek-V3-0324

6710B

SWE-bench Verified38.80

LiveCodeBench49.20

HumanEval0.00

Free commercial

GPT-4.5

SWE-bench Verified38.00

LiveCodeBench46.40

HumanEval0.00

不开源

Qwen3-235B-A22B

2350B

SWE-bench Verified34.40

LiveCodeBench70.70

HumanEval0.00

Free commercial

GPT OSS 20B

210B

SWE-bench Verified34.00

LiveCodeBench0.00

HumanEval0.00

Free commercial

GPT-4o

SWE-bench Verified31.00

LiveCodeBench35.10

HumanEval90.00

不开源

Gemini 2.5 Flash-Lite

SWE-bench Verified27.60

LiveCodeBench34.30

HumanEval0.00

不开源

GPT-4.1 mini

SWE-bench Verified23.60

LiveCodeBench0.00

HumanEval0.00

不开源

Qwen3-30B-A3B-2507

305B

SWE-bench Verified22.00

LiveCodeBench0.00

HumanEval0.00

Free commercial

Gemini 2.0 Flash Experimental

SWE-bench Verified21.40

LiveCodeBench29.10

HumanEval0.00

不开源

OpenAI o3

SWE-bench Verified0.00

LiveCodeBench75.80

HumanEval0.00

不开源

Pangu Embedded

70B

SWE-bench Verified0.00

LiveCodeBench67.10

HumanEval0.00

Free commercial

Qwen3-32B

320B

SWE-bench Verified0.00

LiveCodeBench65.70

HumanEval0.00

Free commercial

Kimi-k1.6-IOI

SWE-bench Verified0.00

LiveCodeBench65.90

HumanEval0.00

不开源

Claude Sonnet 4

SWE-bench Verified0.00

LiveCodeBench66.00

HumanEval0.00

不开源

Step3

3210B

SWE-bench Verified0.00

LiveCodeBench67.10

HumanEval0.00

Free commercial

DeepSeek-V3.1

6710B

SWE-bench Verified0.00

LiveCodeBench74.80

HumanEval0.00

Free commercial

Qwen3-235B-A22B-Thinking-2507

2350B

SWE-bench Verified0.00

LiveCodeBench74.10

HumanEval0.00

Free commercial

Qwen3-235B-A22B-Thinking

305B

SWE-bench Verified0.00

LiveCodeBench74.10

HumanEval0.00

Free commercial

DeepSeek V3.2-Exp

6710B

SWE-bench Verified0.00

LiveCodeBench74.10

HumanEval0.00

Free commercial

Kimi-k1.6-IOI-high

SWE-bench Verified0.00

LiveCodeBench73.80

HumanEval0.00

不开源

Claude Sonnet 4.5

SWE-bench Verified0.00

LiveCodeBench71.00

HumanEval0.00

不开源

Qwen3-235B-A22B

2350B

SWE-bench Verified0.00

LiveCodeBench70.70

HumanEval0.00

Free commercial

Grok 3

SWE-bench Verified0.00

LiveCodeBench70.60

HumanEval0.00

不开源

OpenAI o3-mini (medium)

SWE-bench Verified0.00

LiveCodeBench67.40

HumanEval0.00

不开源

QwQ-Max-Preview

SWE-bench Verified0.00

LiveCodeBench65.60

HumanEval0.00

Free commercial

GLM-4-9B-Chat

90B

SWE-bench Verified0.00

LiveCodeBench51.80

HumanEval0.00

Free commercial

Gemma 3 - 12B (IT)

120B

SWE-bench Verified0.00

LiveCodeBench24.60

HumanEval0.00

Free commercial

100

Gemini 2.0 Flash-Lite

SWE-bench Verified0.00

LiveCodeBench28.90

HumanEval0.00

不开源

101

Qwen3-30B-A3B

305B

SWE-bench Verified0.00

LiveCodeBench29.00

HumanEval0.00

Free commercial

102

Llama 4 Scout Instruct

1090B

SWE-bench Verified0.00

LiveCodeBench32.80

HumanEval0.00

Free commercial

103

Qwen3-4B-2507

40B

SWE-bench Verified0.00

LiveCodeBench35.10

HumanEval0.00

Free commercial

104

GPT-4o(2025-03-27)

SWE-bench Verified0.00

LiveCodeBench35.80

HumanEval0.00

不开源

105

ERNIE-4.5-300B-A47B

3000B

SWE-bench Verified0.00

LiveCodeBench38.80

HumanEval0.00

Free commercial

106

ERNIE-4.5-VL-424B-A47B-Base

4240B

SWE-bench Verified0.00

LiveCodeBench38.80

HumanEval0.00

Free commercial

107

Qwen3-30B-A3B-2507

305B

SWE-bench Verified0.00

LiveCodeBench43.20

HumanEval0.00

Free commercial

108

Llama 4 Maverick Instruct

4000B

SWE-bench Verified0.00

LiveCodeBench43.40

HumanEval0.00

Free commercial

109

Claude Sonnet 4

SWE-bench Verified0.00

LiveCodeBench48.50

HumanEval0.00

不开源

110

Llama 4 Behemoth Instruct

20000B

SWE-bench Verified0.00

LiveCodeBench49.40

HumanEval0.00

Free commercial

111

Qwen3-235B-A22B-2507

2350B

SWE-bench Verified0.00

LiveCodeBench51.80

HumanEval0.00

Free commercial

112

MiniMax M2

2300B

SWE-bench Verified0.00

LiveCodeBench83.00

HumanEval0.00

Free commercial

113

DeepSeek V3.2-Exp

6710B

SWE-bench Verified0.00

LiveCodeBench55.00

HumanEval0.00

Free commercial

114

GPT-5-mini

SWE-bench Verified0.00

LiveCodeBench55.00

HumanEval0.00

不开源

115

Qwen3-4B-Thinking-2507

40B

SWE-bench Verified0.00

LiveCodeBench55.20

HumanEval0.00

Free commercial

116

Magistral-Small-2506

240B

SWE-bench Verified0.00

LiveCodeBench55.84

HumanEval0.00

Free commercial

117

Qwen3-Next

800B

SWE-bench Verified0.00

LiveCodeBench56.60

HumanEval0.00

Free commercial

118

Hunyuan-7B

70B

SWE-bench Verified0.00

LiveCodeBench57.00

HumanEval0.00

Free commercial

119

Qwen3-8B

80B

SWE-bench Verified0.00

LiveCodeBench57.50

HumanEval0.00

Free commercial

120

Magistral-Medium-2506

SWE-bench Verified0.00

LiveCodeBench59.36

HumanEval0.00

不开源

121

Pangu Pro MoE

719B

SWE-bench Verified0.00

LiveCodeBench59.60

HumanEval0.00

Free commercial

122

Qwen3-8B

80B

SWE-bench Verified0.00

LiveCodeBench61.80

HumanEval0.00

Free commercial

123

Haiku 4.5

SWE-bench Verified0.00

LiveCodeBench62.00

HumanEval0.00

不开源

124

Hunyuan-A13B-Instruct

800B

SWE-bench Verified0.00

LiveCodeBench63.90

HumanEval0.00

Free commercial

125

Hunyuan-T1

SWE-bench Verified0.00

LiveCodeBench64.90

HumanEval0.00

不开源

126

Qwen2.5-Max

SWE-bench Verified0.00

LiveCodeBench0.00

HumanEval73.20

不开源

127

Grok 2

2690B

SWE-bench Verified0.00

LiveCodeBench0.00

HumanEval88.40

Free commercial

128

Claude 3.5 Haiku

SWE-bench Verified0.00

LiveCodeBench0.00

HumanEval88.10

不开源

129

Gemma 3 - 27B (IT)

270B

SWE-bench Verified0.00

LiveCodeBench29.70

HumanEval87.80

Free commercial

130

GPT-4o mini

SWE-bench Verified0.00

LiveCodeBench0.00

HumanEval87.20

不开源

131

Codestral 25.01

SWE-bench Verified0.00

LiveCodeBench37.90

HumanEval86.60

不开源

132

Claude3-Opus

SWE-bench Verified0.00

LiveCodeBench0.00

HumanEval84.90

不开源

133

Codestral

220B

SWE-bench Verified0.00

LiveCodeBench31.50

HumanEval81.10

Non-commercial

134

Llama3.1-70B-Instruct

700B

SWE-bench Verified0.00

LiveCodeBench33.30

HumanEval80.50

Free commercial

135

Phi-4-mini-instruct (3.8B)

38B

SWE-bench Verified0.00

LiveCodeBench0.00

HumanEval74.40

Free commercial

136

Grok-1.5

SWE-bench Verified0.00

LiveCodeBench0.00

HumanEval74.10

不开源

137

Llama3.3-70B-Instruct

700B

SWE-bench Verified0.00

LiveCodeBench33.30

HumanEval88.40

Free commercial

138

Llama3.1-8B-Instruct

80B

SWE-bench Verified0.00

LiveCodeBench0.00

HumanEval66.50

Free commercial

139

C4AI Aya Vision 32B

320B

SWE-bench Verified0.00

LiveCodeBench0.00

HumanEval62.20

Non-commercial

140

Qwen2.5-72B

727B

SWE-bench Verified0.00

LiveCodeBench0.00

HumanEval59.10

Free commercial

141

Qwen2.5-7B

70B

SWE-bench Verified0.00

LiveCodeBench0.00

HumanEval57.90

Free commercial

142

Moonlight-16B-A3B-Instruct

160B

SWE-bench Verified0.00

LiveCodeBench0.00

HumanEval48.10

Free commercial

143

Qwen2.5-3B

30B

SWE-bench Verified0.00

LiveCodeBench0.00

HumanEval42.10

Free commercial

144

Gemma 2 - 9B

90B

SWE-bench Verified0.00

LiveCodeBench0.00

HumanEval37.80

Free commercial

145

Llama3.1-8B

80B

SWE-bench Verified0.00

LiveCodeBench0.00

HumanEval33.50

Free commercial

146

Mistral-7B-Instruct-v0.3

70B

SWE-bench Verified0.00

LiveCodeBench0.00

HumanEval29.30

Free commercial

147

Llama-3.2-3B

32B

SWE-bench Verified0.00

LiveCodeBench0.00

HumanEval28.00

Free commercial

148

Gemini 2.5 Deep Think

SWE-bench Verified0.00

LiveCodeBench87.60

HumanEval0.00

不开源

149

Grok-3 - Reasoning Beta

SWE-bench Verified0.00

LiveCodeBench79.40

HumanEval0.00

不开源

150

DeepSeek-V3.1 Terminus

6710B

SWE-bench Verified0.00

LiveCodeBench80.00

HumanEval0.00

Free commercial

151

Grok 4 Fast

SWE-bench Verified0.00

LiveCodeBench80.00

HumanEval0.00

不开源

152

Gemini 2.5 Pro Deep Think

SWE-bench Verified0.00

LiveCodeBench80.40

HumanEval0.00

不开源

153

Grok 4.1 Fast

SWE-bench Verified0.00

LiveCodeBench82.00

HumanEval0.00

不开源

154

GLM-4.6

3550B

SWE-bench Verified0.00

LiveCodeBench82.80

HumanEval0.00

Free commercial

155

QwQ-32B

325B

SWE-bench Verified0.00

LiveCodeBench0.00

HumanEval19.00

Free commercial

156

Kimi K2 Thinking

10400B

SWE-bench Verified0.00

LiveCodeBench83.10

HumanEval0.00

Free commercial

157

GLM-4.7

3580B

SWE-bench Verified0.00

LiveCodeBench84.90

HumanEval0.00

Free commercial

158

Claude Opus 4.5

SWE-bench Verified0.00

LiveCodeBench87.00

HumanEval0.00

不开源

159

Gemini 2.5-Pro

SWE-bench Verified0.00

LiveCodeBench77.10

HumanEval0.00

不开源

160

OpenAI o1-mini

SWE-bench Verified0.00

LiveCodeBench52.00

HumanEval92.40

不开源

161

Claude 3.5 Sonnet

SWE-bench Verified0.00

LiveCodeBench0.00

HumanEval92.00

不开源

162

Hunyuan-TurboS

SWE-bench Verified0.00

LiveCodeBench32.00

HumanEval91.00

不开源

163

GPT-4o(2024-11-20)

SWE-bench Verified0.00

LiveCodeBench0.00

HumanEval90.20

不开源

164

Gemini 1.5 Pro

SWE-bench Verified0.00

LiveCodeBench0.00

HumanEval89.00

不开源

165

Llama3.1-405B Instruct

4050B

SWE-bench Verified0.00

LiveCodeBench30.20

HumanEval89.00

Free commercial

166

Amazon Nova Pro

SWE-bench Verified0.00

LiveCodeBench0.00

HumanEval89.00

不开源

167

DeepSeek-V3

6810B

SWE-bench Verified0.00

LiveCodeBench34.60

HumanEval89.00

Free commercial

168

Mistral-Small-3.1-24B-Instruct-2503

240B

SWE-bench Verified0.00

LiveCodeBench0.00

HumanEval88.41

Free commercial

169

Qwen2.5-32B

320B

SWE-bench Verified0.00

LiveCodeBench51.20

HumanEval88.40

Free commercial