DataLearner logoDataLearnerAI
Latest AI Insights
Model Leaderboards
Benchmarks
Model Directory
Model Comparison
Resource Center
Tools
LanguageEnglish
DataLearner logoDataLearner AI

A knowledge platform focused on LLM benchmarking, datasets, and practical instruction with continuously updated capability maps.

Products

  • Leaderboards
  • Model comparison
  • Datasets

Resources

  • Tutorials
  • Editorial
  • Tool directory

Company

  • About
  • Privacy policy
  • Data methodology
  • Contact

© 2026 DataLearner AI. DataLearner curates industry data and case studies so researchers, enterprises, and developers can rely on trustworthy intelligence.

Privacy policyTerms of service
Back to Main Leaderboard

LLM Coding Benchmark Leaderboard

This page provides the LLM coding benchmark leaderboard, covering SWE-Bench Verified, SWE-Bench Pro, LiveCodeBench, and SWE-bench Multilingual datasets, comparing GPT, Claude, Qwen, and DeepSeek models.

Updated on 2026-05-02 07:10:24

As of 2026-05, this page covers SWE-bench Verified, LiveCodeBench, SWE-Bench Pro - Public, SWE-bench Multilingual and related benchmarks for LLM Coding Benchmark Leaderboard, making it straightforward to compare within the same task family.

Click any model name to check context length, licensing, and pricing on its detail page. See Data Methodology for scoring details.

Reference: Composite Coding Rankings

There is no single, universally accepted coding leaderboard. Static benchmarks like SWE-bench and HumanEval measure specific skills but can be gamed through targeted fine-tuning. We selected two complementary human-preference leaderboards: LMArena Coding Arena ranks models on general programming tasks (debugging, algorithms, code generation) via anonymous crowd-sourced voting; DesignArena Code Category focuses specifically on visual, front-end code generation (websites, UI components, games) using the same blind-voting methodology. Reading both together gives a fuller picture of coding capability.

LMArena Coding Arena

Full ranking

Elo ratings from anonymous A/B voting on real general coding tasks (debugging, algorithms, code generation) submitted by developers.

Updated 2026-05-07

#ModelElo
1
Anthropic
Opus 4.7 (thinking)Anthropic
1569
2
Anthropic
Claude Opus 4.6 (thinking)Anthropic
1553
3
Anthropic
Opus 4.7Anthropic
1550
4
Anthropic
Claude Opus 4.6Anthropic
1550
5
Anthropic
Claude Opus 4 (thinking-32k)Anthropic
1531
6
F
Muse SparkFacebook AI研究实验室
1530
7
Google Deep Mind
Gemini 3.1 Pro PreviewGoogle Deep Mind
1529
8
OpenAI
gpt-5.4-highOpenAI
1528
9
智
GLM 5.1智谱AI
1525
10
OpenAI
gpt-5.5-highOpenAI
1524
Benchmark
SWE-bench VerifiedLiveCodeBenchSWE-Bench Pro - PublicSWE-bench Multilingual
More Benchmarks
Model Size:All3B and below7B13B

LLM Performance Results

Data source: DataLearnerAI
RankModelLicense
Moonshot AI
Kimi K2.6
Moonshot AI
80.2089.6058.6076.70Free commercial
DeepSeek-AI
DeepSeek-V4-Pro
DeepSeek-AI
80.6093.5055.4076.20Free commercial
DeepSeek-AI
DeepSeek-V4-Flash
DeepSeek-AI
79.0091.6052.6073.30Free commercial
4
Moonshot AI
Kimi K2.5
Moonshot AI
76.8085.0050.7073.00Free commercial
5
MiniMaxAI
MiniMax M2.5
MiniMaxAI
80.20—55.40—Free commercial
6
智谱AI
GLM-5
智谱AI
77.80———Free commercial
7
阿里巴巴
Qwen3-Max-Thinking
阿里巴巴
75.3085.90——Proprietary
8
OpenAI
o3-pro
OpenAI
75.00———Proprietary
9
MiniMaxAI
M2.1
MiniMaxAI
74.80—32.60—Free commercial
10
StepFunAI
Step 3.5 Flash
StepFunAI
74.4086.40——Free commercial
11
智谱AI
GLM-4.7
智谱AI
73.8084.9040.60—Free commercial
12
DeepSeek-AI
DeepSeek V3.2
DeepSeek-AI
73.1083.3040.90—Free commercial
13
Anthropic
Claude Opus 4
Anthropic
72.5056.60——Proprietary
14
Moonshot AI
Kimi K2 Thinking
Moonshot AI
71.3083.10——Free commercial
15
Anthropic
Claude Sonnet 3.7
Anthropic
70.30———Proprietary
16
MiniMaxAI
MiniMax M2
MiniMaxAI
69.4083.00——Free commercial
17
Moonshot AI
Kimi K2 0905
Moonshot AI
69.20—27.67—Free commercial
18
DeepSeek-AI
DeepSeek-V3.1 Terminus
DeepSeek-AI
68.4080.00——Free commercial
19
OpenAI
OpenAI o4 - mini
OpenAI
68.10———Proprietary
20
智谱AI
GLM-4.6
智谱AI
68.0084.50——Free commercial
21
DeepSeek-AI
DeepSeek V3.2-Exp
DeepSeek-AI
67.8074.10——Free commercial
22
阿里巴巴
Qwen3-Coder-480B-A35B
阿里巴巴
67.00———Free commercial
23
DeepSeek-AI
DeepSeek-V3.1
DeepSeek-AI
66.0074.80——Free commercial
24
智谱AI
GLM-4.5
智谱AI
64.2072.90——Free commercial
25
Google Deep Mind
Gemini-2.5-Pro-Preview-05-06
Google Deep Mind
63.2077.10——Proprietary
26
DeepSeek-AI
DeepSeek-R1-0528
DeepSeek-AI
57.6073.30——Free commercial
27
智谱AI
GLM-4.5-Air
智谱AI
57.6070.70——Free commercial
28
MiniMaxAI
MiniMax-M1-80k
MiniMaxAI
56.0065.00——Free commercial
29
MiniMaxAI
MiniMax-M1-40k
MiniMaxAI
55.6062.30——Free commercial
30
OpenAI
GPT-4.1
OpenAI
54.6040.50——Proprietary
31
Moonshot AI
Kimi K2
Moonshot AI
51.8053.70——Free commercial
32
Google Deep Mind
Gemini 2.5 Flash
Google Deep Mind
50.0055.40——Proprietary
33
OpenAI
OpenAI o3-mini (high)
OpenAI
49.3069.50——Proprietary
34
DeepSeek-AI
DeepSeek-R1
DeepSeek-AI
49.2065.90——Free commercial
35
OpenAI
OpenAI o1
OpenAI
48.9071.00——Proprietary
36
DeepSeek-AI
DeepSeek-V3-0324
DeepSeek-AI
38.8049.20——Free commercial
37
OpenAI
GPT-4.5
OpenAI
38.0046.40——Proprietary
38
阿里巴巴
Qwen3-235B-A22B
阿里巴巴
34.4070.70——Free commercial
39
OpenAI
GPT-4o(2024-11-20)
OpenAI
31.00———Proprietary
40
Google Deep Mind
Gemini 2.5 Flash-Lite
Google Deep Mind
27.6034.30——Proprietary
41
OpenAI
GPT-4.1 mini
OpenAI
23.60———Proprietary
42
DeepMind
Gemini 2.0 Flash Experimental
DeepMind
21.4029.10——Proprietary
43
Facebook AI研究实验室
Llama 4 Behemoth Instruct
Facebook AI研究实验室
—49.40——Free commercial
44
MiniMaxAI
MiniMax-M2.7
MiniMaxAI
——56.20—Non-commercial
45
Facebook AI研究实验室
Llama 4 Maverick Instruct
Facebook AI研究实验室
—43.40——Free commercial
46
百度
ERNIE-4.5-VL-424B-A47B-Base
百度
—38.80——Free commercial
47
百度
ERNIE-4.5-300B-A47B
百度
—38.80——Free commercial
48
MistralAI
Codestral 25.01
MistralAI
—37.90——Proprietary
49
DeepSeek-AI
DeepSeek-V3
DeepSeek-AI
—34.60——Free commercial
50
Facebook AI研究实验室
Llama 4 Scout Instruct
Facebook AI研究实验室
—32.80——Free commercial
Kimi K2.6
Moonshot AI
SWE-bench Verified80.20
LiveCodeBench89.60
SWE-Bench Pro - Public58.60
SWE-bench Multilingual76.70
Free commercial
DeepSeek-V4-Pro
DeepSeek-AI
SWE-bench Verified80.60
LiveCodeBench93.50
SWE-Bench Pro - Public55.40
SWE-bench Multilingual76.20
Free commercial
DeepSeek-V4-Flash
DeepSeek-AI
SWE-bench Verified79.00
LiveCodeBench91.60
SWE-Bench Pro - Public52.60
SWE-bench Multilingual73.30
Free commercial
4
Kimi K2.5
Moonshot AI
SWE-bench Verified76.80
LiveCodeBench85.00
SWE-Bench Pro - Public50.70
SWE-bench Multilingual73.00
Free commercial
5
MiniMax M2.5
MiniMaxAI
SWE-bench Verified80.20
LiveCodeBench—
SWE-Bench Pro - Public55.40
SWE-bench Multilingual—
Free commercial
6
GLM-5
智谱AI
SWE-bench Verified77.80
LiveCodeBench—
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Free commercial
7
Qwen3-Max-Thinking
阿里巴巴
SWE-bench Verified75.30
LiveCodeBench85.90
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Proprietary
8
o3-pro
OpenAI
SWE-bench Verified75.00
LiveCodeBench—
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Proprietary
9
M2.1
MiniMaxAI
SWE-bench Verified74.80
LiveCodeBench—
SWE-Bench Pro - Public32.60
SWE-bench Multilingual—
Free commercial
10
Step 3.5 Flash
StepFunAI
SWE-bench Verified74.40
LiveCodeBench86.40
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Free commercial
11
GLM-4.7
智谱AI
SWE-bench Verified73.80
LiveCodeBench84.90
SWE-Bench Pro - Public40.60
SWE-bench Multilingual—
Free commercial
12
DeepSeek V3.2
DeepSeek-AI
SWE-bench Verified73.10
LiveCodeBench83.30
SWE-Bench Pro - Public40.90
SWE-bench Multilingual—
Free commercial
13
Claude Opus 4
Anthropic
SWE-bench Verified72.50
LiveCodeBench56.60
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Proprietary
14
Kimi K2 Thinking
Moonshot AI
SWE-bench Verified71.30
LiveCodeBench83.10
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Free commercial
15
Claude Sonnet 3.7
Anthropic
SWE-bench Verified70.30
LiveCodeBench—
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Proprietary
16
MiniMax M2
MiniMaxAI
SWE-bench Verified69.40
LiveCodeBench83.00
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Free commercial
17
Kimi K2 0905
Moonshot AI
SWE-bench Verified69.20
LiveCodeBench—
SWE-Bench Pro - Public27.67
SWE-bench Multilingual—
Free commercial
18
DeepSeek-V3.1 Terminus
DeepSeek-AI
SWE-bench Verified68.40
LiveCodeBench80.00
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Free commercial
19
OpenAI o4 - mini
OpenAI
SWE-bench Verified68.10
LiveCodeBench—
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Proprietary
20
GLM-4.6
智谱AI
SWE-bench Verified68.00
LiveCodeBench84.50
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Free commercial
21
DeepSeek V3.2-Exp
DeepSeek-AI
SWE-bench Verified67.80
LiveCodeBench74.10
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Free commercial
22
Qwen3-Coder-480B-A35B
阿里巴巴
SWE-bench Verified67.00
LiveCodeBench—
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Free commercial
23
DeepSeek-V3.1
DeepSeek-AI
SWE-bench Verified66.00
LiveCodeBench74.80
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Free commercial
24
GLM-4.5
智谱AI
SWE-bench Verified64.20
LiveCodeBench72.90
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Free commercial
25
Gemini-2.5-Pro-Preview-05-06
Google Deep Mind
SWE-bench Verified63.20
LiveCodeBench77.10
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Proprietary
26
DeepSeek-R1-0528
DeepSeek-AI
SWE-bench Verified57.60
LiveCodeBench73.30
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Free commercial
27
GLM-4.5-Air
智谱AI
SWE-bench Verified57.60
LiveCodeBench70.70
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Free commercial
28
MiniMax-M1-80k
MiniMaxAI
SWE-bench Verified56.00
LiveCodeBench65.00
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Free commercial
29
MiniMax-M1-40k
MiniMaxAI
SWE-bench Verified55.60
LiveCodeBench62.30
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Free commercial
30
GPT-4.1
OpenAI
SWE-bench Verified54.60
LiveCodeBench40.50
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Proprietary
31
Kimi K2
Moonshot AI
SWE-bench Verified51.80
LiveCodeBench53.70
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Free commercial
32
Gemini 2.5 Flash
Google Deep Mind
SWE-bench Verified50.00
LiveCodeBench55.40
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Proprietary
33
OpenAI o3-mini (high)
OpenAI
SWE-bench Verified49.30
LiveCodeBench69.50
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Proprietary
34
DeepSeek-R1
DeepSeek-AI
SWE-bench Verified49.20
LiveCodeBench65.90
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Free commercial
35
OpenAI o1
OpenAI
SWE-bench Verified48.90
LiveCodeBench71.00
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Proprietary
36
DeepSeek-V3-0324
DeepSeek-AI
SWE-bench Verified38.80
LiveCodeBench49.20
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Free commercial
37
GPT-4.5
OpenAI
SWE-bench Verified38.00
LiveCodeBench46.40
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Proprietary
38
Qwen3-235B-A22B
阿里巴巴
SWE-bench Verified34.40
LiveCodeBench70.70
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Free commercial
39
GPT-4o(2024-11-20)
OpenAI
SWE-bench Verified31.00
LiveCodeBench—
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Proprietary
40
Gemini 2.5 Flash-Lite
Google Deep Mind
SWE-bench Verified27.60
LiveCodeBench34.30
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Proprietary
41
GPT-4.1 mini
OpenAI
SWE-bench Verified23.60
LiveCodeBench—
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Proprietary
42
Gemini 2.0 Flash Experimental
DeepMind
SWE-bench Verified21.40
LiveCodeBench29.10
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Proprietary
43
Llama 4 Behemoth Instruct
Facebook AI研究实验室
SWE-bench Verified—
LiveCodeBench49.40
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Free commercial
44
MiniMax-M2.7
MiniMaxAI
SWE-bench Verified—
LiveCodeBench—
SWE-Bench Pro - Public56.20
SWE-bench Multilingual—
Non-commercial
45
Llama 4 Maverick Instruct
Facebook AI研究实验室
SWE-bench Verified—
LiveCodeBench43.40
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Free commercial
46
ERNIE-4.5-VL-424B-A47B-Base
百度
SWE-bench Verified—
LiveCodeBench38.80
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Free commercial
47
ERNIE-4.5-300B-A47B
百度
SWE-bench Verified—
LiveCodeBench38.80
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Free commercial
48
Codestral 25.01
MistralAI
SWE-bench Verified—
LiveCodeBench37.90
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Proprietary
49
DeepSeek-V3
DeepSeek-AI
SWE-bench Verified—
LiveCodeBench34.60
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Free commercial
50
Llama 4 Scout Instruct
Facebook AI研究实验室
SWE-bench Verified—
LiveCodeBench32.80
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Free commercial
Sort by:
Showing 50 of 66 modelsView SWE-bench Multilingual benchmark page
Source: LMArena

DesignArena Code Category

Full ranking

Elo ratings from anonymous voting on visual front-end code tasks (websites, UI components, games, data viz) by Arcada Labs.

Updated 2026-05-10

#ModelElo
1
Anthropic
Claude Opus 4.7 (Thinking)Anthropic
1350
2
Anthropic
Claude Opus 4.6Anthropic
1346
3
Anthropic
Claude Opus 4.6 (Thinking)Anthropic
1344
4
Moonshot AI
Kimi K2.6Moonshot AI
1343
5
Z
GLM 5.1Zhipu AI
1341
6
Anthropic
Opus 4.7Anthropic
1338
7
Z
GLM 5 TurboZhipu AI
1336
8
Anthropic
Claude Sonnet 4.6Anthropic
1331
9
OpenAI
GPT-5.5OpenAI
1314
10
DeepSeek-AI
DeepSeek-V4-ProDeepSeek-AI
1313
Source: DesignArena
34B
65B
100B and above
Model Type:AllReasoning ModelsFoundation ModelsInstruction/Chat ModelsCoding Models
Source:AllOpen SourceClosed Source
Origin:AllChina
Model release cutoff: