DataLearner logoDataLearnerAI
Latest AI Insights
Model Leaderboards
Benchmarks
Model Directory
Model Comparison
Resource Center
Tools
LanguageEnglish
DataLearner logoDataLearner AI

A knowledge platform focused on LLM benchmarking, datasets, and practical instruction with continuously updated capability maps.

Products

  • Leaderboards
  • Model comparison
  • Datasets

Resources

  • Tutorials
  • Editorial
  • Tool directory

Company

  • About
  • Privacy policy
  • Data methodology
  • Contact

© 2026 DataLearner AI. DataLearner curates industry data and case studies so researchers, enterprises, and developers can rely on trustworthy intelligence.

Privacy policyTerms of service
Back to Main Leaderboard

LLM Coding Benchmark Leaderboard

This page provides the LLM coding benchmark leaderboard, covering SWE-Bench Verified, SWE-Bench Pro, LiveCodeBench, and SWE-bench Multilingual datasets, comparing GPT, Claude, Qwen, and DeepSeek models.

Updated on 2026-05-21 22:14:17

As of 2026-05, this page covers SWE-bench Verified, LiveCodeBench, SWE-Bench Pro - Public, SWE-bench Multilingual and related benchmarks for LLM Coding Benchmark Leaderboard, making it straightforward to compare within the same task family.

Click any model name to check context length, licensing, and pricing on its detail page. See Data Methodology for scoring details.

Reference: Composite Coding Rankings

There is no single, universally accepted coding leaderboard. Static benchmarks like SWE-bench and HumanEval measure specific skills but can be gamed through targeted fine-tuning. We selected two complementary human-preference leaderboards: LMArena Coding Arena ranks models on general programming tasks (debugging, algorithms, code generation) via anonymous crowd-sourced voting; DesignArena Code Category focuses specifically on visual, front-end code generation (websites, UI components, games) using the same blind-voting methodology. Reading both together gives a fuller picture of coding capability.

LMArena Coding Arena

Full ranking

Elo ratings from anonymous A/B voting on real general coding tasks (debugging, algorithms, code generation) submitted by developers.

Updated 2026-05-14

#ModelElo
1
Anthropic
Opus 4.7 (thinking)Anthropic
1563
2
Anthropic
Opus 4.7Anthropic
1551
3
Anthropic
Claude Opus 4.6 (thinking)Anthropic
1550
4
Anthropic
Claude Opus 4.6Anthropic
1549
5
Anthropic
Claude Opus 4 (thinking-32k)Anthropic
1531
6
F
Muse SparkFacebook AI研究实验室
1530
7
OpenAI
GPT-5.4 (high)OpenAI
1527
8
智
GLM 5.1智谱AI
1527
9
Google Deep Mind
Gemini 3.1 Pro PreviewGoogle Deep Mind
1526
10
Anthropic
Claude Sonnet 4.6Anthropic
1522
Benchmark
SWE-bench VerifiedLiveCodeBenchSWE-Bench Pro - PublicSWE-bench Multilingual
More Benchmarks
Model Size:All3B and below7B

Top picks

Ranked by SWE-bench Multilingual
Current SOTA
阿里巴巴

Qwen3.7-Max-Preview

阿里巴巴

78.30SWE-bench Multilingual
View model
Best Open-Source

No qualifying model on this benchmark.

Best China-Made
阿里巴巴

Qwen3.6-Max-Preview

阿里巴巴

73.80SWE-bench Multilingual−4.50
View model

LLM Performance Results

Data source: DataLearnerAI

Click any row to open the model page. Tick the checkboxes to compare up to 4 models side by side.

RankModel
License
阿里巴巴
Qwen3.7-Max-Preview
阿里巴巴
80.4091.6060.6078.30ProprietaryDetailsDetails
阿里巴巴
Qwen3.6-Max-Preview
阿里巴巴
78.8087.1057.3073.80ProprietaryDetailsDetails
阿里巴巴
Qwen3-Max-Thinking
阿里巴巴
75.3085.90——ProprietaryDetailsDetails
4
OpenAI
o3-pro
OpenAI
75.00———ProprietaryDetailsDetails
5
Anthropic
Claude Opus 4
Anthropic
72.5056.60——ProprietaryDetailsDetails
6
Anthropic
Claude Sonnet 3.7
Anthropic
70.30———ProprietaryDetailsDetails
7
OpenAI
OpenAI o4 - mini
OpenAI
68.10———ProprietaryDetailsDetails
8
Google Deep Mind
Gemini-2.5-Pro-Preview-05-06
Google Deep Mind
63.2077.10——ProprietaryDetailsDetails
9
OpenAI
GPT-4.1
OpenAI
54.6040.50——ProprietaryDetailsDetails
10
Google Deep Mind
Gemini 2.5 Flash
Google Deep Mind
50.0055.40——ProprietaryDetailsDetails
11
OpenAI
OpenAI o3-mini (high)
OpenAI
49.3069.50——ProprietaryDetailsDetails
12
OpenAI
OpenAI o1
OpenAI
48.9071.00——ProprietaryDetailsDetails
13
OpenAI
GPT-4.5
OpenAI
38.0046.40——ProprietaryDetailsDetails
14
OpenAI
GPT-4o(2024-11-20)
OpenAI
31.00———ProprietaryDetailsDetails
15
Google Deep Mind
Gemini 2.5 Flash-Lite
Google Deep Mind
27.6034.30——ProprietaryDetailsDetails
16
OpenAI
GPT-4.1 mini
OpenAI
23.60———ProprietaryDetailsDetails
17
DeepMind
Gemini 2.0 Flash Experimental
DeepMind
21.4029.10——ProprietaryDetailsDetails
18
MistralAI
Codestral 25.01
MistralAI
—37.90——ProprietaryDetailsDetails
19
腾讯AI实验室
Hunyuan-TurboS
腾讯AI实验室
—32.00——ProprietaryDetailsDetails
20
DeepMind
Gemini 2.0 Flash-Lite
DeepMind
—28.90——ProprietaryDetailsDetails
21
OpenAI
OpenAI o1-mini
OpenAI
—52.00——ProprietaryDetailsDetails
22
MistralAI
Magistral-Medium-2506
MistralAI
—59.36——ProprietaryDetailsDetails
23
Moonshot AI
Kimi-k1.6-IOI
Moonshot AI
—65.90——ProprietaryDetailsDetails
24
OpenAI
OpenAI o3-mini (medium)
OpenAI
—67.40——ProprietaryDetailsDetails
25
xAI
Grok 3
xAI
—70.60——ProprietaryDetailsDetails
26
Moonshot AI
Kimi-k1.6-IOI-high
Moonshot AI
—73.80——ProprietaryDetailsDetails
27
xAI
Grok-3 - Reasoning Beta
xAI
—79.40——ProprietaryDetailsDetails
28
Google Deep Mind
Gemini 2.5 Pro Deep Think
Google Deep Mind
—80.40——ProprietaryDetailsDetails
Qwen3.7-Max-Preview
阿里巴巴
SWE-bench Verified80.40
LiveCodeBench91.60
SWE-Bench Pro - Public60.60
SWE-bench Multilingual78.30
Proprietary
Qwen3.6-Max-Preview
阿里巴巴
SWE-bench Verified78.80
LiveCodeBench87.10
SWE-Bench Pro - Public57.30
SWE-bench Multilingual73.80
Proprietary
Qwen3-Max-Thinking
阿里巴巴
SWE-bench Verified75.30
LiveCodeBench85.90
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Proprietary
4
o3-pro
OpenAI
SWE-bench Verified75.00
LiveCodeBench—
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Proprietary
5
Claude Opus 4
Anthropic
SWE-bench Verified72.50
LiveCodeBench56.60
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Proprietary
6
Claude Sonnet 3.7
Anthropic
SWE-bench Verified70.30
LiveCodeBench—
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Proprietary
7
OpenAI o4 - mini
OpenAI
SWE-bench Verified68.10
LiveCodeBench—
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Proprietary
8
Gemini-2.5-Pro-Preview-05-06
Google Deep Mind
SWE-bench Verified63.20
LiveCodeBench77.10
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Proprietary
9
GPT-4.1
OpenAI
SWE-bench Verified54.60
LiveCodeBench40.50
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Proprietary
10
Gemini 2.5 Flash
Google Deep Mind
SWE-bench Verified50.00
LiveCodeBench55.40
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Proprietary
11
OpenAI o3-mini (high)
OpenAI
SWE-bench Verified49.30
LiveCodeBench69.50
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Proprietary
12
OpenAI o1
OpenAI
SWE-bench Verified48.90
LiveCodeBench71.00
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Proprietary
13
GPT-4.5
OpenAI
SWE-bench Verified38.00
LiveCodeBench46.40
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Proprietary
14
GPT-4o(2024-11-20)
OpenAI
SWE-bench Verified31.00
LiveCodeBench—
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Proprietary
15
Gemini 2.5 Flash-Lite
Google Deep Mind
SWE-bench Verified27.60
LiveCodeBench34.30
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Proprietary
16
GPT-4.1 mini
OpenAI
SWE-bench Verified23.60
LiveCodeBench—
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Proprietary
17
Gemini 2.0 Flash Experimental
DeepMind
SWE-bench Verified21.40
LiveCodeBench29.10
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Proprietary
18
Codestral 25.01
MistralAI
SWE-bench Verified—
LiveCodeBench37.90
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Proprietary
19
Hunyuan-TurboS
腾讯AI实验室
SWE-bench Verified—
LiveCodeBench32.00
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Proprietary
20
Gemini 2.0 Flash-Lite
DeepMind
SWE-bench Verified—
LiveCodeBench28.90
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Proprietary
21
OpenAI o1-mini
OpenAI
SWE-bench Verified—
LiveCodeBench52.00
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Proprietary
22
Magistral-Medium-2506
MistralAI
SWE-bench Verified—
LiveCodeBench59.36
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Proprietary
23
Kimi-k1.6-IOI
Moonshot AI
SWE-bench Verified—
LiveCodeBench65.90
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Proprietary
24
OpenAI o3-mini (medium)
OpenAI
SWE-bench Verified—
LiveCodeBench67.40
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Proprietary
25
Grok 3
xAI
SWE-bench Verified—
LiveCodeBench70.60
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Proprietary
26
Kimi-k1.6-IOI-high
Moonshot AI
SWE-bench Verified—
LiveCodeBench73.80
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Proprietary
27
Grok-3 - Reasoning Beta
xAI
SWE-bench Verified—
LiveCodeBench79.40
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Proprietary
28
Gemini 2.5 Pro Deep Think
Google Deep Mind
SWE-bench Verified—
LiveCodeBench80.40
SWE-Bench Pro - Public—
SWE-bench Multilingual—
Proprietary
Sort by:
Source: LMArena

DesignArena Code Category

Full ranking

Elo ratings from anonymous voting on visual front-end code tasks (websites, UI components, games, data viz) by Arcada Labs.

Updated 2026-05-17

#ModelElo
1
Anthropic
Claude Opus 4.6Anthropic
1348
2
Anthropic
Opus 4.7 (thinking)Anthropic
1345
3
Anthropic
Claude Opus 4.6 (thinking)Anthropic
1344
4
Moonshot AI
Kimi K2.6Moonshot AI
1343
5
智
GLM 5.1智谱AI
1338
6
Anthropic
Opus 4.7Anthropic
1335
7
智
GLM-5-Turbo智谱AI
1334
8
Anthropic
Claude Sonnet 4.6Anthropic
1331
9
X
MiMo-V2.5-ProXiaomi
1329
10
OpenAI
GPT-5.5OpenAI
1320
Source: DesignArena
13B
34B
65B
100B and above
Model Type:AllReasoning ModelsFoundation ModelsInstruction/Chat ModelsCoding Models
Source:AllOpen SourceClosed Source
Origin:AllChina
Model release cutoff: