加载中...

LLM Benchmark Performance Comparison

Quickly view LLM performance across benchmarks like MMLU Pro, HLE, SWE-Bench, and more. Compare models across general knowledge, coding, and reasoning capabilities. Customize your comparison by selecting specific models and benchmarks.

Detailed benchmark descriptions available at:LLM Benchmark List & Guide

Updated on: 2025/11/08 22:10:24

Benchmark switcher

Pick the leaderboard to sync both chart and table

MMLU Pro GPQA Diamond SWE-bench Verified MATH-500 AIME 2024 LiveCodeBench

Filters

Active

Filter by parameter size

All 3B and below 7B 13B 34B 65B 100B and above

Filter by model type

All Reasoning Models Foundation Models Instruction/Chat Models Coding Models

LLM Performance Results

Data source: DataLearnerAI

LLM Performance Results

Data source: DataLearnerAI

MATH-500

Rank	Model	MMLU Pro	GPQA Diamond	SWE-bench Verified	MATH-500	AIME 2024	LiveCodeBench	Params (B)	License
1	OpenAI o1	91.04	77.30	48.90	96.40	79.20	71.00	—	不开源
2	M2.1	88.00	81.00	74.00	0.00	0.00	0.00	2300B	Free commercial
3	GPT-4.5	86.10	71.40	38.00	90.70	36.70	46.40	—	不开源
4	Qwen3-Max-Thinking	85.70	87.40	75.30	0.00	0.00	85.90	10000B	不开源
5	DeepSeek-R1-0528	85.00	81.00	57.60	98.00	91.40	73.30	6710B	Free commercial
6	DeepSeek-V3.1	85.00	80.10	66.00	0.00	93.10	74.80	6710B	Free commercial
7	DeepSeek-V3.1 Terminus	85.00	80.70	68.40	0.00	0.00	80.00	6710B	Free commercial
8	DeepSeek V3.2-Exp	85.00	79.90	67.80	0.00	0.00	74.10	6710B	Free commercial
9	Claude Opus 4	85.00	79.60	72.50	98.20	76.00	56.60	—	不开源
10	GLM-4.5	84.60	79.10	64.20	98.20	91.00	72.90	3550B	Free commercial
11	Kimi K2 Thinking	84.60	84.50	71.30	0.00	0.00	83.10	10400B	Free commercial
12	Qwen3-235B-A22B-Thinking-2507	84.40	81.10	0.00	0.00	0.00	74.10	2350B	Free commercial
13	GLM-4.7	84.30	85.70	73.80	0.00	0.00	84.90	3580B	Free commercial
14	DeepSeek-R1	84.00	71.50	49.20	97.30	79.80	65.90	6710B	Free commercial
15	Intern-S1	83.50	77.30	0.00	0.00	0.00	0.00	2410B	Free commercial
16	Qwen3-235B-A22B-2507	83.00	77.50	0.00	0.00	0.00	51.80	2350B	Free commercial
17	GLM-4.6	83.00	82.90	68.00	0.00	0.00	84.50	3550B	Free commercial
18	Llama 4 Behemoth Instruct	82.20	73.70	0.00	95.00	0.00	49.40	20000B	Free commercial
19	MiniMax M2	82.00	78.00	69.40	0.00	0.00	83.00	2300B	Free commercial
20	GLM-4.5-Air	81.40	75.00	57.60	98.10	89.40	70.70	1060B	Free commercial
21	DeepSeek-V3-0324	81.20	68.40	38.80	94.00	59.40	49.20	6710B	Free commercial
22	Kimi K2	81.10	75.10	51.80	97.40	69.60	53.70	10000B	Free commercial
23	MiniMax-M1-80k	81.10	70.00	56.00	96.80	86.00	65.00	4560B	Free commercial
24	OpenAI o4 - mini	80.60	81.40	68.10	0.00	98.70	0.00	—	不开源
25	MiniMax-M1-40k	80.60	69.20	55.60	96.00	83.30	62.30	4560B	Free commercial
26	Llama 4 Maverick Instruct	80.50	69.80	0.00	0.00	0.00	43.40	4000B	Free commercial
27	GPT-4.1	80.50	66.30	54.60	92.80	48.10	40.50	—	不开源
28	OpenAI o1-mini	80.30	60.00	0.00	90.00	63.60	52.00	—	不开源
29	Gemini 2.0 Pro Experimental	79.10	64.70	0.00	0.00	36.00	0.00	—	不开源
30	Hunyuan-TurboS	79.00	57.50	0.00	0.00	0.00	32.00	—	不开源
31	Kimi K2.5	78.50	87.60	76.80	0.00	0.00	85.00	10000B	Free commercial
32	ERNIE-4.5-300B-A47B	78.40	0.00	0.00	96.40	54.80	38.80	3000B	Free commercial
33	GPT-4o(2024-11-20)	77.90	0.00	0.00	0.00	0.00	0.00	—	不开源
34	Claude 3.5 Sonnet	77.64	59.40	0.00	0.00	0.00	0.00	—	不开源
35	Gemini 2.0 Flash Experimental	76.24	65.20	21.40	0.00	0.00	29.10	—	不开源
36	Qwen2.5-Max	76.10	0.00	0.00	0.00	0.00	0.00	—	不开源
37	DeepSeek-V3	75.90	59.10	0.00	87.80	39.00	34.60	6810B	Free commercial
38	Grok 2	75.50	56.00	0.00	0.00	0.00	0.00	2690B	Free commercial
39	Llama 4 Scout Instruct	74.30	57.20	0.00	0.00	0.00	32.80	1090B	Free commercial
40	Llama3.1-405B Instruct	73.40	49.00	0.00	0.00	0.00	30.20	4050B	Free commercial
41	Qwen3-235B-A22B	72.90	71.10	34.40	98.00	85.70	70.70	2350B	Free commercial
42	Gemini 2.0 Flash-Lite	71.60	51.50	0.00	0.00	0.00	28.90	—	不开源
43	Llama 4 Maverick	62.90	0.00	0.00	0.00	0.00	0.00	4000B	Free commercial
44	Llama3.1-405B	61.60	0.00	0.00	0.00	0.00	0.00	4050B	Free commercial
45	Llama 4 Scout	58.20	0.00	0.00	0.00	0.00	0.00	1090B	Free commercial
46	Mixtral-8x22B-Instruct-v0.1	56.33	0.00	0.00	0.00	0.00	0.00	1410B	Free commercial
47	Grok-1.5	51.00	35.90	0.00	0.00	0.00	0.00	—	不开源
48	Grok 3 mini	0.00	65.00	0.00	0.00	40.00	0.00	—	不开源
49	Codestral 25.01	0.00	0.00	0.00	0.00	0.00	37.90	—	不开源
50	GPT-4.1 mini	0.00	65.00	23.60	0.00	49.60	0.00	—	不开源
51	GPT-4.1 nano	0.00	50.30	0.00	0.00	29.40	0.00	—	不开源
52	Grok 3.5	0.00	0.00	0.00	0.00	0.00	0.00	—	不开源
53	Step 3.5 Flash	0.00	0.00	74.40	0.00	0.00	86.40	1960B	Free commercial
54	Kimi K2 0905	0.00	0.00	69.20	0.00	0.00	0.00	10000B	Free commercial
55	Qwen3-Coder-480B-A35B	0.00	0.00	67.00	0.00	0.00	0.00	4800B	Free commercial
56	Kimi k1.5 (Long-CoT)	0.00	0.00	0.00	96.20	0.00	0.00	—	不开源
57	Kimi k1.5 (Short-CoT)	0.00	0.00	0.00	94.60	0.00	0.00	—	不开源
58	Gemini 2.5 Pro Deep Think	0.00	0.00	0.00	0.00	0.00	80.40	—	不开源
59	Kimi-k1.6-IOI-high	0.00	0.00	0.00	0.00	0.00	73.80	—	不开源
60	OpenAI o3-mini (medium)	0.00	0.00	0.00	0.00	0.00	67.40	—	不开源
61	Kimi-k1.6-IOI	0.00	0.00	0.00	0.00	0.00	65.90	—	不开源
62	QwQ-Max-Preview	0.00	0.00	0.00	0.00	0.00	65.60	—	Free commercial
63	Gemini 2.5 Flash-Lite	0.00	66.70	27.60	0.00	0.00	34.30	—	不开源
64	Claude Sonnet 3.7	0.00	68.00	70.30	82.20	23.30	0.00	—	不开源
65	Magistral-Medium-2506	0.00	70.83	0.00	0.00	73.59	59.36	—	不开源
66	Step3	0.00	73.00	0.00	0.00	0.00	67.10	3210B	Free commercial
67	ERNIE-4.5-VL-424B-A47B-Base	0.00	76.80	0.00	0.00	0.00	38.80	4240B	Free commercial
68	OpenAI o3-mini (high)	0.00	79.70	49.30	97.90	87.00	69.50	—	不开源
69	Grok 3	0.00	80.40	0.00	0.00	84.20	70.60	—	不开源
70	DeepSeek V3.2	0.00	82.40	73.10	0.00	0.00	83.30	6710B	Free commercial
71	Gemini 2.5 Flash	0.00	82.80	50.00	0.00	88.00	55.40	—	不开源
72	Gemini-2.5-Pro-Preview-05-06	0.00	83.00	63.20	98.80	92.00	77.10	—	不开源
73	o3-pro	0.00	84.00	75.00	0.00	93.00	0.00	—	不开源
74	Grok-3 mini - Reasoning	0.00	84.00	0.00	0.00	96.00	0.00	—	不开源
75	Grok-3 - Reasoning Beta	0.00	84.60	0.00	0.00	93.30	79.40	—	不开源
76	Claude Sonnet 3.7-64K Extended Thinking	0.00	84.80	0.00	96.20	80.00	0.00	—	不开源
77	Amazon Nova Pro	0.00	0.00	0.00	0.00	0.00	0.00	—	不开源

OpenAI o1

MMLU Pro91.04

GPQA Diamond77.30

SWE-bench Verified48.90

MATH-50096.40

AIME 202479.20

LiveCodeBench71.00

不开源

M2.1

2300B

MMLU Pro88.00

GPQA Diamond81.00

SWE-bench Verified74.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

GPT-4.5

MMLU Pro86.10

GPQA Diamond71.40

SWE-bench Verified38.00

MATH-50090.70

AIME 202436.70

LiveCodeBench46.40

不开源

Qwen3-Max-Thinking

10000B

MMLU Pro85.70

GPQA Diamond87.40

SWE-bench Verified75.30

MATH-5000.00

AIME 20240.00

LiveCodeBench85.90

不开源

DeepSeek-R1-0528

6710B

MMLU Pro85.00

GPQA Diamond81.00

SWE-bench Verified57.60

MATH-50098.00

AIME 202491.40

LiveCodeBench73.30

Free commercial

DeepSeek-V3.1

6710B

MMLU Pro85.00

GPQA Diamond80.10

SWE-bench Verified66.00

MATH-5000.00

AIME 202493.10

LiveCodeBench74.80

Free commercial

DeepSeek-V3.1 Terminus

6710B

MMLU Pro85.00

GPQA Diamond80.70

SWE-bench Verified68.40

MATH-5000.00

AIME 20240.00

LiveCodeBench80.00

Free commercial

DeepSeek V3.2-Exp

6710B

MMLU Pro85.00

GPQA Diamond79.90

SWE-bench Verified67.80

MATH-5000.00

AIME 20240.00

LiveCodeBench74.10

Free commercial

Claude Opus 4

MMLU Pro85.00

GPQA Diamond79.60

SWE-bench Verified72.50

MATH-50098.20

AIME 202476.00

LiveCodeBench56.60

不开源

GLM-4.5

3550B

MMLU Pro84.60

GPQA Diamond79.10

SWE-bench Verified64.20

MATH-50098.20

AIME 202491.00

LiveCodeBench72.90

Free commercial

Kimi K2 Thinking

10400B

MMLU Pro84.60

GPQA Diamond84.50

SWE-bench Verified71.30

MATH-5000.00

AIME 20240.00

LiveCodeBench83.10

Free commercial

Qwen3-235B-A22B-Thinking-2507

2350B

MMLU Pro84.40

GPQA Diamond81.10

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench74.10

Free commercial

GLM-4.7

3580B

MMLU Pro84.30

GPQA Diamond85.70

SWE-bench Verified73.80

MATH-5000.00

AIME 20240.00

LiveCodeBench84.90

Free commercial

DeepSeek-R1

6710B

MMLU Pro84.00

GPQA Diamond71.50

SWE-bench Verified49.20

MATH-50097.30

AIME 202479.80

LiveCodeBench65.90

Free commercial

Intern-S1

2410B

MMLU Pro83.50

GPQA Diamond77.30

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

Qwen3-235B-A22B-2507

2350B

MMLU Pro83.00

GPQA Diamond77.50

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench51.80

Free commercial

GLM-4.6

3550B

MMLU Pro83.00

GPQA Diamond82.90

SWE-bench Verified68.00

MATH-5000.00

AIME 20240.00

LiveCodeBench84.50

Free commercial

Llama 4 Behemoth Instruct

20000B

MMLU Pro82.20

GPQA Diamond73.70

SWE-bench Verified0.00

MATH-50095.00

AIME 20240.00

LiveCodeBench49.40

Free commercial

MiniMax M2

2300B

MMLU Pro82.00

GPQA Diamond78.00

SWE-bench Verified69.40

MATH-5000.00

AIME 20240.00

LiveCodeBench83.00

Free commercial

GLM-4.5-Air

1060B

MMLU Pro81.40

GPQA Diamond75.00

SWE-bench Verified57.60

MATH-50098.10

AIME 202489.40

LiveCodeBench70.70

Free commercial

DeepSeek-V3-0324

6710B

MMLU Pro81.20

GPQA Diamond68.40

SWE-bench Verified38.80

MATH-50094.00

AIME 202459.40

LiveCodeBench49.20

Free commercial

Kimi K2

10000B

MMLU Pro81.10

GPQA Diamond75.10

SWE-bench Verified51.80

MATH-50097.40

AIME 202469.60

LiveCodeBench53.70

Free commercial

MiniMax-M1-80k

4560B

MMLU Pro81.10

GPQA Diamond70.00

SWE-bench Verified56.00

MATH-50096.80

AIME 202486.00

LiveCodeBench65.00

Free commercial

OpenAI o4 - mini

MMLU Pro80.60

GPQA Diamond81.40

SWE-bench Verified68.10

MATH-5000.00

AIME 202498.70

LiveCodeBench0.00

不开源

MiniMax-M1-40k

4560B

MMLU Pro80.60

GPQA Diamond69.20

SWE-bench Verified55.60

MATH-50096.00

AIME 202483.30

LiveCodeBench62.30

Free commercial

Llama 4 Maverick Instruct

4000B

MMLU Pro80.50

GPQA Diamond69.80

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench43.40

Free commercial

GPT-4.1

MMLU Pro80.50

GPQA Diamond66.30

SWE-bench Verified54.60

MATH-50092.80

AIME 202448.10

LiveCodeBench40.50

不开源

OpenAI o1-mini

MMLU Pro80.30

GPQA Diamond60.00

SWE-bench Verified0.00

MATH-50090.00

AIME 202463.60

LiveCodeBench52.00

不开源

Gemini 2.0 Pro Experimental

MMLU Pro79.10

GPQA Diamond64.70

SWE-bench Verified0.00

MATH-5000.00

AIME 202436.00

LiveCodeBench0.00

不开源

Hunyuan-TurboS

MMLU Pro79.00

GPQA Diamond57.50

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench32.00

不开源

Kimi K2.5

10000B

MMLU Pro78.50

GPQA Diamond87.60

SWE-bench Verified76.80

MATH-5000.00

AIME 20240.00

LiveCodeBench85.00

Free commercial

ERNIE-4.5-300B-A47B

3000B

MMLU Pro78.40

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-50096.40

AIME 202454.80

LiveCodeBench38.80

Free commercial

GPT-4o(2024-11-20)

MMLU Pro77.90

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

Claude 3.5 Sonnet

MMLU Pro77.64

GPQA Diamond59.40

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

Gemini 2.0 Flash Experimental

MMLU Pro76.24

GPQA Diamond65.20

SWE-bench Verified21.40

MATH-5000.00

AIME 20240.00

LiveCodeBench29.10

不开源

Qwen2.5-Max

MMLU Pro76.10

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

DeepSeek-V3

6810B

MMLU Pro75.90

GPQA Diamond59.10

SWE-bench Verified0.00

MATH-50087.80

AIME 202439.00

LiveCodeBench34.60

Free commercial

Grok 2

2690B

MMLU Pro75.50

GPQA Diamond56.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

Llama 4 Scout Instruct

1090B

MMLU Pro74.30

GPQA Diamond57.20

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench32.80

Free commercial

Llama3.1-405B Instruct

4050B

MMLU Pro73.40

GPQA Diamond49.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench30.20

Free commercial

Qwen3-235B-A22B

2350B

MMLU Pro72.90

GPQA Diamond71.10

SWE-bench Verified34.40

MATH-50098.00

AIME 202485.70

LiveCodeBench70.70

Free commercial

Gemini 2.0 Flash-Lite

MMLU Pro71.60

GPQA Diamond51.50

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench28.90

不开源

Llama 4 Maverick

4000B

MMLU Pro62.90

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

Llama3.1-405B

4050B

MMLU Pro61.60

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

Llama 4 Scout

1090B

MMLU Pro58.20

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

Mixtral-8x22B-Instruct-v0.1

1410B

MMLU Pro56.33

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

Grok-1.5

MMLU Pro51.00

GPQA Diamond35.90

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

Grok 3 mini

MMLU Pro0.00

GPQA Diamond65.00

SWE-bench Verified0.00

MATH-5000.00

AIME 202440.00

LiveCodeBench0.00

不开源

Codestral 25.01

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench37.90

不开源

GPT-4.1 mini

MMLU Pro0.00

GPQA Diamond65.00

SWE-bench Verified23.60

MATH-5000.00

AIME 202449.60

LiveCodeBench0.00

不开源

GPT-4.1 nano

MMLU Pro0.00

GPQA Diamond50.30

SWE-bench Verified0.00

MATH-5000.00

AIME 202429.40

LiveCodeBench0.00

不开源

Grok 3.5

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

Step 3.5 Flash

1960B

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified74.40

MATH-5000.00

AIME 20240.00

LiveCodeBench86.40

Free commercial

Kimi K2 0905

10000B

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified69.20

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

Qwen3-Coder-480B-A35B

4800B

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified67.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

Kimi k1.5 (Long-CoT)

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-50096.20

AIME 20240.00

LiveCodeBench0.00

不开源

Kimi k1.5 (Short-CoT)

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-50094.60

AIME 20240.00

LiveCodeBench0.00

不开源

Gemini 2.5 Pro Deep Think

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench80.40

不开源

Kimi-k1.6-IOI-high

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench73.80

不开源

OpenAI o3-mini (medium)

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench67.40

不开源

Kimi-k1.6-IOI

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench65.90

不开源

QwQ-Max-Preview

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench65.60

Free commercial

Gemini 2.5 Flash-Lite

MMLU Pro0.00

GPQA Diamond66.70

SWE-bench Verified27.60

MATH-5000.00

AIME 20240.00

LiveCodeBench34.30

不开源

Claude Sonnet 3.7

MMLU Pro0.00

GPQA Diamond68.00

SWE-bench Verified70.30

MATH-50082.20

AIME 202423.30

LiveCodeBench0.00

不开源

Magistral-Medium-2506

MMLU Pro0.00

GPQA Diamond70.83

SWE-bench Verified0.00

MATH-5000.00

AIME 202473.59

LiveCodeBench59.36

不开源

Step3

3210B

MMLU Pro0.00

GPQA Diamond73.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench67.10

Free commercial

ERNIE-4.5-VL-424B-A47B-Base

4240B

MMLU Pro0.00

GPQA Diamond76.80

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench38.80

Free commercial

OpenAI o3-mini (high)

MMLU Pro0.00

GPQA Diamond79.70

SWE-bench Verified49.30

MATH-50097.90

AIME 202487.00

LiveCodeBench69.50

不开源

Grok 3

MMLU Pro0.00

GPQA Diamond80.40

SWE-bench Verified0.00

MATH-5000.00

AIME 202484.20

LiveCodeBench70.60

不开源

DeepSeek V3.2

6710B

MMLU Pro0.00

GPQA Diamond82.40

SWE-bench Verified73.10

MATH-5000.00

AIME 20240.00

LiveCodeBench83.30

Free commercial

Gemini 2.5 Flash

MMLU Pro0.00

GPQA Diamond82.80

SWE-bench Verified50.00

MATH-5000.00

AIME 202488.00

LiveCodeBench55.40

不开源

Gemini-2.5-Pro-Preview-05-06

MMLU Pro0.00

GPQA Diamond83.00

SWE-bench Verified63.20

MATH-50098.80

AIME 202492.00

LiveCodeBench77.10

不开源

o3-pro

MMLU Pro0.00

GPQA Diamond84.00

SWE-bench Verified75.00

MATH-5000.00

AIME 202493.00

LiveCodeBench0.00

不开源

Grok-3 mini - Reasoning

MMLU Pro0.00

GPQA Diamond84.00

SWE-bench Verified0.00

MATH-5000.00

AIME 202496.00

LiveCodeBench0.00

不开源

Grok-3 - Reasoning Beta

MMLU Pro0.00

GPQA Diamond84.60

SWE-bench Verified0.00

MATH-5000.00

AIME 202493.30

LiveCodeBench79.40

不开源

Claude Sonnet 3.7-64K Extended Thinking

MMLU Pro0.00

GPQA Diamond84.80

SWE-bench Verified0.00

MATH-50096.20

AIME 202480.00

LiveCodeBench0.00

不开源

Amazon Nova Pro

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

加载中...

LLM Benchmark Performance Comparison

Detailed benchmark descriptions available at:LLM Benchmark List & Guide

Updated on: 2025/11/08 22:10:24

Benchmark switcher

Pick the leaderboard to sync both chart and table

MMLU Pro GPQA Diamond SWE-bench Verified MATH-500 AIME 2024 LiveCodeBench

Filters

Active

Filter by parameter size

All 3B and below 7B 13B 34B 65B 100B and above

Filter by model type

All Reasoning Models Foundation Models Instruction/Chat Models Coding Models

LLM Performance Results

Data source: DataLearnerAI

LLM Performance Results

Data source: DataLearnerAI

MATH-500

Rank	Model	MMLU Pro	GPQA Diamond	SWE-bench Verified	MATH-500	AIME 2024	LiveCodeBench	Params (B)	License
1	OpenAI o1	91.04	77.30	48.90	96.40	79.20	71.00	—	不开源
2	M2.1	88.00	81.00	74.00	0.00	0.00	0.00	2300B	Free commercial
3	GPT-4.5	86.10	71.40	38.00	90.70	36.70	46.40	—	不开源
4	Qwen3-Max-Thinking	85.70	87.40	75.30	0.00	0.00	85.90	10000B	不开源
5	DeepSeek-R1-0528	85.00	81.00	57.60	98.00	91.40	73.30	6710B	Free commercial
6	DeepSeek-V3.1	85.00	80.10	66.00	0.00	93.10	74.80	6710B	Free commercial
7	DeepSeek-V3.1 Terminus	85.00	80.70	68.40	0.00	0.00	80.00	6710B	Free commercial
8	DeepSeek V3.2-Exp	85.00	79.90	67.80	0.00	0.00	74.10	6710B	Free commercial
9	Claude Opus 4	85.00	79.60	72.50	98.20	76.00	56.60	—	不开源
10	GLM-4.5	84.60	79.10	64.20	98.20	91.00	72.90	3550B	Free commercial
11	Kimi K2 Thinking	84.60	84.50	71.30	0.00	0.00	83.10	10400B	Free commercial
12	Qwen3-235B-A22B-Thinking-2507	84.40	81.10	0.00	0.00	0.00	74.10	2350B	Free commercial
13	GLM-4.7	84.30	85.70	73.80	0.00	0.00	84.90	3580B	Free commercial
14	DeepSeek-R1	84.00	71.50	49.20	97.30	79.80	65.90	6710B	Free commercial
15	Intern-S1	83.50	77.30	0.00	0.00	0.00	0.00	2410B	Free commercial
16	Qwen3-235B-A22B-2507	83.00	77.50	0.00	0.00	0.00	51.80	2350B	Free commercial
17	GLM-4.6	83.00	82.90	68.00	0.00	0.00	84.50	3550B	Free commercial
18	Llama 4 Behemoth Instruct	82.20	73.70	0.00	95.00	0.00	49.40	20000B	Free commercial
19	MiniMax M2	82.00	78.00	69.40	0.00	0.00	83.00	2300B	Free commercial
20	GLM-4.5-Air	81.40	75.00	57.60	98.10	89.40	70.70	1060B	Free commercial
21	DeepSeek-V3-0324	81.20	68.40	38.80	94.00	59.40	49.20	6710B	Free commercial
22	Kimi K2	81.10	75.10	51.80	97.40	69.60	53.70	10000B	Free commercial
23	MiniMax-M1-80k	81.10	70.00	56.00	96.80	86.00	65.00	4560B	Free commercial
24	OpenAI o4 - mini	80.60	81.40	68.10	0.00	98.70	0.00	—	不开源
25	MiniMax-M1-40k	80.60	69.20	55.60	96.00	83.30	62.30	4560B	Free commercial
26	Llama 4 Maverick Instruct	80.50	69.80	0.00	0.00	0.00	43.40	4000B	Free commercial
27	GPT-4.1	80.50	66.30	54.60	92.80	48.10	40.50	—	不开源
28	OpenAI o1-mini	80.30	60.00	0.00	90.00	63.60	52.00	—	不开源
29	Gemini 2.0 Pro Experimental	79.10	64.70	0.00	0.00	36.00	0.00	—	不开源
30	Hunyuan-TurboS	79.00	57.50	0.00	0.00	0.00	32.00	—	不开源
31	Kimi K2.5	78.50	87.60	76.80	0.00	0.00	85.00	10000B	Free commercial
32	ERNIE-4.5-300B-A47B	78.40	0.00	0.00	96.40	54.80	38.80	3000B	Free commercial
33	GPT-4o(2024-11-20)	77.90	0.00	0.00	0.00	0.00	0.00	—	不开源
34	Claude 3.5 Sonnet	77.64	59.40	0.00	0.00	0.00	0.00	—	不开源
35	Gemini 2.0 Flash Experimental	76.24	65.20	21.40	0.00	0.00	29.10	—	不开源
36	Qwen2.5-Max	76.10	0.00	0.00	0.00	0.00	0.00	—	不开源
37	DeepSeek-V3	75.90	59.10	0.00	87.80	39.00	34.60	6810B	Free commercial
38	Grok 2	75.50	56.00	0.00	0.00	0.00	0.00	2690B	Free commercial
39	Llama 4 Scout Instruct	74.30	57.20	0.00	0.00	0.00	32.80	1090B	Free commercial
40	Llama3.1-405B Instruct	73.40	49.00	0.00	0.00	0.00	30.20	4050B	Free commercial
41	Qwen3-235B-A22B	72.90	71.10	34.40	98.00	85.70	70.70	2350B	Free commercial
42	Gemini 2.0 Flash-Lite	71.60	51.50	0.00	0.00	0.00	28.90	—	不开源
43	Llama 4 Maverick	62.90	0.00	0.00	0.00	0.00	0.00	4000B	Free commercial
44	Llama3.1-405B	61.60	0.00	0.00	0.00	0.00	0.00	4050B	Free commercial
45	Llama 4 Scout	58.20	0.00	0.00	0.00	0.00	0.00	1090B	Free commercial
46	Mixtral-8x22B-Instruct-v0.1	56.33	0.00	0.00	0.00	0.00	0.00	1410B	Free commercial
47	Grok-1.5	51.00	35.90	0.00	0.00	0.00	0.00	—	不开源
48	Grok 3 mini	0.00	65.00	0.00	0.00	40.00	0.00	—	不开源
49	Codestral 25.01	0.00	0.00	0.00	0.00	0.00	37.90	—	不开源
50	GPT-4.1 mini	0.00	65.00	23.60	0.00	49.60	0.00	—	不开源
51	GPT-4.1 nano	0.00	50.30	0.00	0.00	29.40	0.00	—	不开源
52	Grok 3.5	0.00	0.00	0.00	0.00	0.00	0.00	—	不开源
53	Step 3.5 Flash	0.00	0.00	74.40	0.00	0.00	86.40	1960B	Free commercial
54	Kimi K2 0905	0.00	0.00	69.20	0.00	0.00	0.00	10000B	Free commercial
55	Qwen3-Coder-480B-A35B	0.00	0.00	67.00	0.00	0.00	0.00	4800B	Free commercial
56	Kimi k1.5 (Long-CoT)	0.00	0.00	0.00	96.20	0.00	0.00	—	不开源
57	Kimi k1.5 (Short-CoT)	0.00	0.00	0.00	94.60	0.00	0.00	—	不开源
58	Gemini 2.5 Pro Deep Think	0.00	0.00	0.00	0.00	0.00	80.40	—	不开源
59	Kimi-k1.6-IOI-high	0.00	0.00	0.00	0.00	0.00	73.80	—	不开源
60	OpenAI o3-mini (medium)	0.00	0.00	0.00	0.00	0.00	67.40	—	不开源
61	Kimi-k1.6-IOI	0.00	0.00	0.00	0.00	0.00	65.90	—	不开源
62	QwQ-Max-Preview	0.00	0.00	0.00	0.00	0.00	65.60	—	Free commercial
63	Gemini 2.5 Flash-Lite	0.00	66.70	27.60	0.00	0.00	34.30	—	不开源
64	Claude Sonnet 3.7	0.00	68.00	70.30	82.20	23.30	0.00	—	不开源
65	Magistral-Medium-2506	0.00	70.83	0.00	0.00	73.59	59.36	—	不开源
66	Step3	0.00	73.00	0.00	0.00	0.00	67.10	3210B	Free commercial
67	ERNIE-4.5-VL-424B-A47B-Base	0.00	76.80	0.00	0.00	0.00	38.80	4240B	Free commercial
68	OpenAI o3-mini (high)	0.00	79.70	49.30	97.90	87.00	69.50	—	不开源
69	Grok 3	0.00	80.40	0.00	0.00	84.20	70.60	—	不开源
70	DeepSeek V3.2	0.00	82.40	73.10	0.00	0.00	83.30	6710B	Free commercial
71	Gemini 2.5 Flash	0.00	82.80	50.00	0.00	88.00	55.40	—	不开源
72	Gemini-2.5-Pro-Preview-05-06	0.00	83.00	63.20	98.80	92.00	77.10	—	不开源
73	o3-pro	0.00	84.00	75.00	0.00	93.00	0.00	—	不开源
74	Grok-3 mini - Reasoning	0.00	84.00	0.00	0.00	96.00	0.00	—	不开源
75	Grok-3 - Reasoning Beta	0.00	84.60	0.00	0.00	93.30	79.40	—	不开源
76	Claude Sonnet 3.7-64K Extended Thinking	0.00	84.80	0.00	96.20	80.00	0.00	—	不开源
77	Amazon Nova Pro	0.00	0.00	0.00	0.00	0.00	0.00	—	不开源

OpenAI o1

MMLU Pro91.04

GPQA Diamond77.30

SWE-bench Verified48.90

MATH-50096.40

AIME 202479.20

LiveCodeBench71.00

不开源

M2.1

2300B

MMLU Pro88.00

GPQA Diamond81.00

SWE-bench Verified74.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

GPT-4.5

MMLU Pro86.10

GPQA Diamond71.40

SWE-bench Verified38.00

MATH-50090.70

AIME 202436.70

LiveCodeBench46.40

不开源

Qwen3-Max-Thinking

10000B

MMLU Pro85.70

GPQA Diamond87.40

SWE-bench Verified75.30

MATH-5000.00

AIME 20240.00

LiveCodeBench85.90

不开源

DeepSeek-R1-0528

6710B

MMLU Pro85.00

GPQA Diamond81.00

SWE-bench Verified57.60

MATH-50098.00

AIME 202491.40

LiveCodeBench73.30

Free commercial

DeepSeek-V3.1

6710B

MMLU Pro85.00

GPQA Diamond80.10

SWE-bench Verified66.00

MATH-5000.00

AIME 202493.10

LiveCodeBench74.80

Free commercial

DeepSeek-V3.1 Terminus

6710B

MMLU Pro85.00

GPQA Diamond80.70

SWE-bench Verified68.40

MATH-5000.00

AIME 20240.00

LiveCodeBench80.00

Free commercial

DeepSeek V3.2-Exp

6710B

MMLU Pro85.00

GPQA Diamond79.90

SWE-bench Verified67.80

MATH-5000.00

AIME 20240.00

LiveCodeBench74.10

Free commercial

Claude Opus 4

MMLU Pro85.00

GPQA Diamond79.60

SWE-bench Verified72.50

MATH-50098.20

AIME 202476.00

LiveCodeBench56.60

不开源

GLM-4.5

3550B

MMLU Pro84.60

GPQA Diamond79.10

SWE-bench Verified64.20

MATH-50098.20

AIME 202491.00

LiveCodeBench72.90

Free commercial

Kimi K2 Thinking

10400B

MMLU Pro84.60

GPQA Diamond84.50

SWE-bench Verified71.30

MATH-5000.00

AIME 20240.00

LiveCodeBench83.10

Free commercial

Qwen3-235B-A22B-Thinking-2507

2350B

MMLU Pro84.40

GPQA Diamond81.10

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench74.10

Free commercial

GLM-4.7

3580B

MMLU Pro84.30

GPQA Diamond85.70

SWE-bench Verified73.80

MATH-5000.00

AIME 20240.00

LiveCodeBench84.90

Free commercial

DeepSeek-R1

6710B

MMLU Pro84.00

GPQA Diamond71.50

SWE-bench Verified49.20

MATH-50097.30

AIME 202479.80

LiveCodeBench65.90

Free commercial

Intern-S1

2410B

MMLU Pro83.50

GPQA Diamond77.30

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

Qwen3-235B-A22B-2507

2350B

MMLU Pro83.00

GPQA Diamond77.50

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench51.80

Free commercial

GLM-4.6

3550B

MMLU Pro83.00

GPQA Diamond82.90

SWE-bench Verified68.00

MATH-5000.00

AIME 20240.00

LiveCodeBench84.50

Free commercial

Llama 4 Behemoth Instruct

20000B

MMLU Pro82.20

GPQA Diamond73.70

SWE-bench Verified0.00

MATH-50095.00

AIME 20240.00

LiveCodeBench49.40

Free commercial

MiniMax M2

2300B

MMLU Pro82.00

GPQA Diamond78.00

SWE-bench Verified69.40

MATH-5000.00

AIME 20240.00

LiveCodeBench83.00

Free commercial

GLM-4.5-Air

1060B

MMLU Pro81.40

GPQA Diamond75.00

SWE-bench Verified57.60

MATH-50098.10

AIME 202489.40

LiveCodeBench70.70

Free commercial

DeepSeek-V3-0324

6710B

MMLU Pro81.20

GPQA Diamond68.40

SWE-bench Verified38.80

MATH-50094.00

AIME 202459.40

LiveCodeBench49.20

Free commercial

Kimi K2

10000B

MMLU Pro81.10

GPQA Diamond75.10

SWE-bench Verified51.80

MATH-50097.40

AIME 202469.60

LiveCodeBench53.70

Free commercial

MiniMax-M1-80k

4560B

MMLU Pro81.10

GPQA Diamond70.00

SWE-bench Verified56.00

MATH-50096.80

AIME 202486.00

LiveCodeBench65.00

Free commercial

OpenAI o4 - mini

MMLU Pro80.60

GPQA Diamond81.40

SWE-bench Verified68.10

MATH-5000.00

AIME 202498.70

LiveCodeBench0.00

不开源

MiniMax-M1-40k

4560B

MMLU Pro80.60

GPQA Diamond69.20

SWE-bench Verified55.60

MATH-50096.00

AIME 202483.30

LiveCodeBench62.30

Free commercial

Llama 4 Maverick Instruct

4000B

MMLU Pro80.50

GPQA Diamond69.80

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench43.40

Free commercial

GPT-4.1

MMLU Pro80.50

GPQA Diamond66.30

SWE-bench Verified54.60

MATH-50092.80

AIME 202448.10

LiveCodeBench40.50

不开源

OpenAI o1-mini

MMLU Pro80.30

GPQA Diamond60.00

SWE-bench Verified0.00

MATH-50090.00

AIME 202463.60

LiveCodeBench52.00

不开源

Gemini 2.0 Pro Experimental

MMLU Pro79.10

GPQA Diamond64.70

SWE-bench Verified0.00

MATH-5000.00

AIME 202436.00

LiveCodeBench0.00

不开源

Hunyuan-TurboS

MMLU Pro79.00

GPQA Diamond57.50

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench32.00

不开源

Kimi K2.5

10000B

MMLU Pro78.50

GPQA Diamond87.60

SWE-bench Verified76.80

MATH-5000.00

AIME 20240.00

LiveCodeBench85.00

Free commercial

ERNIE-4.5-300B-A47B

3000B

MMLU Pro78.40

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-50096.40

AIME 202454.80

LiveCodeBench38.80

Free commercial

GPT-4o(2024-11-20)

MMLU Pro77.90

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

Claude 3.5 Sonnet

MMLU Pro77.64

GPQA Diamond59.40

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

Gemini 2.0 Flash Experimental

MMLU Pro76.24

GPQA Diamond65.20

SWE-bench Verified21.40

MATH-5000.00

AIME 20240.00

LiveCodeBench29.10

不开源

Qwen2.5-Max

MMLU Pro76.10

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

DeepSeek-V3

6810B

MMLU Pro75.90

GPQA Diamond59.10

SWE-bench Verified0.00

MATH-50087.80

AIME 202439.00

LiveCodeBench34.60

Free commercial

Grok 2

2690B

MMLU Pro75.50

GPQA Diamond56.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

Llama 4 Scout Instruct

1090B

MMLU Pro74.30

GPQA Diamond57.20

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench32.80

Free commercial

Llama3.1-405B Instruct

4050B

MMLU Pro73.40

GPQA Diamond49.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench30.20

Free commercial

Qwen3-235B-A22B

2350B

MMLU Pro72.90

GPQA Diamond71.10

SWE-bench Verified34.40

MATH-50098.00

AIME 202485.70

LiveCodeBench70.70

Free commercial

Gemini 2.0 Flash-Lite

MMLU Pro71.60

GPQA Diamond51.50

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench28.90

不开源

Llama 4 Maverick

4000B

MMLU Pro62.90

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

Llama3.1-405B

4050B

MMLU Pro61.60

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

Llama 4 Scout

1090B

MMLU Pro58.20

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

Mixtral-8x22B-Instruct-v0.1

1410B

MMLU Pro56.33

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

Grok-1.5

MMLU Pro51.00

GPQA Diamond35.90

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

Grok 3 mini

MMLU Pro0.00

GPQA Diamond65.00

SWE-bench Verified0.00

MATH-5000.00

AIME 202440.00

LiveCodeBench0.00

不开源

Codestral 25.01

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench37.90

不开源

GPT-4.1 mini

MMLU Pro0.00

GPQA Diamond65.00

SWE-bench Verified23.60

MATH-5000.00

AIME 202449.60

LiveCodeBench0.00

不开源

GPT-4.1 nano

MMLU Pro0.00

GPQA Diamond50.30

SWE-bench Verified0.00

MATH-5000.00

AIME 202429.40

LiveCodeBench0.00

不开源

Grok 3.5

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

Step 3.5 Flash

1960B

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified74.40

MATH-5000.00

AIME 20240.00

LiveCodeBench86.40

Free commercial

Kimi K2 0905

10000B

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified69.20

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

Qwen3-Coder-480B-A35B

4800B

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified67.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

Kimi k1.5 (Long-CoT)

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-50096.20

AIME 20240.00

LiveCodeBench0.00

不开源

Kimi k1.5 (Short-CoT)

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-50094.60

AIME 20240.00

LiveCodeBench0.00

不开源

Gemini 2.5 Pro Deep Think

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench80.40

不开源

Kimi-k1.6-IOI-high

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench73.80

不开源

OpenAI o3-mini (medium)

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench67.40

不开源

Kimi-k1.6-IOI

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench65.90

不开源

QwQ-Max-Preview

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench65.60

Free commercial

Gemini 2.5 Flash-Lite

MMLU Pro0.00

GPQA Diamond66.70

SWE-bench Verified27.60

MATH-5000.00

AIME 20240.00

LiveCodeBench34.30

不开源

Claude Sonnet 3.7

MMLU Pro0.00

GPQA Diamond68.00

SWE-bench Verified70.30

MATH-50082.20

AIME 202423.30

LiveCodeBench0.00

不开源

Magistral-Medium-2506

MMLU Pro0.00

GPQA Diamond70.83

SWE-bench Verified0.00

MATH-5000.00

AIME 202473.59

LiveCodeBench59.36

不开源

Step3

3210B

MMLU Pro0.00

GPQA Diamond73.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench67.10

Free commercial

ERNIE-4.5-VL-424B-A47B-Base

4240B

MMLU Pro0.00

GPQA Diamond76.80

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench38.80

Free commercial

OpenAI o3-mini (high)

MMLU Pro0.00

GPQA Diamond79.70

SWE-bench Verified49.30

MATH-50097.90

AIME 202487.00

LiveCodeBench69.50

不开源

Grok 3

MMLU Pro0.00

GPQA Diamond80.40

SWE-bench Verified0.00

MATH-5000.00

AIME 202484.20

LiveCodeBench70.60

不开源

DeepSeek V3.2

6710B

MMLU Pro0.00

GPQA Diamond82.40

SWE-bench Verified73.10

MATH-5000.00

AIME 20240.00

LiveCodeBench83.30

Free commercial

Gemini 2.5 Flash

MMLU Pro0.00

GPQA Diamond82.80

SWE-bench Verified50.00

MATH-5000.00

AIME 202488.00

LiveCodeBench55.40

不开源

Gemini-2.5-Pro-Preview-05-06

MMLU Pro0.00

GPQA Diamond83.00

SWE-bench Verified63.20

MATH-50098.80

AIME 202492.00

LiveCodeBench77.10

不开源

o3-pro

MMLU Pro0.00

GPQA Diamond84.00

SWE-bench Verified75.00

MATH-5000.00

AIME 202493.00

LiveCodeBench0.00

不开源

Grok-3 mini - Reasoning

MMLU Pro0.00

GPQA Diamond84.00

SWE-bench Verified0.00

MATH-5000.00

AIME 202496.00

LiveCodeBench0.00

不开源

Grok-3 - Reasoning Beta

MMLU Pro0.00

GPQA Diamond84.60

SWE-bench Verified0.00

MATH-5000.00

AIME 202493.30

LiveCodeBench79.40

不开源

Claude Sonnet 3.7-64K Extended Thinking

MMLU Pro0.00

GPQA Diamond84.80

SWE-bench Verified0.00

MATH-50096.20

AIME 202480.00

LiveCodeBench0.00

不开源

Amazon Nova Pro

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源