加载中...

LLM Benchmark Performance Comparison

Quickly view LLM performance across benchmarks like MMLU Pro, HLE, SWE-Bench, and more. Compare models across general knowledge, coding, and reasoning capabilities. Customize your comparison by selecting specific models and benchmarks.

Detailed benchmark descriptions available at:LLM Benchmark List & Guide

Updated on: 2025/11/08 22:10:24

Benchmark switcher

Pick the leaderboard to sync both chart and table

MMLU Pro GPQA Diamond SWE-bench Verified MATH-500 AIME 2024 LiveCodeBench

Filters

Filter by parameter size

All 3B and below 7B 13B 34B 65B 100B and above

Filter by model type

All Reasoning Models Foundation Models Instruction/Chat Models Coding Models

LLM Performance Results

Data source: DataLearnerAI

LLM Performance Results

Data source: DataLearnerAI

MMLU Pro

Rank	Model	MMLU Pro	GPQA Diamond	SWE-bench Verified	MATH-500	AIME 2024	LiveCodeBench	Params (B)	License
1	OpenAI o1	91.04	77.30	48.90	96.40	79.20	71.00	—	不开源
2	Gemini 3.0 Pro (Preview 11-2025)	90.00	91.90	76.20	0.00	0.00	92.00	—	不开源
3	Claude Opus 4.5	90.00	87.00	80.90	0.00	0.00	0.00	—	不开源
4	Claude Opus 4.1	88.00	81.00	74.50	0.00	0.00	0.00	—	不开源
5	M2.1	88.00	81.00	74.00	0.00	0.00	0.00	2300B	Free commercial
6	Claude Sonnet 4.5	88.00	83.40	0.00	0.00	0.00	71.00	—	不开源
7	Hunyuan-T1	87.20	69.30	0.00	96.20	78.20	64.90	—	不开源
8	Grok 4	87.00	87.00	58.60	0.00	0.00	82.00	—	不开源
9	GPT-4.5	86.10	71.40	38.00	90.70	36.70	46.40	—	不开源
10	Gemini 2.5-Pro	86.00	0.00	0.00	98.80	92.00	77.10	—	不开源
11	Qwen3-Max-Thinking	85.70	87.40	75.30	0.00	0.00	85.90	10000B	不开源
12	OpenAI o3	85.60	0.00	0.00	98.10	91.60	75.80	—	不开源
13	DeepSeek V3.2-Exp	85.00	79.90	0.00	0.00	0.00	74.10	6710B	Free commercial
14	Grok 4.1 Fast	85.00	85.00	0.00	0.00	0.00	82.00	—	不开源
15	DeepSeek-V3.1 Terminus	85.00	80.70	68.40	0.00	0.00	74.90	6710B	Free commercial
16	DeepSeek-V3.1 Terminus	85.00	79.00	0.00	0.00	0.00	80.00	6710B	Free commercial
17	DeepSeek-V3.1	85.00	80.10	0.00	0.00	93.10	74.80	6710B	Free commercial
18	DeepSeek-R1-0528	85.00	81.00	57.60	98.00	91.40	73.30	6710B	Free commercial
19	Claude Opus 4	85.00	79.60	72.50	98.20	76.00	56.60	—	不开源
20	GLM-4.5	84.60	79.10	64.20	98.20	91.00	72.90	3550B	Free commercial
21	Kimi K2 Thinking	84.60	84.50	0.00	0.00	0.00	83.10	10400B	Free commercial
22	Qwen3-235B-A22B-Thinking-2507	84.40	81.10	0.00	0.00	0.00	74.10	2350B	Free commercial
23	Qwen3-235B-A22B-Thinking	84.40	81.10	0.00	0.00	0.00	74.10	305B	Free commercial
24	GLM-4.7	84.30	85.70	0.00	0.00	0.00	84.90	3580B	Free commercial
25	DeepSeek-R1	84.00	71.50	49.20	97.30	79.80	65.90	6710B	Free commercial
26	Claude Sonnet 4	84.00	75.40	0.00	0.00	0.00	66.00	—	不开源
27	Qwen3 Max (Preview)	84.00	76.00	69.60	0.00	0.00	57.50	—	不开源
28	DeepSeek V3.2-Exp	84.00	74.00	0.00	0.00	0.00	55.00	6710B	Free commercial
29	DeepSeek-V3.1	83.70	74.90	66.00	0.00	66.30	56.40	6710B	Free commercial
30	Intern-S1	83.50	77.30	0.00	0.00	0.00	0.00	2410B	Free commercial
31	Qwen3-235B-A22B-2507	83.00	77.50	0.00	0.00	0.00	51.80	2350B	Free commercial
32	GLM-4.6	83.00	81.00	0.00	0.00	0.00	82.80	3550B	Free commercial
33	Pangu Pro MoE	82.60	73.70	0.00	96.80	79.20	59.60	719B	Free commercial
34	Llama 4 Behemoth Instruct	82.20	73.70	0.00	95.00	0.00	49.40	20000B	Free commercial
35	MiniMax M2	82.00	78.00	0.00	0.00	0.00	83.00	2300B	Free commercial
36	GLM-4.5-Air	81.40	75.00	57.60	98.10	89.40	70.70	1060B	Free commercial
37	DeepSeek-V3-0324	81.20	68.40	38.80	94.00	59.40	49.20	6710B	Free commercial
38	MiniMax-M1-80k	81.10	70.00	56.00	96.80	86.00	65.00	4560B	Free commercial
39	Kimi K2	81.10	75.10	51.80	97.40	69.60	53.70	10000B	Free commercial
40	OpenAI o4 - mini	80.60	81.40	68.10	0.00	93.40	0.00	—	不开源
41	MiniMax-M1-40k	80.60	69.20	55.60	96.00	83.30	62.30	4560B	Free commercial
42	GPT-4.1	80.50	66.30	54.60	92.80	48.10	40.50	—	不开源
43	Llama 4 Maverick Instruct	80.50	69.80	0.00	0.00	0.00	43.40	4000B	Free commercial
44	OpenAI o1-mini	80.30	60.00	0.00	90.00	63.60	52.00	—	不开源
45	Haiku 4.5	80.00	60.50	60.60	0.00	0.00	51.00	—	不开源
46	GPT-4o(2025-03-27)	79.80	66.90	0.00	0.00	0.00	35.80	—	不开源
47	Gemini 2.0 Pro Experimental	79.10	64.70	0.00	0.00	36.00	0.00	—	不开源
48	Hunyuan-TurboS	79.00	57.50	0.00	0.00	0.00	32.00	—	不开源
49	Pangu Embedded	79.00	0.00	0.00	92.40	81.90	67.10	70B	Free commercial
50	GPT OSS 120B	79.00	80.10	60.10	0.00	0.00	0.00	117B	Free commercial
51	Kimi K2.5	78.50	87.60	76.80	0.00	0.00	85.00	10000B	Free commercial
52	ERNIE-4.5-300B-A47B	78.40	0.00	0.00	96.40	54.80	38.80	3000B	Free commercial
53	Qwen3-30B-A3B-2507	78.40	70.40	0.00	0.00	0.00	43.20	305B	Free commercial
54	Claude 3.5 Sonnet New	78.00	65.00	49.00	78.00	16.00	38.70	—	不开源
55	GLM-4.6	78.00	63.00	68.00	0.00	0.00	56.00	3550B	Free commercial
56	GPT-5-mini	78.00	69.00	0.00	0.00	0.00	55.00	—	不开源
57	GPT-4o	77.90	70.10	31.00	75.90	9.30	35.10	—	不开源
58	GPT-4o(2024-11-20)	77.90	0.00	0.00	0.00	0.00	0.00	—	不开源
59	Claude 3.5 Sonnet	77.64	59.40	0.00	0.00	0.00	0.00	—	不开源
60	Gemini 2.0 Flash Experimental	76.24	65.20	21.40	0.00	0.00	29.10	—	不开源
61	Gemini 1.5 Pro	76.10	53.50	0.00	0.00	0.00	0.00	—	不开源
62	Qwen2.5-Max	76.10	0.00	0.00	0.00	0.00	0.00	—	不开源
63	QwQ-32B	76.00	58.00	0.00	91.00	79.50	0.00	325B	Free commercial
64	Haiku 4.5	76.00	73.30	0.00	0.00	0.00	62.00	—	不开源
65	DeepSeek-V3	75.90	59.10	0.00	87.80	39.00	34.60	6810B	Free commercial
66	Grok 2	75.50	56.00	0.00	0.00	0.00	0.00	2690B	Free commercial
67	Llama 4 Scout Instruct	74.30	57.20	0.00	0.00	0.00	32.80	1090B	Free commercial
68	GPT OSS 20B	74.00	71.50	34.00	0.00	0.00	0.00	210B	Free commercial
69	Llama3.1-405B Instruct	73.40	49.00	0.00	0.00	0.00	30.20	4050B	Free commercial
70	Qwen3-235B-A22B	72.90	71.10	34.40	96.20	85.70	70.70	2350B	Free commercial
71	Qwen3-8B	72.50	39.30	0.00	87.40	79.40	61.80	80B	Free commercial
72	GLM-4-9B-Chat	72.40	0.00	0.00	0.00	76.40	51.80	90B	Free commercial
73	Gemini 2.0 Flash-Lite	71.60	51.50	0.00	0.00	0.00	28.90	—	不开源
74	QwQ-32B-Preview	70.97	0.00	0.00	90.60	50.00	0.00	320B	Free commercial
75	Phi 4 - 14B	70.40	0.00	0.00	0.00	0.00	0.00	140B	Non-commercial
76	Qwen2.5-32B	69.23	0.00	0.00	0.00	0.00	51.20	320B	Free commercial
77	Qwen3-30B-A3B	69.10	54.80	0.00	0.00	0.00	29.00	305B	Free commercial
78	Mistral-Small-3.2	69.06	46.13	0.00	0.00	0.00	0.00	240B	Free commercial
79	Llama3.3-70B-Instruct	68.90	50.50	0.00	0.00	0.00	33.30	700B	Free commercial
80	Claude3-Opus	68.45	50.40	0.00	0.00	0.00	0.00	—	不开源
81	Gemma 3 - 27B (IT)	67.50	42.40	0.00	0.00	25.30	29.70	270B	Free commercial
82	Hunyuan-A13B-Instruct	67.23	71.20	0.00	0.00	87.30	63.90	800B	Free commercial
83	Mistral-Small-3.1-24B-Instruct-2503	66.76	45.96	0.00	0.00	0.00	0.00	240B	Free commercial
84	Llama3.1-70B-Instruct	66.40	48.00	0.00	0.00	0.00	33.30	700B	Free commercial
85	Qwen3-Next	66.05	0.00	0.00	0.00	0.00	56.60	800B	Free commercial
86	Claude 3.5 Haiku	65.00	41.60	0.00	0.00	0.00	0.00	—	不开源
87	Qwen2.5-14B	63.69	0.00	0.00	0.00	0.00	0.00	140B	Free commercial
88	Llama 4 Maverick	62.90	0.00	0.00	0.00	0.00	0.00	4000B	Free commercial
89	GPT-4o mini	61.70	41.10	0.00	0.00	0.00	0.00	—	不开源
90	Llama3.1-405B	61.60	0.00	0.00	0.00	0.00	0.00	4050B	Free commercial
91	Gemma 3 - 12B (IT)	60.60	40.90	0.00	0.00	0.00	24.60	120B	Free commercial
92	Llama 4 Scout	58.20	0.00	0.00	0.00	0.00	0.00	1090B	Free commercial
93	Qwen2.5-72B	58.10	45.90	0.00	0.00	0.00	0.00	727B	Free commercial
94	Claude3-Sonnet	56.80	0.00	0.00	0.00	0.00	0.00	—	不开源
95	Gemma2-27B	56.54	0.00	0.00	0.00	0.00	0.00	270B	Free commercial
96	Mixtral-8x22B-Instruct-v0.1	56.33	0.00	0.00	0.00	0.00	0.00	1410B	Free commercial
97	Llama3-70B-Instruct	56.20	0.00	0.00	0.00	0.00	0.00	700B	Free commercial
98	Phi-4-mini-instruct (3.8B)	52.80	36.00	0.00	71.80	10.00	0.00	38B	Free commercial
99	Llama3-70B	52.78	0.00	0.00	0.00	0.00	0.00	700B	Free commercial
100	Llama3.1-70B	52.47	0.00	0.00	0.00	0.00	0.00	700B	Free commercial
101	Grok-1.5	51.00	35.90	0.00	0.00	0.00	0.00	—	不开源
102	C4AI Aya Vision 32B	47.16	33.84	0.00	0.00	0.00	0.00	320B	Non-commercial
103	Qwen2.5-7B	45.00	36.40	0.00	0.00	0.00	0.00	70B	Free commercial
104	Gemma 2 - 9B	44.70	32.80	0.00	0.00	0.00	0.00	90B	Free commercial
105	Llama3.1-8B-Instruct	44.00	26.30	0.00	0.00	0.00	0.00	80B	Free commercial
106	Moonlight-16B-A3B-Instruct	42.40	0.00	0.00	0.00	0.00	0.00	160B	Free commercial
107	Llama3.1-8B	35.40	25.80	0.00	0.00	0.00	0.00	80B	Free commercial
108	Qwen2.5-3B	34.60	24.30	0.00	0.00	0.00	0.00	30B	Free commercial
109	Mistral-7B-Instruct-v0.3	30.90	24.70	0.00	0.00	0.00	0.00	70B	Free commercial
110	Llama-3.2-3B	25.00	26.60	0.00	0.00	0.00	0.00	32B	Free commercial
111	o3-pro	0.00	0.00	75.00	0.00	0.00	0.00	—	不开源
112	GPT-5.1 Codex	0.00	0.00	70.40	0.00	0.00	85.50	—	不开源
113	GPT-5 Codex	0.00	0.00	74.50	0.00	0.00	0.00	—	不开源
114	StepFun Flash 3.5	0.00	0.00	74.40	0.00	0.00	86.40	1960B	Free commercial
115	GLM-4.7	0.00	0.00	73.80	0.00	0.00	0.00	3580B	Free commercial
116	Grok 4 Heavy	0.00	0.00	73.50	0.00	0.00	0.00	—	不开源
117	Haiku 4.5	0.00	0.00	73.30	0.00	0.00	0.00	—	不开源
118	DeepSeek V3.2	0.00	0.00	73.10	0.00	0.00	0.00	6710B	Free commercial
119	Claude Sonnet 4	0.00	0.00	72.70	0.00	0.00	0.00	—	不开源
120	Grok 4 Code	0.00	0.00	72.00	0.00	0.00	0.00	—	不开源
121	Kimi K2 Thinking	0.00	0.00	71.30	0.00	0.00	0.00	10400B	Free commercial
122	Grok Code Fast 1	0.00	0.00	70.80	0.00	0.00	0.00	—	不开源
123	Hunyuan-7B	0.00	60.10	0.00	93.70	81.10	57.00	70B	Free commercial
124	GPT-5.1-Codex-Max	0.00	0.00	76.80	0.00	0.00	0.00	—	不开源
125	Claude Sonnet 4.5	0.00	0.00	77.20	0.00	0.00	0.00	—	不开源
126	Claude Opus 4.1	0.00	0.00	79.40	0.00	0.00	0.00	—	不开源
127	Claude Sonnet 4	0.00	0.00	80.20	0.00	0.00	0.00	—	不开源
128	Claude Sonnet 4.5	0.00	0.00	82.00	0.00	0.00	0.00	—	不开源
129	GPT-5-mini	0.00	0.00	0.00	0.00	0.00	0.00	—	不开源
130	Grok 3.5	0.00	0.00	0.00	0.00	0.00	0.00	—	不开源
131	Phi-4-instruct (reasoning-trained)	0.00	49.00	0.00	90.40	50.00	0.00	38B	不开源
132	DeepSeek-R1-Distill-Qwen-7B	0.00	49.50	0.00	91.40	53.30	0.00	70B	Free commercial
133	GPT-4.1 nano	0.00	50.30	0.00	0.00	29.40	0.00	—	不开源
134	Qwen3-32B	0.00	53.30	0.00	0.00	81.40	65.70	320B	Free commercial
135	Codestral	0.00	0.00	0.00	0.00	0.00	31.50	220B	Non-commercial
136	Kimi k1.5 (Short-CoT)	0.00	0.00	0.00	94.60	0.00	0.00	—	不开源
137	Codestral 25.01	0.00	0.00	0.00	0.00	0.00	37.90	—	不开源
138	QwQ-Max-Preview	0.00	0.00	0.00	0.00	0.00	65.60	—	Free commercial
139	Kimi-k1.6-IOI	0.00	0.00	0.00	0.00	0.00	65.90	—	不开源
140	OpenAI o3-mini (medium)	0.00	0.00	0.00	0.00	0.00	67.40	—	不开源
141	Kimi-k1.6-IOI-high	0.00	0.00	0.00	0.00	0.00	73.80	—	不开源
142	Gemini 2.5 Pro Deep Think	0.00	0.00	0.00	0.00	0.00	80.40	—	不开源
143	Claude Opus 4.5	0.00	0.00	0.00	0.00	0.00	87.00	—	不开源
144	Gemini 2.5 Deep Think	0.00	0.00	0.00	0.00	0.00	87.60	—	不开源
145	GPT OSS 20B	0.00	0.00	0.00	0.00	96.00	0.00	210B	Free commercial
146	GPT OSS 120B	0.00	0.00	0.00	0.00	96.60	0.00	117B	Free commercial
147	OpenAI o4 - mini	0.00	0.00	0.00	0.00	98.70	0.00	—	不开源
148	MiniMax M2	0.00	0.00	69.40	0.00	0.00	0.00	2300B	Free commercial
149	Kimi k1.5 (Long-CoT)	0.00	0.00	0.00	96.20	0.00	0.00	—	不开源
150	Qwen3-30B-A3B-2507	0.00	0.00	22.00	0.00	0.00	0.00	305B	Free commercial
151	Devstral Small 1.0	0.00	0.00	46.80	0.00	0.00	0.00	240B	Free commercial
152	Qwen3-Coder-Flash	0.00	0.00	51.60	0.00	0.00	0.00	305B	Free commercial
153	Devstral Small 1.1	0.00	0.00	53.60	0.00	0.00	0.00	240B	Free commercial
154	Gemini 2.5 Flash-Preview-09-2025	0.00	0.00	54.00	0.00	0.00	0.00	—	不开源
155	Devstral Medium	0.00	0.00	61.60	0.00	0.00	0.00	—	不开源
156	Qwen3-Coder-480B-A35B	0.00	0.00	67.00	0.00	0.00	0.00	4800B	Free commercial
157	DeepSeek V3.2-Exp	0.00	0.00	67.80	0.00	0.00	0.00	6710B	Free commercial
158	Kimi K2 0905	0.00	0.00	69.20	0.00	0.00	0.00	10000B	Free commercial
159	Kimi K2 0905	0.00	0.00	69.20	0.00	0.00	0.00	10000B	Free commercial
160	Gemini 2.5-Pro	0.00	86.40	67.20	0.00	0.00	0.00	—	不开源
161	Gemini 2.5 Flash	0.00	82.80	48.90	0.00	0.00	55.40	—	不开源
162	GLM-4.6	0.00	82.90	68.00	0.00	0.00	84.50	3550B	Free commercial
163	Gemini-2.5-Pro-Preview-05-06	0.00	83.00	63.20	98.80	92.00	77.10	—	不开源
164	OpenAI o3	0.00	83.30	69.10	0.00	0.00	0.00	—	不开源
165	Claude Sonnet 4	0.00	83.80	0.00	0.00	0.00	0.00	—	不开源
166	o3-pro	0.00	84.00	0.00	0.00	93.00	0.00	—	不开源
167	Gemini 2.5 Pro Experimental 03-25	0.00	84.00	63.80	0.00	92.00	70.40	—	不开源
168	Grok-3 mini - Reasoning	0.00	84.00	0.00	0.00	96.00	0.00	—	不开源
169	Grok-3 - Reasoning Beta	0.00	84.60	0.00	0.00	93.30	79.40	—	不开源
170	Claude Sonnet 3.7-64K Extended Thinking	0.00	84.80	0.00	96.20	80.00	0.00	—	不开源
171	Grok 4 Fast	0.00	85.70	0.00	0.00	0.00	80.00	—	不开源
172	GPT-5	0.00	85.70	72.80	0.00	0.00	0.00	—	不开源
173	DeepSeek V3.2	0.00	82.40	0.00	0.00	0.00	83.30	6710B	Free commercial
174	GPT-5	0.00	87.30	0.00	0.00	0.00	0.00	—	不开源
175	GPT-5.1	0.00	88.10	76.30	0.00	0.00	0.00	—	不开源
176	GPT-5.1	0.00	88.10	0.00	0.00	0.00	0.00	—	不开源
177	GPT-5-Pro	0.00	88.40	0.00	0.00	0.00	0.00	—	不开源
178	Grok 4 Heavy	0.00	88.90	0.00	0.00	0.00	0.00	—	不开源
179	GPT-5-Pro	0.00	89.40	0.00	0.00	0.00	0.00	—	不开源
180	Gemini 3.0 Flash	0.00	90.40	68.70	0.00	0.00	0.00	—	不开源
181	GPT-5.2	0.00	92.40	80.00	0.00	0.00	0.00	—	不开源
182	GPT-5.2 Pro	0.00	93.20	0.00	0.00	0.00	0.00	—	不开源
183	Gemini 3.0 Pro (Preview 11-2025)	0.00	93.80	0.00	0.00	0.00	0.00	—	不开源
184	Amazon Nova Pro	0.00	0.00	0.00	0.00	0.00	0.00	—	不开源
185	OpenAI o3-mini	0.00	70.60	40.80	95.80	60.00	0.00	—	不开源
186	Qwen3-8B	0.00	62.00	0.00	97.40	76.00	57.50	80B	Free commercial
187	GPT-4.1 mini	0.00	65.00	23.60	0.00	49.60	0.00	—	不开源
188	Grok 3 mini	0.00	65.00	0.00	0.00	40.00	0.00	—	不开源
189	DeepSeek-R1-Distill-Llama-70B	0.00	65.20	0.00	94.50	0.00	0.00	700B	Free commercial
190	Qwen3-4B-Thinking-2507	0.00	65.80	0.00	0.00	0.00	55.20	40B	Free commercial
191	GLM-4.7-Flash	0.00	66.00	0.00	0.00	0.00	0.00	310B	Free commercial
192	Gemini 2.5 Flash-Lite	0.00	66.70	27.60	0.00	0.00	34.30	—	不开源
193	Claude Sonnet 4	0.00	68.00	0.00	0.00	43.40	48.50	—	不开源
194	Claude Sonnet 3.7	0.00	68.00	70.30	82.20	23.30	0.00	—	不开源
195	Magistral-Small-2506	0.00	68.18	0.00	0.00	70.68	55.84	240B	Free commercial
196	Qwen3-32B	0.00	68.40	0.00	97.20	81.40	0.00	320B	Free commercial
197	Qwen3-4B-2507	0.00	62.00	0.00	0.00	0.00	35.10	40B	Free commercial
198	Magistral-Medium-2506	0.00	70.83	0.00	0.00	73.59	59.36	—	不开源
199	Qwen3-235B-A22B	0.00	71.10	0.00	98.00	85.70	70.70	2350B	Free commercial
200	Step3	0.00	73.00	0.00	0.00	0.00	67.10	3210B	Free commercial
201	Claude Sonnet 4.5	0.00	73.70	64.80	0.00	0.00	59.00	—	不开源
202	GLM-4.7-Flash	0.00	75.20	59.20	0.00	0.00	0.00	310B	Free commercial
203	ERNIE-4.5-VL-424B-A47B-Base	0.00	76.80	0.00	0.00	0.00	38.80	4240B	Free commercial
204	GPT-5	0.00	77.80	0.00	0.00	0.00	0.00	—	不开源
205	Gemini 2.5 Flash	0.00	78.30	50.00	0.00	88.00	41.10	—	不开源
206	OpenAI o3-mini (high)	0.00	79.70	49.30	97.90	87.00	69.50	—	不开源
207	Grok 3	0.00	80.40	0.00	0.00	84.20	70.60	—	不开源
208	Claude Opus 4.1	0.00	80.90	74.50	0.00	0.00	65.00	—	不开源

OpenAI o1

MMLU Pro91.04

GPQA Diamond77.30

SWE-bench Verified48.90

MATH-50096.40

AIME 202479.20

LiveCodeBench71.00

不开源

Gemini 3.0 Pro (Preview 11-2025)

MMLU Pro90.00

GPQA Diamond91.90

SWE-bench Verified76.20

MATH-5000.00

AIME 20240.00

LiveCodeBench92.00

不开源

Claude Opus 4.5

MMLU Pro90.00

GPQA Diamond87.00

SWE-bench Verified80.90

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

Claude Opus 4.1

MMLU Pro88.00

GPQA Diamond81.00

SWE-bench Verified74.50

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

M2.1

2300B

MMLU Pro88.00

GPQA Diamond81.00

SWE-bench Verified74.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

Claude Sonnet 4.5

MMLU Pro88.00

GPQA Diamond83.40

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench71.00

不开源

Hunyuan-T1

MMLU Pro87.20

GPQA Diamond69.30

SWE-bench Verified0.00

MATH-50096.20

AIME 202478.20

LiveCodeBench64.90

不开源

Grok 4

MMLU Pro87.00

GPQA Diamond87.00

SWE-bench Verified58.60

MATH-5000.00

AIME 20240.00

LiveCodeBench82.00

不开源

GPT-4.5

MMLU Pro86.10

GPQA Diamond71.40

SWE-bench Verified38.00

MATH-50090.70

AIME 202436.70

LiveCodeBench46.40

不开源

Gemini 2.5-Pro

MMLU Pro86.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-50098.80

AIME 202492.00

LiveCodeBench77.10

不开源

Qwen3-Max-Thinking

10000B

MMLU Pro85.70

GPQA Diamond87.40

SWE-bench Verified75.30

MATH-5000.00

AIME 20240.00

LiveCodeBench85.90

不开源

OpenAI o3

MMLU Pro85.60

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-50098.10

AIME 202491.60

LiveCodeBench75.80

不开源

DeepSeek V3.2-Exp

6710B

MMLU Pro85.00

GPQA Diamond79.90

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench74.10

Free commercial

Grok 4.1 Fast

MMLU Pro85.00

GPQA Diamond85.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench82.00

不开源

DeepSeek-V3.1 Terminus

6710B

MMLU Pro85.00

GPQA Diamond80.70

SWE-bench Verified68.40

MATH-5000.00

AIME 20240.00

LiveCodeBench74.90

Free commercial

DeepSeek-V3.1 Terminus

6710B

MMLU Pro85.00

GPQA Diamond79.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench80.00

Free commercial

DeepSeek-V3.1

6710B

MMLU Pro85.00

GPQA Diamond80.10

SWE-bench Verified0.00

MATH-5000.00

AIME 202493.10

LiveCodeBench74.80

Free commercial

DeepSeek-R1-0528

6710B

MMLU Pro85.00

GPQA Diamond81.00

SWE-bench Verified57.60

MATH-50098.00

AIME 202491.40

LiveCodeBench73.30

Free commercial

Claude Opus 4

MMLU Pro85.00

GPQA Diamond79.60

SWE-bench Verified72.50

MATH-50098.20

AIME 202476.00

LiveCodeBench56.60

不开源

GLM-4.5

3550B

MMLU Pro84.60

GPQA Diamond79.10

SWE-bench Verified64.20

MATH-50098.20

AIME 202491.00

LiveCodeBench72.90

Free commercial

Kimi K2 Thinking

10400B

MMLU Pro84.60

GPQA Diamond84.50

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench83.10

Free commercial

Qwen3-235B-A22B-Thinking-2507

2350B

MMLU Pro84.40

GPQA Diamond81.10

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench74.10

Free commercial

Qwen3-235B-A22B-Thinking

305B

MMLU Pro84.40

GPQA Diamond81.10

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench74.10

Free commercial

GLM-4.7

3580B

MMLU Pro84.30

GPQA Diamond85.70

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench84.90

Free commercial

DeepSeek-R1

6710B

MMLU Pro84.00

GPQA Diamond71.50

SWE-bench Verified49.20

MATH-50097.30

AIME 202479.80

LiveCodeBench65.90

Free commercial

Claude Sonnet 4

MMLU Pro84.00

GPQA Diamond75.40

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench66.00

不开源

Qwen3 Max (Preview)

MMLU Pro84.00

GPQA Diamond76.00

SWE-bench Verified69.60

MATH-5000.00

AIME 20240.00

LiveCodeBench57.50

不开源

DeepSeek V3.2-Exp

6710B

MMLU Pro84.00

GPQA Diamond74.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench55.00

Free commercial

DeepSeek-V3.1

6710B

MMLU Pro83.70

GPQA Diamond74.90

SWE-bench Verified66.00

MATH-5000.00

AIME 202466.30

LiveCodeBench56.40

Free commercial

Intern-S1

2410B

MMLU Pro83.50

GPQA Diamond77.30

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

Qwen3-235B-A22B-2507

2350B

MMLU Pro83.00

GPQA Diamond77.50

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench51.80

Free commercial

GLM-4.6

3550B

MMLU Pro83.00

GPQA Diamond81.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench82.80

Free commercial

Pangu Pro MoE

719B

MMLU Pro82.60

GPQA Diamond73.70

SWE-bench Verified0.00

MATH-50096.80

AIME 202479.20

LiveCodeBench59.60

Free commercial

Llama 4 Behemoth Instruct

20000B

MMLU Pro82.20

GPQA Diamond73.70

SWE-bench Verified0.00

MATH-50095.00

AIME 20240.00

LiveCodeBench49.40

Free commercial

MiniMax M2

2300B

MMLU Pro82.00

GPQA Diamond78.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench83.00

Free commercial

GLM-4.5-Air

1060B

MMLU Pro81.40

GPQA Diamond75.00

SWE-bench Verified57.60

MATH-50098.10

AIME 202489.40

LiveCodeBench70.70

Free commercial

DeepSeek-V3-0324

6710B

MMLU Pro81.20

GPQA Diamond68.40

SWE-bench Verified38.80

MATH-50094.00

AIME 202459.40

LiveCodeBench49.20

Free commercial

MiniMax-M1-80k

4560B

MMLU Pro81.10

GPQA Diamond70.00

SWE-bench Verified56.00

MATH-50096.80

AIME 202486.00

LiveCodeBench65.00

Free commercial

Kimi K2

10000B

MMLU Pro81.10

GPQA Diamond75.10

SWE-bench Verified51.80

MATH-50097.40

AIME 202469.60

LiveCodeBench53.70

Free commercial

OpenAI o4 - mini

MMLU Pro80.60

GPQA Diamond81.40

SWE-bench Verified68.10

MATH-5000.00

AIME 202493.40

LiveCodeBench0.00

不开源

MiniMax-M1-40k

4560B

MMLU Pro80.60

GPQA Diamond69.20

SWE-bench Verified55.60

MATH-50096.00

AIME 202483.30

LiveCodeBench62.30

Free commercial

GPT-4.1

MMLU Pro80.50

GPQA Diamond66.30

SWE-bench Verified54.60

MATH-50092.80

AIME 202448.10

LiveCodeBench40.50

不开源

Llama 4 Maverick Instruct

4000B

MMLU Pro80.50

GPQA Diamond69.80

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench43.40

Free commercial

OpenAI o1-mini

MMLU Pro80.30

GPQA Diamond60.00

SWE-bench Verified0.00

MATH-50090.00

AIME 202463.60

LiveCodeBench52.00

不开源

Haiku 4.5

MMLU Pro80.00

GPQA Diamond60.50

SWE-bench Verified60.60

MATH-5000.00

AIME 20240.00

LiveCodeBench51.00

不开源

GPT-4o(2025-03-27)

MMLU Pro79.80

GPQA Diamond66.90

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench35.80

不开源

Gemini 2.0 Pro Experimental

MMLU Pro79.10

GPQA Diamond64.70

SWE-bench Verified0.00

MATH-5000.00

AIME 202436.00

LiveCodeBench0.00

不开源

Hunyuan-TurboS

MMLU Pro79.00

GPQA Diamond57.50

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench32.00

不开源

Pangu Embedded

70B

MMLU Pro79.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-50092.40

AIME 202481.90

LiveCodeBench67.10

Free commercial

GPT OSS 120B

117B

MMLU Pro79.00

GPQA Diamond80.10

SWE-bench Verified60.10

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

Kimi K2.5

10000B

MMLU Pro78.50

GPQA Diamond87.60

SWE-bench Verified76.80

MATH-5000.00

AIME 20240.00

LiveCodeBench85.00

Free commercial

ERNIE-4.5-300B-A47B

3000B

MMLU Pro78.40

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-50096.40

AIME 202454.80

LiveCodeBench38.80

Free commercial

Qwen3-30B-A3B-2507

305B

MMLU Pro78.40

GPQA Diamond70.40

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench43.20

Free commercial

Claude 3.5 Sonnet New

MMLU Pro78.00

GPQA Diamond65.00

SWE-bench Verified49.00

MATH-50078.00

AIME 202416.00

LiveCodeBench38.70

不开源

GLM-4.6

3550B

MMLU Pro78.00

GPQA Diamond63.00

SWE-bench Verified68.00

MATH-5000.00

AIME 20240.00

LiveCodeBench56.00

Free commercial

GPT-5-mini

MMLU Pro78.00

GPQA Diamond69.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench55.00

不开源

GPT-4o

MMLU Pro77.90

GPQA Diamond70.10

SWE-bench Verified31.00

MATH-50075.90

AIME 20249.30

LiveCodeBench35.10

不开源

GPT-4o(2024-11-20)

MMLU Pro77.90

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

Claude 3.5 Sonnet

MMLU Pro77.64

GPQA Diamond59.40

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

Gemini 2.0 Flash Experimental

MMLU Pro76.24

GPQA Diamond65.20

SWE-bench Verified21.40

MATH-5000.00

AIME 20240.00

LiveCodeBench29.10

不开源

Gemini 1.5 Pro

MMLU Pro76.10

GPQA Diamond53.50

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

Qwen2.5-Max

MMLU Pro76.10

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

QwQ-32B

325B

MMLU Pro76.00

GPQA Diamond58.00

SWE-bench Verified0.00

MATH-50091.00

AIME 202479.50

LiveCodeBench0.00

Free commercial

Haiku 4.5

MMLU Pro76.00

GPQA Diamond73.30

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench62.00

不开源

DeepSeek-V3

6810B

MMLU Pro75.90

GPQA Diamond59.10

SWE-bench Verified0.00

MATH-50087.80

AIME 202439.00

LiveCodeBench34.60

Free commercial

Grok 2

2690B

MMLU Pro75.50

GPQA Diamond56.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

Llama 4 Scout Instruct

1090B

MMLU Pro74.30

GPQA Diamond57.20

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench32.80

Free commercial

GPT OSS 20B

210B

MMLU Pro74.00

GPQA Diamond71.50

SWE-bench Verified34.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

Llama3.1-405B Instruct

4050B

MMLU Pro73.40

GPQA Diamond49.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench30.20

Free commercial

Qwen3-235B-A22B

2350B

MMLU Pro72.90

GPQA Diamond71.10

SWE-bench Verified34.40

MATH-50096.20

AIME 202485.70

LiveCodeBench70.70

Free commercial

Qwen3-8B

80B

MMLU Pro72.50

GPQA Diamond39.30

SWE-bench Verified0.00

MATH-50087.40

AIME 202479.40

LiveCodeBench61.80

Free commercial

GLM-4-9B-Chat

90B

MMLU Pro72.40

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 202476.40

LiveCodeBench51.80

Free commercial

Gemini 2.0 Flash-Lite

MMLU Pro71.60

GPQA Diamond51.50

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench28.90

不开源

QwQ-32B-Preview

320B

MMLU Pro70.97

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-50090.60

AIME 202450.00

LiveCodeBench0.00

Free commercial

Phi 4 - 14B

140B

MMLU Pro70.40

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Non-commercial

Qwen2.5-32B

320B

MMLU Pro69.23

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench51.20

Free commercial

Qwen3-30B-A3B

305B

MMLU Pro69.10

GPQA Diamond54.80

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench29.00

Free commercial

Mistral-Small-3.2

240B

MMLU Pro69.06

GPQA Diamond46.13

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

Llama3.3-70B-Instruct

700B

MMLU Pro68.90

GPQA Diamond50.50

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench33.30

Free commercial

Claude3-Opus

MMLU Pro68.45

GPQA Diamond50.40

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

Gemma 3 - 27B (IT)

270B

MMLU Pro67.50

GPQA Diamond42.40

SWE-bench Verified0.00

MATH-5000.00

AIME 202425.30

LiveCodeBench29.70

Free commercial

Hunyuan-A13B-Instruct

800B

MMLU Pro67.23

GPQA Diamond71.20

SWE-bench Verified0.00

MATH-5000.00

AIME 202487.30

LiveCodeBench63.90

Free commercial

Mistral-Small-3.1-24B-Instruct-2503

240B

MMLU Pro66.76

GPQA Diamond45.96

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

Llama3.1-70B-Instruct

700B

MMLU Pro66.40

GPQA Diamond48.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench33.30

Free commercial

Qwen3-Next

800B

MMLU Pro66.05

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench56.60

Free commercial

Claude 3.5 Haiku

MMLU Pro65.00

GPQA Diamond41.60

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

Qwen2.5-14B

140B

MMLU Pro63.69

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

Llama 4 Maverick

4000B

MMLU Pro62.90

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

GPT-4o mini

MMLU Pro61.70

GPQA Diamond41.10

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

Llama3.1-405B

4050B

MMLU Pro61.60

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

Gemma 3 - 12B (IT)

120B

MMLU Pro60.60

GPQA Diamond40.90

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench24.60

Free commercial

Llama 4 Scout

1090B

MMLU Pro58.20

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

Qwen2.5-72B

727B

MMLU Pro58.10

GPQA Diamond45.90

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

Claude3-Sonnet

MMLU Pro56.80

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

Gemma2-27B

270B

MMLU Pro56.54

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

Mixtral-8x22B-Instruct-v0.1

1410B

MMLU Pro56.33

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

Llama3-70B-Instruct

700B

MMLU Pro56.20

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

Phi-4-mini-instruct (3.8B)

38B

MMLU Pro52.80

GPQA Diamond36.00

SWE-bench Verified0.00

MATH-50071.80

AIME 202410.00

LiveCodeBench0.00

Free commercial

Llama3-70B

700B

MMLU Pro52.78

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

100

Llama3.1-70B

700B

MMLU Pro52.47

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

101

Grok-1.5

MMLU Pro51.00

GPQA Diamond35.90

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

102

C4AI Aya Vision 32B

320B

MMLU Pro47.16

GPQA Diamond33.84

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Non-commercial

103

Qwen2.5-7B

70B

MMLU Pro45.00

GPQA Diamond36.40

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

104

Gemma 2 - 9B

90B

MMLU Pro44.70

GPQA Diamond32.80

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

105

Llama3.1-8B-Instruct

80B

MMLU Pro44.00

GPQA Diamond26.30

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

106

Moonlight-16B-A3B-Instruct

160B

MMLU Pro42.40

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

107

Llama3.1-8B

80B

MMLU Pro35.40

GPQA Diamond25.80

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

108

Qwen2.5-3B

30B

MMLU Pro34.60

GPQA Diamond24.30

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

109

Mistral-7B-Instruct-v0.3

70B

MMLU Pro30.90

GPQA Diamond24.70

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

110

Llama-3.2-3B

32B

MMLU Pro25.00

GPQA Diamond26.60

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

111

o3-pro

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified75.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

112

GPT-5.1 Codex

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified70.40

MATH-5000.00

AIME 20240.00

LiveCodeBench85.50

不开源

113

GPT-5 Codex

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified74.50

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

114

StepFun Flash 3.5

1960B

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified74.40

MATH-5000.00

AIME 20240.00

LiveCodeBench86.40

Free commercial

115

GLM-4.7

3580B

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified73.80

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

116

Grok 4 Heavy

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified73.50

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

117

Haiku 4.5

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified73.30

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

118

DeepSeek V3.2

6710B

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified73.10

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

119

Claude Sonnet 4

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified72.70

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

120

Grok 4 Code

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified72.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

121

Kimi K2 Thinking

10400B

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified71.30

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

122

Grok Code Fast 1

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified70.80

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

123

Hunyuan-7B

70B

MMLU Pro0.00

GPQA Diamond60.10

SWE-bench Verified0.00

MATH-50093.70

AIME 202481.10

LiveCodeBench57.00

Free commercial

124

GPT-5.1-Codex-Max

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified76.80

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

125

Claude Sonnet 4.5

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified77.20

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

126

Claude Opus 4.1

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified79.40

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

127

Claude Sonnet 4

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified80.20

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

128

Claude Sonnet 4.5

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified82.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

129

GPT-5-mini

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

130

Grok 3.5

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

131

Phi-4-instruct (reasoning-trained)

38B

MMLU Pro0.00

GPQA Diamond49.00

SWE-bench Verified0.00

MATH-50090.40

AIME 202450.00

LiveCodeBench0.00

不开源

132

DeepSeek-R1-Distill-Qwen-7B

70B

MMLU Pro0.00

GPQA Diamond49.50

SWE-bench Verified0.00

MATH-50091.40

AIME 202453.30

LiveCodeBench0.00

Free commercial

133

GPT-4.1 nano

MMLU Pro0.00

GPQA Diamond50.30

SWE-bench Verified0.00

MATH-5000.00

AIME 202429.40

LiveCodeBench0.00

不开源

134

Qwen3-32B

320B

MMLU Pro0.00

GPQA Diamond53.30

SWE-bench Verified0.00

MATH-5000.00

AIME 202481.40

LiveCodeBench65.70

Free commercial

135

Codestral

220B

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench31.50

Non-commercial

136

Kimi k1.5 (Short-CoT)

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-50094.60

AIME 20240.00

LiveCodeBench0.00

不开源

137

Codestral 25.01

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench37.90

不开源

138

QwQ-Max-Preview

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench65.60

Free commercial

139

Kimi-k1.6-IOI

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench65.90

不开源

140

OpenAI o3-mini (medium)

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench67.40

不开源

141

Kimi-k1.6-IOI-high

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench73.80

不开源

142

Gemini 2.5 Pro Deep Think

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench80.40

不开源

143

Claude Opus 4.5

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench87.00

不开源

144

Gemini 2.5 Deep Think

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench87.60

不开源

145

GPT OSS 20B

210B

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 202496.00

LiveCodeBench0.00

Free commercial

146

GPT OSS 120B

117B

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 202496.60

LiveCodeBench0.00

Free commercial

147

OpenAI o4 - mini

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 202498.70

LiveCodeBench0.00

不开源

148

MiniMax M2

2300B

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified69.40

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

149

Kimi k1.5 (Long-CoT)

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-50096.20

AIME 20240.00

LiveCodeBench0.00

不开源

150

Qwen3-30B-A3B-2507

305B

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified22.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

151

Devstral Small 1.0

240B

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified46.80

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

152

Qwen3-Coder-Flash

305B

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified51.60

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

153

Devstral Small 1.1

240B

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified53.60

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

154

Gemini 2.5 Flash-Preview-09-2025

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified54.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

155

Devstral Medium

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified61.60

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

156

Qwen3-Coder-480B-A35B

4800B

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified67.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

157

DeepSeek V3.2-Exp

6710B

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified67.80

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

158

Kimi K2 0905

10000B

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified69.20

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

159

Kimi K2 0905

10000B

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified69.20

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

160

Gemini 2.5-Pro

MMLU Pro0.00

GPQA Diamond86.40

SWE-bench Verified67.20

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

161

Gemini 2.5 Flash

MMLU Pro0.00

GPQA Diamond82.80

SWE-bench Verified48.90

MATH-5000.00

AIME 20240.00

LiveCodeBench55.40

不开源

162

GLM-4.6

3550B

MMLU Pro0.00

GPQA Diamond82.90

SWE-bench Verified68.00

MATH-5000.00

AIME 20240.00

LiveCodeBench84.50

Free commercial

163

Gemini-2.5-Pro-Preview-05-06

MMLU Pro0.00

GPQA Diamond83.00

SWE-bench Verified63.20

MATH-50098.80

AIME 202492.00

LiveCodeBench77.10

不开源

164

OpenAI o3

MMLU Pro0.00

GPQA Diamond83.30

SWE-bench Verified69.10

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

165

Claude Sonnet 4

MMLU Pro0.00

GPQA Diamond83.80

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

166

o3-pro

MMLU Pro0.00

GPQA Diamond84.00

SWE-bench Verified0.00

MATH-5000.00

AIME 202493.00

LiveCodeBench0.00

不开源

167

Gemini 2.5 Pro Experimental 03-25

MMLU Pro0.00

GPQA Diamond84.00

SWE-bench Verified63.80

MATH-5000.00

AIME 202492.00

LiveCodeBench70.40

不开源

168

Grok-3 mini - Reasoning

MMLU Pro0.00

GPQA Diamond84.00

SWE-bench Verified0.00

MATH-5000.00

AIME 202496.00

LiveCodeBench0.00

不开源

169

Grok-3 - Reasoning Beta

MMLU Pro0.00

GPQA Diamond84.60

SWE-bench Verified0.00

MATH-5000.00

AIME 202493.30

LiveCodeBench79.40

不开源

170

Claude Sonnet 3.7-64K Extended Thinking

MMLU Pro0.00

GPQA Diamond84.80

SWE-bench Verified0.00

MATH-50096.20

AIME 202480.00

LiveCodeBench0.00

不开源

171

Grok 4 Fast

MMLU Pro0.00

GPQA Diamond85.70

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench80.00

不开源

172

GPT-5

MMLU Pro0.00

GPQA Diamond85.70

SWE-bench Verified72.80

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

173

DeepSeek V3.2

6710B

MMLU Pro0.00

GPQA Diamond82.40

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench83.30

Free commercial

174

GPT-5

MMLU Pro0.00

GPQA Diamond87.30

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

175

GPT-5.1

MMLU Pro0.00

GPQA Diamond88.10

SWE-bench Verified76.30

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

176

GPT-5.1

MMLU Pro0.00

GPQA Diamond88.10

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

177

GPT-5-Pro

MMLU Pro0.00

GPQA Diamond88.40

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

178

Grok 4 Heavy

MMLU Pro0.00

GPQA Diamond88.90

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

179

GPT-5-Pro

MMLU Pro0.00

GPQA Diamond89.40

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

180

Gemini 3.0 Flash

MMLU Pro0.00

GPQA Diamond90.40

SWE-bench Verified68.70

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

181

GPT-5.2

MMLU Pro0.00

GPQA Diamond92.40

SWE-bench Verified80.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

182

GPT-5.2 Pro

MMLU Pro0.00

GPQA Diamond93.20

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

183

Gemini 3.0 Pro (Preview 11-2025)

MMLU Pro0.00

GPQA Diamond93.80

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

184

Amazon Nova Pro

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

185

OpenAI o3-mini

MMLU Pro0.00

GPQA Diamond70.60

SWE-bench Verified40.80

MATH-50095.80

AIME 202460.00

LiveCodeBench0.00

不开源

186

Qwen3-8B

80B

MMLU Pro0.00

GPQA Diamond62.00

SWE-bench Verified0.00

MATH-50097.40

AIME 202476.00

LiveCodeBench57.50

Free commercial

187

GPT-4.1 mini

MMLU Pro0.00

GPQA Diamond65.00

SWE-bench Verified23.60

MATH-5000.00

AIME 202449.60

LiveCodeBench0.00

不开源

188

Grok 3 mini

MMLU Pro0.00

GPQA Diamond65.00

SWE-bench Verified0.00

MATH-5000.00

AIME 202440.00

LiveCodeBench0.00

不开源

189

DeepSeek-R1-Distill-Llama-70B

700B

MMLU Pro0.00

GPQA Diamond65.20

SWE-bench Verified0.00

MATH-50094.50

AIME 20240.00

LiveCodeBench0.00

Free commercial

190

Qwen3-4B-Thinking-2507

40B

MMLU Pro0.00

GPQA Diamond65.80

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench55.20

Free commercial

191

GLM-4.7-Flash

310B

MMLU Pro0.00

GPQA Diamond66.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

192

Gemini 2.5 Flash-Lite

MMLU Pro0.00

GPQA Diamond66.70

SWE-bench Verified27.60

MATH-5000.00

AIME 20240.00

LiveCodeBench34.30

不开源

193

Claude Sonnet 4

MMLU Pro0.00

GPQA Diamond68.00

SWE-bench Verified0.00

MATH-5000.00

AIME 202443.40

LiveCodeBench48.50

不开源

194

Claude Sonnet 3.7

MMLU Pro0.00

GPQA Diamond68.00

SWE-bench Verified70.30

MATH-50082.20

AIME 202423.30

LiveCodeBench0.00

不开源

195

Magistral-Small-2506

240B

MMLU Pro0.00

GPQA Diamond68.18

SWE-bench Verified0.00

MATH-5000.00

AIME 202470.68

LiveCodeBench55.84

Free commercial

196

Qwen3-32B

320B

MMLU Pro0.00

GPQA Diamond68.40

SWE-bench Verified0.00

MATH-50097.20

AIME 202481.40

LiveCodeBench0.00

Free commercial

197

Qwen3-4B-2507

40B

MMLU Pro0.00

GPQA Diamond62.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench35.10

Free commercial

198

Magistral-Medium-2506

MMLU Pro0.00

GPQA Diamond70.83

SWE-bench Verified0.00

MATH-5000.00

AIME 202473.59

LiveCodeBench59.36

不开源

199

Qwen3-235B-A22B

2350B

MMLU Pro0.00

GPQA Diamond71.10

SWE-bench Verified0.00

MATH-50098.00

AIME 202485.70

LiveCodeBench70.70

Free commercial

200

Step3

3210B

MMLU Pro0.00

GPQA Diamond73.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench67.10

Free commercial

201

Claude Sonnet 4.5

MMLU Pro0.00

GPQA Diamond73.70

SWE-bench Verified64.80

MATH-5000.00

AIME 20240.00

LiveCodeBench59.00

不开源

202

GLM-4.7-Flash

310B

MMLU Pro0.00

GPQA Diamond75.20

SWE-bench Verified59.20

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

203

ERNIE-4.5-VL-424B-A47B-Base

4240B

MMLU Pro0.00

GPQA Diamond76.80

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench38.80

Free commercial

204

GPT-5

MMLU Pro0.00

GPQA Diamond77.80

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

205

Gemini 2.5 Flash

MMLU Pro0.00

GPQA Diamond78.30

SWE-bench Verified50.00

MATH-5000.00

AIME 202488.00

LiveCodeBench41.10

不开源

206

OpenAI o3-mini (high)

MMLU Pro0.00

GPQA Diamond79.70

SWE-bench Verified49.30

MATH-50097.90

AIME 202487.00

LiveCodeBench69.50

不开源

207

Grok 3

MMLU Pro0.00

GPQA Diamond80.40

SWE-bench Verified0.00

MATH-5000.00

AIME 202484.20

LiveCodeBench70.60

不开源

208

Claude Opus 4.1

MMLU Pro0.00

GPQA Diamond80.90

SWE-bench Verified74.50

MATH-5000.00

AIME 20240.00

LiveCodeBench65.00

不开源