加载中...

LLM Benchmark Performance Comparison

Compare model performance across MMLU Pro, HLE, SWE-Bench and more. Select benchmarks to view rankings.

Detailed benchmark descriptions available at:LLM Benchmark List & Guide

Updated on: 2025/11/08 22:10:24

Benchmark switcher

Pick the leaderboard to sync both chart and table

MMLU Pro GPQA Diamond SWE-bench Verified MATH-500 AIME 2024 LiveCodeBench

More benchmark coverage

Browse the benchmark catalog by category and language

More Benchmarks

Filters

Model Size

All 3B and below 7B 13B 34B 65B 100B and above

Model Type

All Reasoning Models Foundation Models Instruction/Chat Models Coding Models

LLM Performance Results

Data source: DataLearnerAI

Rank	Model	MMLU Pro	GPQA Diamond	SWE-bench Verified	MATH-500	AIME 2024	LiveCodeBench	Params (B)	License
1	OpenAI o1	91.04	77.30	48.90	96.40	79.20	71.00	—	不开源
2	Gemini 3.0 Pro (Preview 11-2025)	90.00	91.90	76.20	0.00	0.00	92.00	—	不开源
3	Claude Opus 4.5	90.00	87.00	80.90	0.00	0.00	0.00	—	不开源
4	Claude Opus 4.1	88.00	81.00	74.50	0.00	0.00	0.00	—	不开源
5	M2.1	88.00	81.00	74.80	0.00	0.00	0.00	2300B	Free commercial
6	Claude Sonnet 4.5	88.00	83.40	0.00	0.00	0.00	71.00	—	不开源
7	Qwen3.5-397B-A17B	87.80	88.40	76.40	0.00	0.00	0.00	397B	Free commercial
8	Qwen3.5-397B-A17B	87.80	88.40	0.00	0.00	0.00	83.60	397B	Free commercial
9	Hunyuan-T1	87.20	69.30	0.00	96.20	78.20	64.90	—	不开源
10	Grok 4	87.00	87.00	58.60	0.00	0.00	82.00	—	不开源
11	GPT-4.5	86.10	71.40	38.00	90.70	36.70	46.40	—	不开源
12	Qwen3.5-27B	86.10	85.50	72.40	0.00	0.00	0.00	270B	Free commercial
13	Gemini 2.5-Pro	86.00	0.00	0.00	98.80	92.00	77.10	—	不开源
14	Qwen3-Max-Thinking	85.70	87.40	75.30	0.00	0.00	85.90	10000B	不开源
15	OpenAI o3	85.60	0.00	0.00	98.10	91.60	75.80	—	不开源
16	DeepSeek-R1-0528	85.00	81.00	57.60	98.00	91.40	73.30	6710B	Free commercial
17	Grok 4.1 Fast	85.00	85.00	0.00	0.00	0.00	82.00	—	不开源
18	DeepSeek V3.2-Exp	85.00	79.90	0.00	0.00	0.00	74.10	6710B	Free commercial
19	DeepSeek-V3.1 Terminus	85.00	80.70	68.40	0.00	0.00	74.90	6710B	Free commercial
20	DeepSeek-V3.1 Terminus	85.00	79.00	0.00	0.00	0.00	80.00	6710B	Free commercial
21	DeepSeek-V3.1	85.00	80.10	0.00	0.00	93.10	74.80	6710B	Free commercial
22	Claude Opus 4	85.00	79.60	72.50	98.20	76.00	56.60	—	不开源
23	GLM-4.5	84.60	79.10	64.20	98.20	91.00	72.90	3550B	Free commercial
24	Kimi K2 Thinking	84.60	84.50	0.00	0.00	0.00	83.10	10400B	Free commercial
25	Qwen3-235B-A22B-Thinking	84.40	81.10	0.00	0.00	0.00	74.10	305B	Free commercial
26	Qwen3-235B-A22B-Thinking-2507	84.40	81.10	0.00	0.00	0.00	74.10	2350B	Free commercial
27	GLM-4.7	84.30	85.70	0.00	0.00	0.00	84.90	3580B	Free commercial
28	DeepSeek-R1	84.00	71.50	49.20	97.30	79.80	65.90	6710B	Free commercial
29	Claude Sonnet 4	84.00	75.40	0.00	0.00	0.00	66.00	—	不开源
30	Qwen3 Max (Preview)	84.00	76.00	69.60	0.00	0.00	57.50	—	不开源
31	DeepSeek V3.2-Exp	84.00	74.00	0.00	0.00	0.00	55.00	6710B	Free commercial
32	DeepSeek-V3.1	83.70	74.90	66.00	0.00	66.30	56.40	6710B	Free commercial
33	Intern-S1	83.50	77.30	0.00	0.00	0.00	0.00	2410B	Free commercial
34	Qwen3-235B-A22B-2507	83.00	77.50	0.00	0.00	0.00	51.80	2350B	Free commercial
35	GLM-4.6	83.00	81.00	0.00	0.00	0.00	82.80	3550B	Free commercial
36	Pangu Pro MoE	82.60	73.70	0.00	96.80	79.20	59.60	719B	Free commercial
37	Llama 4 Behemoth Instruct	82.20	73.70	0.00	95.00	0.00	49.40	20000B	Free commercial
38	MiniMax M2	82.00	78.00	0.00	0.00	0.00	83.00	2300B	Free commercial
39	GLM-4.5-Air	81.40	75.00	57.60	98.10	89.40	70.70	1060B	Free commercial
40	DeepSeek-V3-0324	81.20	68.40	38.80	94.00	59.40	49.20	6710B	Free commercial
41	MiniMax-M1-80k	81.10	70.00	56.00	96.80	86.00	65.00	4560B	Free commercial
42	Kimi K2	81.10	75.10	51.80	97.40	69.60	53.70	10000B	Free commercial
43	OpenAI o4 - mini	80.60	81.40	68.10	0.00	93.40	0.00	—	不开源
44	MiniMax-M1-40k	80.60	69.20	55.60	96.00	83.30	62.30	4560B	Free commercial
45	GPT-4.1	80.50	66.30	54.60	92.80	48.10	40.50	—	不开源
46	Llama 4 Maverick Instruct	80.50	69.80	0.00	0.00	0.00	43.40	4000B	Free commercial
47	OpenAI o1-mini	80.30	60.00	0.00	90.00	63.60	52.00	—	不开源
48	Haiku 4.5	80.00	73.30	0.00	0.00	0.00	62.00	—	不开源
49	GPT-4o(2025-03-27)	79.80	66.90	0.00	0.00	0.00	35.80	—	不开源
50	Gemini 2.0 Pro Experimental	79.10	64.70	0.00	0.00	36.00	0.00	—	不开源
51	Hunyuan-TurboS	79.00	57.50	0.00	0.00	0.00	32.00	—	不开源
52	Pangu Embedded	79.00	0.00	0.00	92.40	81.90	67.10	70B	Free commercial
53	GPT OSS 120B	79.00	80.10	60.10	0.00	0.00	0.00	117B	Free commercial
54	Kimi K2.5	78.50	87.60	76.80	0.00	0.00	85.00	10000B	Free commercial
55	ERNIE-4.5-300B-A47B	78.40	0.00	0.00	96.40	54.80	38.80	3000B	Free commercial
56	Qwen3-30B-A3B-2507	78.40	70.40	0.00	0.00	0.00	43.20	305B	Free commercial
57	Claude 3.5 Sonnet New	78.00	65.00	49.00	78.00	16.00	38.70	—	不开源
58	GLM-4.6	78.00	63.00	68.00	0.00	0.00	56.00	3550B	Free commercial
59	GPT-5-mini	78.00	69.00	0.00	0.00	0.00	55.00	—	不开源
60	GPT-4o	77.90	70.10	31.00	75.90	9.30	35.10	—	不开源
61	GPT-4o(2024-11-20)	77.90	0.00	0.00	0.00	0.00	0.00	—	不开源
62	Claude 3.5 Sonnet	77.64	59.40	0.00	0.00	0.00	0.00	—	不开源
63	Gemini 2.0 Flash Experimental	76.24	65.20	21.40	0.00	0.00	29.10	—	不开源
64	Gemini 1.5 Pro	76.10	53.50	0.00	0.00	0.00	0.00	—	不开源
65	Qwen2.5-Max	76.10	0.00	0.00	0.00	0.00	0.00	—	不开源
66	Haiku 4.5	76.00	60.50	0.00	0.00	0.00	51.00	—	不开源
67	QwQ-32B	76.00	58.00	0.00	91.00	79.50	0.00	325B	Free commercial
68	DeepSeek-V3	75.90	59.10	0.00	87.80	39.00	34.60	6810B	Free commercial
69	Grok 2	75.50	56.00	0.00	0.00	0.00	0.00	2690B	Free commercial
70	Llama 4 Scout Instruct	74.30	57.20	0.00	0.00	0.00	32.80	1090B	Free commercial
71	GPT OSS 20B	74.00	71.50	34.00	0.00	0.00	0.00	210B	Free commercial
72	Llama3.1-405B Instruct	73.40	49.00	0.00	0.00	0.00	30.20	4050B	Free commercial
73	Qwen3-235B-A22B	72.90	71.10	34.40	96.20	85.70	70.70	2350B	Free commercial
74	Qwen3-8B	72.50	39.30	0.00	87.40	79.40	61.80	80B	Free commercial
75	GLM-4-9B-Chat	72.40	0.00	0.00	0.00	76.40	51.80	90B	Free commercial
76	Gemini 2.0 Flash-Lite	71.60	51.50	0.00	0.00	0.00	28.90	—	不开源
77	QwQ-32B-Preview	70.97	0.00	0.00	90.60	50.00	0.00	320B	Free commercial
78	Phi 4 - 14B	70.40	0.00	0.00	0.00	0.00	0.00	140B	Non-commercial
79	Qwen2.5-32B	69.23	0.00	0.00	0.00	0.00	51.20	320B	Free commercial
80	Qwen3-30B-A3B	69.10	54.80	0.00	0.00	0.00	29.00	305B	Free commercial
81	Mistral-Small-3.2	69.06	46.13	0.00	0.00	0.00	0.00	240B	Free commercial
82	Llama3.3-70B-Instruct	68.90	50.50	0.00	0.00	0.00	33.30	700B	Free commercial
83	Claude3-Opus	68.45	50.40	0.00	0.00	0.00	0.00	—	不开源
84	Gemma 3 - 27B (IT)	67.50	42.40	0.00	0.00	25.30	29.70	270B	Free commercial
85	Hunyuan-A13B-Instruct	67.23	71.20	0.00	0.00	87.30	63.90	800B	Free commercial
86	Mistral-Small-3.1-24B-Instruct-2503	66.76	45.96	0.00	0.00	0.00	0.00	240B	Free commercial
87	Llama3.1-70B-Instruct	66.40	48.00	0.00	0.00	0.00	33.30	700B	Free commercial
88	Qwen3-Next	66.05	0.00	0.00	0.00	0.00	56.60	800B	Free commercial
89	Claude 3.5 Haiku	65.00	41.60	0.00	0.00	0.00	0.00	—	不开源
90	Qwen2.5-14B	63.69	0.00	0.00	0.00	0.00	0.00	140B	Free commercial
91	Llama 4 Maverick	62.90	0.00	0.00	0.00	0.00	0.00	4000B	Free commercial
92	GPT-4o mini	61.70	41.10	0.00	0.00	0.00	0.00	—	不开源
93	Llama3.1-405B	61.60	0.00	0.00	0.00	0.00	0.00	4050B	Free commercial
94	Gemma 3 - 12B (IT)	60.60	40.90	0.00	0.00	0.00	24.60	120B	Free commercial
95	Llama 4 Scout	58.20	0.00	0.00	0.00	0.00	0.00	1090B	Free commercial
96	Qwen2.5-72B	58.10	45.90	0.00	0.00	0.00	0.00	727B	Free commercial
97	Claude3-Sonnet	56.80	0.00	0.00	0.00	0.00	0.00	—	不开源
98	Gemma2-27B	56.54	0.00	0.00	0.00	0.00	0.00	270B	Free commercial
99	Mixtral-8x22B-Instruct-v0.1	56.33	0.00	0.00	0.00	0.00	0.00	1410B	Free commercial
100	Llama3-70B-Instruct	56.20	0.00	0.00	0.00	0.00	0.00	700B	Free commercial
101	Phi-4-mini-instruct (3.8B)	52.80	36.00	0.00	71.80	10.00	0.00	38B	Free commercial
102	Llama3-70B	52.78	0.00	0.00	0.00	0.00	0.00	700B	Free commercial
103	Llama3.1-70B	52.47	0.00	0.00	0.00	0.00	0.00	700B	Free commercial
104	Grok-1.5	51.00	35.90	0.00	0.00	0.00	0.00	—	不开源
105	C4AI Aya Vision 32B	47.16	33.84	0.00	0.00	0.00	0.00	320B	Non-commercial
106	Qwen2.5-7B	45.00	36.40	0.00	0.00	0.00	0.00	70B	Free commercial
107	Gemma 2 - 9B	44.70	32.80	0.00	0.00	0.00	0.00	90B	Free commercial
108	Llama3.1-8B-Instruct	44.00	26.30	0.00	0.00	0.00	0.00	80B	Free commercial
109	Moonlight-16B-A3B-Instruct	42.40	0.00	0.00	0.00	0.00	0.00	160B	Free commercial
110	Llama3.1-8B	35.40	25.80	0.00	0.00	0.00	0.00	80B	Free commercial
111	Qwen2.5-3B	34.60	24.30	0.00	0.00	0.00	0.00	30B	Free commercial
112	Mistral-7B-Instruct-v0.3	30.90	24.70	0.00	0.00	0.00	0.00	70B	Free commercial
113	Llama-3.2-3B	25.00	26.60	0.00	0.00	0.00	0.00	32B	Free commercial
114	GPT-5.1-Codex-Max	0.00	0.00	76.80	0.00	0.00	0.00	—	不开源
115	Qwen3.5-397B-A17B	0.00	0.00	76.40	0.00	0.00	0.00	397B	Free commercial
116	GPT-5.1	0.00	0.00	76.30	0.00	0.00	0.00	—	不开源
117	o3-pro	0.00	0.00	75.00	0.00	0.00	0.00	—	不开源
118	GPT-5 Codex	0.00	0.00	74.50	0.00	0.00	0.00	—	不开源
119	Step 3.5 Flash	0.00	0.00	74.40	0.00	0.00	86.40	1960B	Free commercial
120	GLM-4.7	0.00	0.00	73.80	0.00	0.00	0.00	3580B	Free commercial
121	Grok 4 Heavy	0.00	0.00	73.50	0.00	0.00	0.00	—	不开源
122	Haiku 4.5	0.00	0.00	73.30	0.00	0.00	0.00	—	不开源
123	DeepSeek V3.2	0.00	0.00	73.10	0.00	0.00	0.00	6710B	Free commercial
124	Claude Sonnet 4	0.00	0.00	72.70	0.00	0.00	0.00	—	不开源
125	Grok 4 Code	0.00	0.00	72.00	0.00	0.00	0.00	—	不开源
126	Kimi K2 Thinking	0.00	0.00	71.30	0.00	0.00	0.00	10400B	Free commercial
127	Hunyuan-7B	0.00	60.10	0.00	93.70	81.10	57.00	70B	Free commercial
128	Grok Code Fast 1	0.00	0.00	70.80	0.00	0.00	0.00	—	不开源
129	Claude Sonnet 4.5	0.00	0.00	77.20	0.00	0.00	0.00	—	不开源
130	Claude Opus 4.1	0.00	0.00	79.40	0.00	0.00	0.00	—	不开源
131	GPT-5.2	0.00	0.00	80.00	0.00	0.00	0.00	—	不开源
132	MiniMax M2.5	0.00	0.00	80.20	0.00	0.00	0.00	2290B	Free commercial
133	Claude Sonnet 4	0.00	0.00	80.20	0.00	0.00	0.00	—	不开源
134	Gemini 3.1 Pro Preview	0.00	0.00	80.60	0.00	0.00	2887.00	—	不开源
135	Claude Opus 4.6	0.00	0.00	80.84	0.00	0.00	0.00	—	不开源
136	Claude Sonnet 5	0.00	0.00	82.00	0.00	0.00	0.00	—	不开源
137	Claude Sonnet 4.5	0.00	0.00	82.00	0.00	0.00	0.00	—	不开源
138	GPT-5-mini	0.00	0.00	0.00	0.00	0.00	0.00	—	不开源
139	Grok 3.5	0.00	0.00	0.00	0.00	0.00	0.00	—	不开源
140	Phi-4-instruct (reasoning-trained)	0.00	49.00	0.00	90.40	50.00	0.00	38B	不开源
141	DeepSeek-R1-Distill-Qwen-7B	0.00	49.50	0.00	91.40	53.30	0.00	70B	Free commercial
142	GPT-4.1 nano	0.00	50.30	0.00	0.00	29.40	0.00	—	不开源
143	Qwen3-32B	0.00	53.30	0.00	0.00	81.40	65.70	320B	Free commercial
144	Qwen3-30B-A3B-2507	0.00	0.00	22.00	0.00	0.00	0.00	305B	Free commercial
145	Codestral	0.00	0.00	0.00	0.00	0.00	31.50	220B	Non-commercial
146	Codestral 25.01	0.00	0.00	0.00	0.00	0.00	37.90	—	不开源
147	QwQ-Max-Preview	0.00	0.00	0.00	0.00	0.00	65.60	—	Free commercial
148	Kimi-k1.6-IOI	0.00	0.00	0.00	0.00	0.00	65.90	—	不开源
149	OpenAI o3-mini (medium)	0.00	0.00	0.00	0.00	0.00	67.40	—	不开源
150	Kimi-k1.6-IOI-high	0.00	0.00	0.00	0.00	0.00	73.80	—	不开源
151	Gemini 2.5 Pro Deep Think	0.00	0.00	0.00	0.00	0.00	80.40	—	不开源
152	Qwen3.5-397B-A17B	0.00	0.00	0.00	0.00	0.00	83.60	397B	Free commercial
153	Claude Opus 4.5	0.00	0.00	0.00	0.00	0.00	87.00	—	不开源
154	Gemini 2.5 Deep Think	0.00	0.00	0.00	0.00	0.00	87.60	—	不开源
155	GPT OSS 20B	0.00	0.00	0.00	0.00	96.00	0.00	210B	Free commercial
156	GPT OSS 120B	0.00	0.00	0.00	0.00	96.60	0.00	117B	Free commercial
157	OpenAI o4 - mini	0.00	0.00	0.00	0.00	98.70	0.00	—	不开源
158	Kimi k1.5 (Short-CoT)	0.00	0.00	0.00	94.60	0.00	0.00	—	不开源
159	Kimi k1.5 (Long-CoT)	0.00	0.00	0.00	96.20	0.00	0.00	—	不开源
160	Qwen3-Coder-Next	0.00	0.00	70.60	0.00	0.00	0.00	80B	Free commercial
161	Devstral Small 1.0	0.00	0.00	46.80	0.00	0.00	0.00	240B	Free commercial
162	Qwen3-Coder-Flash	0.00	0.00	51.60	0.00	0.00	0.00	305B	Free commercial
163	Devstral Small 1.1	0.00	0.00	53.60	0.00	0.00	0.00	240B	Free commercial
164	Gemini 2.5 Flash-Preview-09-2025	0.00	0.00	54.00	0.00	0.00	0.00	—	不开源
165	Haiku 4.5	0.00	0.00	60.60	0.00	0.00	0.00	—	不开源
166	Devstral Medium	0.00	0.00	61.60	0.00	0.00	0.00	—	不开源
167	Claude Sonnet 3.7	0.00	0.00	62.30	0.00	0.00	0.00	—	不开源
168	Qwen3-Coder-480B-A35B	0.00	0.00	67.00	0.00	0.00	0.00	4800B	Free commercial
169	DeepSeek V3.2-Exp	0.00	0.00	67.80	0.00	0.00	0.00	6710B	Free commercial
170	Kimi K2 0905	0.00	0.00	69.20	0.00	0.00	0.00	10000B	Free commercial
171	Kimi K2 0905	0.00	0.00	69.20	0.00	0.00	0.00	10000B	Free commercial
172	MiniMax M2	0.00	0.00	69.40	0.00	0.00	0.00	2300B	Free commercial
173	Claude Sonnet 3.7	0.00	0.00	70.30	0.00	0.00	0.00	—	不开源
174	GPT-5.1 Codex	0.00	0.00	70.40	0.00	0.00	85.50	—	不开源
175	GPT-5-Pro	0.00	88.40	0.00	0.00	0.00	0.00	—	不开源
176	o3-pro	0.00	84.00	0.00	0.00	93.00	0.00	—	不开源
177	Gemini 2.5 Pro Experimental 03-25	0.00	84.00	63.80	0.00	92.00	70.40	—	不开源
178	Grok-3 mini - Reasoning	0.00	84.00	0.00	0.00	96.00	0.00	—	不开源
179	Grok-3 - Reasoning Beta	0.00	84.60	0.00	0.00	93.30	79.40	—	不开源
180	Claude Sonnet 3.7-64K Extended Thinking	0.00	84.80	0.00	96.20	80.00	0.00	—	不开源
181	MiniMax M2.5	0.00	85.20	0.00	0.00	0.00	0.00	2290B	Free commercial
182	Grok 4 Fast	0.00	85.70	0.00	0.00	0.00	80.00	—	不开源
183	GPT-5	0.00	85.70	72.80	0.00	0.00	0.00	—	不开源
184	GLM-5	0.00	86.00	77.80	0.00	0.00	0.00	7440B	Free commercial
185	Gemini 2.5-Pro	0.00	86.40	67.20	0.00	0.00	0.00	—	不开源
186	GPT-5	0.00	87.30	0.00	0.00	0.00	0.00	—	不开源
187	GPT-5.4 mini	0.00	88.00	0.00	0.00	0.00	0.00	—	不开源
188	GPT-5.1	0.00	88.10	0.00	0.00	0.00	0.00	—	不开源
189	GPT-5.1	0.00	88.10	76.30	0.00	0.00	0.00	—	不开源
190	GPT-5.1	0.00	88.10	0.00	0.00	0.00	0.00	—	不开源
191	Claude Sonnet 4	0.00	83.80	0.00	0.00	0.00	0.00	—	不开源
192	Grok 4 Heavy	0.00	88.90	0.00	0.00	0.00	0.00	—	不开源
193	GPT-5-Pro	0.00	89.40	0.00	0.00	0.00	0.00	—	不开源
194	Claude Sonnet 4.6	0.00	89.90	79.60	0.00	0.00	0.00	—	不开源
195	Gemini 3.0 Flash	0.00	90.40	68.70	0.00	0.00	0.00	—	不开源
196	Gemini 3.0 Pro (Preview 11-2025)	0.00	91.00	0.00	0.00	0.00	0.00	—	不开源
197	Claude Opus 4.6	0.00	91.31	0.00	97.60	0.00	76.00	—	不开源
198	GPT-5.2	0.00	92.40	0.00	0.00	0.00	0.00	—	不开源
199	GPT-5.4	0.00	92.80	0.00	0.00	0.00	0.00	—	不开源
200	GPT-5.2 Pro	0.00	93.20	0.00	0.00	0.00	0.00	—	不开源
201	GPT-5.2	0.00	93.20	0.00	0.00	0.00	0.00	—	不开源
202	Gemini 3.0 Pro (Preview 11-2025)	0.00	93.80	0.00	0.00	0.00	0.00	—	不开源
203	Gemini 3.1 Pro Preview	0.00	94.30	0.00	0.00	0.00	0.00	—	不开源
204	GPT-5.4 Pro	0.00	94.40	0.00	0.00	0.00	0.00	—	不开源
205	Amazon Nova Pro	0.00	0.00	0.00	0.00	0.00	0.00	—	不开源
206	Claude Sonnet 4.5	0.00	73.70	0.00	0.00	0.00	59.00	—	不开源
207	Qwen3-8B	0.00	62.00	0.00	97.40	76.00	57.50	80B	Free commercial
208	GPT-4.1 mini	0.00	65.00	23.60	0.00	49.60	0.00	—	不开源
209	Grok 3 mini	0.00	65.00	0.00	0.00	40.00	0.00	—	不开源
210	DeepSeek-R1-Distill-Llama-70B	0.00	65.20	0.00	94.50	0.00	0.00	700B	Free commercial
211	Qwen3-4B-Thinking-2507	0.00	65.80	0.00	0.00	0.00	55.20	40B	Free commercial
212	GLM-4.7-Flash	0.00	66.00	0.00	0.00	0.00	0.00	310B	Free commercial
213	Gemini 2.5 Flash-Lite	0.00	66.70	27.60	0.00	0.00	34.30	—	不开源
214	Claude Sonnet 4	0.00	68.00	0.00	0.00	43.40	48.50	—	不开源
215	Claude Sonnet 3.7	0.00	68.00	0.00	82.20	23.30	0.00	—	不开源
216	Magistral-Small-2506	0.00	68.18	0.00	0.00	70.68	55.84	240B	Free commercial
217	Qwen3-32B	0.00	68.40	0.00	97.20	81.40	0.00	320B	Free commercial
218	OpenAI o3-mini	0.00	70.60	40.80	95.80	60.00	0.00	—	不开源
219	Magistral-Medium-2506	0.00	70.83	0.00	0.00	73.59	59.36	—	不开源
220	Qwen3-235B-A22B	0.00	71.10	0.00	98.00	85.70	70.70	2350B	Free commercial
221	Step3	0.00	73.00	0.00	0.00	0.00	67.10	3210B	Free commercial
222	Qwen3-4B-2507	0.00	62.00	0.00	0.00	0.00	35.10	40B	Free commercial
223	GLM-4.7-Flash	0.00	75.20	59.20	0.00	0.00	0.00	310B	Free commercial
224	ERNIE-4.5-VL-424B-A47B-Base	0.00	76.80	0.00	0.00	0.00	38.80	4240B	Free commercial
225	Claude Sonnet 3.7	0.00	77.00	0.00	0.00	0.00	0.00	—	不开源
226	GPT-5	0.00	77.80	0.00	0.00	0.00	0.00	—	不开源
227	Gemini 2.5 Flash	0.00	78.30	50.00	0.00	88.00	41.10	—	不开源
228	OpenAI o3-mini (high)	0.00	79.70	49.30	97.90	87.00	69.50	—	不开源
229	Grok 3	0.00	80.40	0.00	0.00	84.20	70.60	—	不开源
230	Claude Opus 4.1	0.00	80.90	74.50	0.00	0.00	65.00	—	不开源
231	DeepSeek V3.2	0.00	82.40	70.20	0.00	0.00	83.30	6710B	Free commercial
232	GPT-5.4 nano	0.00	82.80	0.00	0.00	0.00	0.00	—	不开源
233	Gemini 2.5 Flash	0.00	82.80	48.90	0.00	0.00	55.40	—	不开源
234	GLM-4.6	0.00	82.90	68.00	0.00	0.00	84.50	3550B	Free commercial
235	Gemini-2.5-Pro-Preview-05-06	0.00	83.00	63.20	98.80	92.00	77.10	—	不开源
236	OpenAI o3	0.00	83.30	69.10	0.00	0.00	0.00	—	不开源

OpenAI o1

MMLU Pro91.04

GPQA Diamond77.30

SWE-bench Verified48.90

MATH-50096.40

AIME 202479.20

LiveCodeBench71.00

不开源

Gemini 3.0 Pro (Preview 11-2025)

MMLU Pro90.00

GPQA Diamond91.90

SWE-bench Verified76.20

MATH-5000.00

AIME 20240.00

LiveCodeBench92.00

不开源

Claude Opus 4.5

MMLU Pro90.00

GPQA Diamond87.00

SWE-bench Verified80.90

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

Claude Opus 4.1

MMLU Pro88.00

GPQA Diamond81.00

SWE-bench Verified74.50

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

M2.1

2300B

MMLU Pro88.00

GPQA Diamond81.00

SWE-bench Verified74.80

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

Claude Sonnet 4.5

MMLU Pro88.00

GPQA Diamond83.40

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench71.00

不开源

Qwen3.5-397B-A17B

397B

MMLU Pro87.80

GPQA Diamond88.40

SWE-bench Verified76.40

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

Qwen3.5-397B-A17B

397B

MMLU Pro87.80

GPQA Diamond88.40

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench83.60

Free commercial

Hunyuan-T1

MMLU Pro87.20

GPQA Diamond69.30

SWE-bench Verified0.00

MATH-50096.20

AIME 202478.20

LiveCodeBench64.90

不开源

Grok 4

MMLU Pro87.00

GPQA Diamond87.00

SWE-bench Verified58.60

MATH-5000.00

AIME 20240.00

LiveCodeBench82.00

不开源

GPT-4.5

MMLU Pro86.10

GPQA Diamond71.40

SWE-bench Verified38.00

MATH-50090.70

AIME 202436.70

LiveCodeBench46.40

不开源

Qwen3.5-27B

270B

MMLU Pro86.10

GPQA Diamond85.50

SWE-bench Verified72.40

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

Gemini 2.5-Pro

MMLU Pro86.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-50098.80

AIME 202492.00

LiveCodeBench77.10

不开源

Qwen3-Max-Thinking

10000B

MMLU Pro85.70

GPQA Diamond87.40

SWE-bench Verified75.30

MATH-5000.00

AIME 20240.00

LiveCodeBench85.90

不开源

OpenAI o3

MMLU Pro85.60

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-50098.10

AIME 202491.60

LiveCodeBench75.80

不开源

DeepSeek-R1-0528

6710B

MMLU Pro85.00

GPQA Diamond81.00

SWE-bench Verified57.60

MATH-50098.00

AIME 202491.40

LiveCodeBench73.30

Free commercial

Grok 4.1 Fast

MMLU Pro85.00

GPQA Diamond85.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench82.00

不开源

DeepSeek V3.2-Exp

6710B

MMLU Pro85.00

GPQA Diamond79.90

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench74.10

Free commercial

DeepSeek-V3.1 Terminus

6710B

MMLU Pro85.00

GPQA Diamond80.70

SWE-bench Verified68.40

MATH-5000.00

AIME 20240.00

LiveCodeBench74.90

Free commercial

DeepSeek-V3.1 Terminus

6710B

MMLU Pro85.00

GPQA Diamond79.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench80.00

Free commercial

DeepSeek-V3.1

6710B

MMLU Pro85.00

GPQA Diamond80.10

SWE-bench Verified0.00

MATH-5000.00

AIME 202493.10

LiveCodeBench74.80

Free commercial

Claude Opus 4

MMLU Pro85.00

GPQA Diamond79.60

SWE-bench Verified72.50

MATH-50098.20

AIME 202476.00

LiveCodeBench56.60

不开源

GLM-4.5

3550B

MMLU Pro84.60

GPQA Diamond79.10

SWE-bench Verified64.20

MATH-50098.20

AIME 202491.00

LiveCodeBench72.90

Free commercial

Kimi K2 Thinking

10400B

MMLU Pro84.60

GPQA Diamond84.50

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench83.10

Free commercial

Qwen3-235B-A22B-Thinking

305B

MMLU Pro84.40

GPQA Diamond81.10

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench74.10

Free commercial

Qwen3-235B-A22B-Thinking-2507

2350B

MMLU Pro84.40

GPQA Diamond81.10

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench74.10

Free commercial

GLM-4.7

3580B

MMLU Pro84.30

GPQA Diamond85.70

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench84.90

Free commercial

DeepSeek-R1

6710B

MMLU Pro84.00

GPQA Diamond71.50

SWE-bench Verified49.20

MATH-50097.30

AIME 202479.80

LiveCodeBench65.90

Free commercial

Claude Sonnet 4

MMLU Pro84.00

GPQA Diamond75.40

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench66.00

不开源

Qwen3 Max (Preview)

MMLU Pro84.00

GPQA Diamond76.00

SWE-bench Verified69.60

MATH-5000.00

AIME 20240.00

LiveCodeBench57.50

不开源

DeepSeek V3.2-Exp

6710B

MMLU Pro84.00

GPQA Diamond74.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench55.00

Free commercial

DeepSeek-V3.1

6710B

MMLU Pro83.70

GPQA Diamond74.90

SWE-bench Verified66.00

MATH-5000.00

AIME 202466.30

LiveCodeBench56.40

Free commercial

Intern-S1

2410B

MMLU Pro83.50

GPQA Diamond77.30

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

Qwen3-235B-A22B-2507

2350B

MMLU Pro83.00

GPQA Diamond77.50

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench51.80

Free commercial

GLM-4.6

3550B

MMLU Pro83.00

GPQA Diamond81.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench82.80

Free commercial

Pangu Pro MoE

719B

MMLU Pro82.60

GPQA Diamond73.70

SWE-bench Verified0.00

MATH-50096.80

AIME 202479.20

LiveCodeBench59.60

Free commercial

Llama 4 Behemoth Instruct

20000B

MMLU Pro82.20

GPQA Diamond73.70

SWE-bench Verified0.00

MATH-50095.00

AIME 20240.00

LiveCodeBench49.40

Free commercial

MiniMax M2

2300B

MMLU Pro82.00

GPQA Diamond78.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench83.00

Free commercial

GLM-4.5-Air

1060B

MMLU Pro81.40

GPQA Diamond75.00

SWE-bench Verified57.60

MATH-50098.10

AIME 202489.40

LiveCodeBench70.70

Free commercial

DeepSeek-V3-0324

6710B

MMLU Pro81.20

GPQA Diamond68.40

SWE-bench Verified38.80

MATH-50094.00

AIME 202459.40

LiveCodeBench49.20

Free commercial

MiniMax-M1-80k

4560B

MMLU Pro81.10

GPQA Diamond70.00

SWE-bench Verified56.00

MATH-50096.80

AIME 202486.00

LiveCodeBench65.00

Free commercial

Kimi K2

10000B

MMLU Pro81.10

GPQA Diamond75.10

SWE-bench Verified51.80

MATH-50097.40

AIME 202469.60

LiveCodeBench53.70

Free commercial

OpenAI o4 - mini

MMLU Pro80.60

GPQA Diamond81.40

SWE-bench Verified68.10

MATH-5000.00

AIME 202493.40

LiveCodeBench0.00

不开源

MiniMax-M1-40k

4560B

MMLU Pro80.60

GPQA Diamond69.20

SWE-bench Verified55.60

MATH-50096.00

AIME 202483.30

LiveCodeBench62.30

Free commercial

GPT-4.1

MMLU Pro80.50

GPQA Diamond66.30

SWE-bench Verified54.60

MATH-50092.80

AIME 202448.10

LiveCodeBench40.50

不开源

Llama 4 Maverick Instruct

4000B

MMLU Pro80.50

GPQA Diamond69.80

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench43.40

Free commercial

OpenAI o1-mini

MMLU Pro80.30

GPQA Diamond60.00

SWE-bench Verified0.00

MATH-50090.00

AIME 202463.60

LiveCodeBench52.00

不开源

Haiku 4.5

MMLU Pro80.00

GPQA Diamond73.30

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench62.00

不开源

GPT-4o(2025-03-27)

MMLU Pro79.80

GPQA Diamond66.90

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench35.80

不开源

Gemini 2.0 Pro Experimental

MMLU Pro79.10

GPQA Diamond64.70

SWE-bench Verified0.00

MATH-5000.00

AIME 202436.00

LiveCodeBench0.00

不开源

Hunyuan-TurboS

MMLU Pro79.00

GPQA Diamond57.50

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench32.00

不开源

Pangu Embedded

70B

MMLU Pro79.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-50092.40

AIME 202481.90

LiveCodeBench67.10

Free commercial

GPT OSS 120B

117B

MMLU Pro79.00

GPQA Diamond80.10

SWE-bench Verified60.10

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

Kimi K2.5

10000B

MMLU Pro78.50

GPQA Diamond87.60

SWE-bench Verified76.80

MATH-5000.00

AIME 20240.00

LiveCodeBench85.00

Free commercial

ERNIE-4.5-300B-A47B

3000B

MMLU Pro78.40

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-50096.40

AIME 202454.80

LiveCodeBench38.80

Free commercial

Qwen3-30B-A3B-2507

305B

MMLU Pro78.40

GPQA Diamond70.40

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench43.20

Free commercial

Claude 3.5 Sonnet New

MMLU Pro78.00

GPQA Diamond65.00

SWE-bench Verified49.00

MATH-50078.00

AIME 202416.00

LiveCodeBench38.70

不开源

GLM-4.6

3550B

MMLU Pro78.00

GPQA Diamond63.00

SWE-bench Verified68.00

MATH-5000.00

AIME 20240.00

LiveCodeBench56.00

Free commercial

GPT-5-mini

MMLU Pro78.00

GPQA Diamond69.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench55.00

不开源

GPT-4o

MMLU Pro77.90

GPQA Diamond70.10

SWE-bench Verified31.00

MATH-50075.90

AIME 20249.30

LiveCodeBench35.10

不开源

GPT-4o(2024-11-20)

MMLU Pro77.90

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

Claude 3.5 Sonnet

MMLU Pro77.64

GPQA Diamond59.40

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

Gemini 2.0 Flash Experimental

MMLU Pro76.24

GPQA Diamond65.20

SWE-bench Verified21.40

MATH-5000.00

AIME 20240.00

LiveCodeBench29.10

不开源

Gemini 1.5 Pro

MMLU Pro76.10

GPQA Diamond53.50

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

Qwen2.5-Max

MMLU Pro76.10

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

Haiku 4.5

MMLU Pro76.00

GPQA Diamond60.50

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench51.00

不开源

QwQ-32B

325B

MMLU Pro76.00

GPQA Diamond58.00

SWE-bench Verified0.00

MATH-50091.00

AIME 202479.50

LiveCodeBench0.00

Free commercial

DeepSeek-V3

6810B

MMLU Pro75.90

GPQA Diamond59.10

SWE-bench Verified0.00

MATH-50087.80

AIME 202439.00

LiveCodeBench34.60

Free commercial

Grok 2

2690B

MMLU Pro75.50

GPQA Diamond56.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

Llama 4 Scout Instruct

1090B

MMLU Pro74.30

GPQA Diamond57.20

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench32.80

Free commercial

GPT OSS 20B

210B

MMLU Pro74.00

GPQA Diamond71.50

SWE-bench Verified34.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

Llama3.1-405B Instruct

4050B

MMLU Pro73.40

GPQA Diamond49.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench30.20

Free commercial

Qwen3-235B-A22B

2350B

MMLU Pro72.90

GPQA Diamond71.10

SWE-bench Verified34.40

MATH-50096.20

AIME 202485.70

LiveCodeBench70.70

Free commercial

Qwen3-8B

80B

MMLU Pro72.50

GPQA Diamond39.30

SWE-bench Verified0.00

MATH-50087.40

AIME 202479.40

LiveCodeBench61.80

Free commercial

GLM-4-9B-Chat

90B

MMLU Pro72.40

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 202476.40

LiveCodeBench51.80

Free commercial

Gemini 2.0 Flash-Lite

MMLU Pro71.60

GPQA Diamond51.50

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench28.90

不开源

QwQ-32B-Preview

320B

MMLU Pro70.97

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-50090.60

AIME 202450.00

LiveCodeBench0.00

Free commercial

Phi 4 - 14B

140B

MMLU Pro70.40

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Non-commercial

Qwen2.5-32B

320B

MMLU Pro69.23

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench51.20

Free commercial

Qwen3-30B-A3B

305B

MMLU Pro69.10

GPQA Diamond54.80

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench29.00

Free commercial

Mistral-Small-3.2

240B

MMLU Pro69.06

GPQA Diamond46.13

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

Llama3.3-70B-Instruct

700B

MMLU Pro68.90

GPQA Diamond50.50

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench33.30

Free commercial

Claude3-Opus

MMLU Pro68.45

GPQA Diamond50.40

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

Gemma 3 - 27B (IT)

270B

MMLU Pro67.50

GPQA Diamond42.40

SWE-bench Verified0.00

MATH-5000.00

AIME 202425.30

LiveCodeBench29.70

Free commercial

Hunyuan-A13B-Instruct

800B

MMLU Pro67.23

GPQA Diamond71.20

SWE-bench Verified0.00

MATH-5000.00

AIME 202487.30

LiveCodeBench63.90

Free commercial

Mistral-Small-3.1-24B-Instruct-2503

240B

MMLU Pro66.76

GPQA Diamond45.96

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

Llama3.1-70B-Instruct

700B

MMLU Pro66.40

GPQA Diamond48.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench33.30

Free commercial

Qwen3-Next

800B

MMLU Pro66.05

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench56.60

Free commercial

Claude 3.5 Haiku

MMLU Pro65.00

GPQA Diamond41.60

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

Qwen2.5-14B

140B

MMLU Pro63.69

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

Llama 4 Maverick

4000B

MMLU Pro62.90

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

GPT-4o mini

MMLU Pro61.70

GPQA Diamond41.10

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

Llama3.1-405B

4050B

MMLU Pro61.60

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

Gemma 3 - 12B (IT)

120B

MMLU Pro60.60

GPQA Diamond40.90

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench24.60

Free commercial

Llama 4 Scout

1090B

MMLU Pro58.20

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

Qwen2.5-72B

727B

MMLU Pro58.10

GPQA Diamond45.90

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

Claude3-Sonnet

MMLU Pro56.80

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

Gemma2-27B

270B

MMLU Pro56.54

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

Mixtral-8x22B-Instruct-v0.1

1410B

MMLU Pro56.33

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

100

Llama3-70B-Instruct

700B

MMLU Pro56.20

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

101

Phi-4-mini-instruct (3.8B)

38B

MMLU Pro52.80

GPQA Diamond36.00

SWE-bench Verified0.00

MATH-50071.80

AIME 202410.00

LiveCodeBench0.00

Free commercial

102

Llama3-70B

700B

MMLU Pro52.78

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

103

Llama3.1-70B

700B

MMLU Pro52.47

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

104

Grok-1.5

MMLU Pro51.00

GPQA Diamond35.90

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

105

C4AI Aya Vision 32B

320B

MMLU Pro47.16

GPQA Diamond33.84

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Non-commercial

106

Qwen2.5-7B

70B

MMLU Pro45.00

GPQA Diamond36.40

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

107

Gemma 2 - 9B

90B

MMLU Pro44.70

GPQA Diamond32.80

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

108

Llama3.1-8B-Instruct

80B

MMLU Pro44.00

GPQA Diamond26.30

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

109

Moonlight-16B-A3B-Instruct

160B

MMLU Pro42.40

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

110

Llama3.1-8B

80B

MMLU Pro35.40

GPQA Diamond25.80

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

111

Qwen2.5-3B

30B

MMLU Pro34.60

GPQA Diamond24.30

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

112

Mistral-7B-Instruct-v0.3

70B

MMLU Pro30.90

GPQA Diamond24.70

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

113

Llama-3.2-3B

32B

MMLU Pro25.00

GPQA Diamond26.60

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

114

GPT-5.1-Codex-Max

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified76.80

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

115

Qwen3.5-397B-A17B

397B

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified76.40

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

116

GPT-5.1

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified76.30

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

117

o3-pro

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified75.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

118

GPT-5 Codex

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified74.50

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

119

Step 3.5 Flash

1960B

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified74.40

MATH-5000.00

AIME 20240.00

LiveCodeBench86.40

Free commercial

120

GLM-4.7

3580B

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified73.80

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

121

Grok 4 Heavy

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified73.50

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

122

Haiku 4.5

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified73.30

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

123

DeepSeek V3.2

6710B

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified73.10

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

124

Claude Sonnet 4

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified72.70

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

125

Grok 4 Code

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified72.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

126

Kimi K2 Thinking

10400B

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified71.30

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

127

Hunyuan-7B

70B

MMLU Pro0.00

GPQA Diamond60.10

SWE-bench Verified0.00

MATH-50093.70

AIME 202481.10

LiveCodeBench57.00

Free commercial

128

Grok Code Fast 1

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified70.80

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

129

Claude Sonnet 4.5

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified77.20

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

130

Claude Opus 4.1

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified79.40

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

131

GPT-5.2

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified80.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

132

MiniMax M2.5

2290B

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified80.20

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

133

Claude Sonnet 4

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified80.20

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

134

Gemini 3.1 Pro Preview

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified80.60

MATH-5000.00

AIME 20240.00

LiveCodeBench2887.00

不开源

135

Claude Opus 4.6

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified80.84

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

136

Claude Sonnet 5

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified82.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

137

Claude Sonnet 4.5

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified82.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

138

GPT-5-mini

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

139

Grok 3.5

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

140

Phi-4-instruct (reasoning-trained)

38B

MMLU Pro0.00

GPQA Diamond49.00

SWE-bench Verified0.00

MATH-50090.40

AIME 202450.00

LiveCodeBench0.00

不开源

141

DeepSeek-R1-Distill-Qwen-7B

70B

MMLU Pro0.00

GPQA Diamond49.50

SWE-bench Verified0.00

MATH-50091.40

AIME 202453.30

LiveCodeBench0.00

Free commercial

142

GPT-4.1 nano

MMLU Pro0.00

GPQA Diamond50.30

SWE-bench Verified0.00

MATH-5000.00

AIME 202429.40

LiveCodeBench0.00

不开源

143

Qwen3-32B

320B

MMLU Pro0.00

GPQA Diamond53.30

SWE-bench Verified0.00

MATH-5000.00

AIME 202481.40

LiveCodeBench65.70

Free commercial

144

Qwen3-30B-A3B-2507

305B

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified22.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

145

Codestral

220B

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench31.50

Non-commercial

146

Codestral 25.01

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench37.90

不开源

147

QwQ-Max-Preview

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench65.60

Free commercial

148

Kimi-k1.6-IOI

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench65.90

不开源

149

OpenAI o3-mini (medium)

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench67.40

不开源

150

Kimi-k1.6-IOI-high

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench73.80

不开源

151

Gemini 2.5 Pro Deep Think

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench80.40

不开源

152

Qwen3.5-397B-A17B

397B

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench83.60

Free commercial

153

Claude Opus 4.5

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench87.00

不开源

154

Gemini 2.5 Deep Think

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench87.60

不开源

155

GPT OSS 20B

210B

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 202496.00

LiveCodeBench0.00

Free commercial

156

GPT OSS 120B

117B

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 202496.60

LiveCodeBench0.00

Free commercial

157

OpenAI o4 - mini

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 202498.70

LiveCodeBench0.00

不开源

158

Kimi k1.5 (Short-CoT)

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-50094.60

AIME 20240.00

LiveCodeBench0.00

不开源

159

Kimi k1.5 (Long-CoT)

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-50096.20

AIME 20240.00

LiveCodeBench0.00

不开源

160

Qwen3-Coder-Next

80B

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified70.60

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

161

Devstral Small 1.0

240B

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified46.80

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

162

Qwen3-Coder-Flash

305B

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified51.60

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

163

Devstral Small 1.1

240B

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified53.60

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

164

Gemini 2.5 Flash-Preview-09-2025

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified54.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

165

Haiku 4.5

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified60.60

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

166

Devstral Medium

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified61.60

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

167

Claude Sonnet 3.7

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified62.30

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

168

Qwen3-Coder-480B-A35B

4800B

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified67.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

169

DeepSeek V3.2-Exp

6710B

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified67.80

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

170

Kimi K2 0905

10000B

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified69.20

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

171

Kimi K2 0905

10000B

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified69.20

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

172

MiniMax M2

2300B

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified69.40

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

173

Claude Sonnet 3.7

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified70.30

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

174

GPT-5.1 Codex

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified70.40

MATH-5000.00

AIME 20240.00

LiveCodeBench85.50

不开源

175

GPT-5-Pro

MMLU Pro0.00

GPQA Diamond88.40

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

176

o3-pro

MMLU Pro0.00

GPQA Diamond84.00

SWE-bench Verified0.00

MATH-5000.00

AIME 202493.00

LiveCodeBench0.00

不开源

177

Gemini 2.5 Pro Experimental 03-25

MMLU Pro0.00

GPQA Diamond84.00

SWE-bench Verified63.80

MATH-5000.00

AIME 202492.00

LiveCodeBench70.40

不开源

178

Grok-3 mini - Reasoning

MMLU Pro0.00

GPQA Diamond84.00

SWE-bench Verified0.00

MATH-5000.00

AIME 202496.00

LiveCodeBench0.00

不开源

179

Grok-3 - Reasoning Beta

MMLU Pro0.00

GPQA Diamond84.60

SWE-bench Verified0.00

MATH-5000.00

AIME 202493.30

LiveCodeBench79.40

不开源

180

Claude Sonnet 3.7-64K Extended Thinking

MMLU Pro0.00

GPQA Diamond84.80

SWE-bench Verified0.00

MATH-50096.20

AIME 202480.00

LiveCodeBench0.00

不开源

181

MiniMax M2.5

2290B

MMLU Pro0.00

GPQA Diamond85.20

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

182

Grok 4 Fast

MMLU Pro0.00

GPQA Diamond85.70

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench80.00

不开源

183

GPT-5

MMLU Pro0.00

GPQA Diamond85.70

SWE-bench Verified72.80

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

184

GLM-5

7440B

MMLU Pro0.00

GPQA Diamond86.00

SWE-bench Verified77.80

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

185

Gemini 2.5-Pro

MMLU Pro0.00

GPQA Diamond86.40

SWE-bench Verified67.20

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

186

GPT-5

MMLU Pro0.00

GPQA Diamond87.30

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

187

GPT-5.4 mini

MMLU Pro0.00

GPQA Diamond88.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

188

GPT-5.1

MMLU Pro0.00

GPQA Diamond88.10

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

189

GPT-5.1

MMLU Pro0.00

GPQA Diamond88.10

SWE-bench Verified76.30

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

190

GPT-5.1

MMLU Pro0.00

GPQA Diamond88.10

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

191

Claude Sonnet 4

MMLU Pro0.00

GPQA Diamond83.80

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

192

Grok 4 Heavy

MMLU Pro0.00

GPQA Diamond88.90

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

193

GPT-5-Pro

MMLU Pro0.00

GPQA Diamond89.40

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

194

Claude Sonnet 4.6

MMLU Pro0.00

GPQA Diamond89.90

SWE-bench Verified79.60

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

195

Gemini 3.0 Flash

MMLU Pro0.00

GPQA Diamond90.40

SWE-bench Verified68.70

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

196

Gemini 3.0 Pro (Preview 11-2025)

MMLU Pro0.00

GPQA Diamond91.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

197

Claude Opus 4.6

MMLU Pro0.00

GPQA Diamond91.31

SWE-bench Verified0.00

MATH-50097.60

AIME 20240.00

LiveCodeBench76.00

不开源

198

GPT-5.2

MMLU Pro0.00

GPQA Diamond92.40

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

199

GPT-5.4

MMLU Pro0.00

GPQA Diamond92.80

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

200

GPT-5.2 Pro

MMLU Pro0.00

GPQA Diamond93.20

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

201

GPT-5.2

MMLU Pro0.00

GPQA Diamond93.20

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

202

Gemini 3.0 Pro (Preview 11-2025)

MMLU Pro0.00

GPQA Diamond93.80

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

203

Gemini 3.1 Pro Preview

MMLU Pro0.00

GPQA Diamond94.30

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

204

GPT-5.4 Pro

MMLU Pro0.00

GPQA Diamond94.40

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

205

Amazon Nova Pro

MMLU Pro0.00

GPQA Diamond0.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

206

Claude Sonnet 4.5

MMLU Pro0.00

GPQA Diamond73.70

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench59.00

不开源

207

Qwen3-8B

80B

MMLU Pro0.00

GPQA Diamond62.00

SWE-bench Verified0.00

MATH-50097.40

AIME 202476.00

LiveCodeBench57.50

Free commercial

208

GPT-4.1 mini

MMLU Pro0.00

GPQA Diamond65.00

SWE-bench Verified23.60

MATH-5000.00

AIME 202449.60

LiveCodeBench0.00

不开源

209

Grok 3 mini

MMLU Pro0.00

GPQA Diamond65.00

SWE-bench Verified0.00

MATH-5000.00

AIME 202440.00

LiveCodeBench0.00

不开源

210

DeepSeek-R1-Distill-Llama-70B

700B

MMLU Pro0.00

GPQA Diamond65.20

SWE-bench Verified0.00

MATH-50094.50

AIME 20240.00

LiveCodeBench0.00

Free commercial

211

Qwen3-4B-Thinking-2507

40B

MMLU Pro0.00

GPQA Diamond65.80

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench55.20

Free commercial

212

GLM-4.7-Flash

310B

MMLU Pro0.00

GPQA Diamond66.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

213

Gemini 2.5 Flash-Lite

MMLU Pro0.00

GPQA Diamond66.70

SWE-bench Verified27.60

MATH-5000.00

AIME 20240.00

LiveCodeBench34.30

不开源

214

Claude Sonnet 4

MMLU Pro0.00

GPQA Diamond68.00

SWE-bench Verified0.00

MATH-5000.00

AIME 202443.40

LiveCodeBench48.50

不开源

215

Claude Sonnet 3.7

MMLU Pro0.00

GPQA Diamond68.00

SWE-bench Verified0.00

MATH-50082.20

AIME 202423.30

LiveCodeBench0.00

不开源

216

Magistral-Small-2506

240B

MMLU Pro0.00

GPQA Diamond68.18

SWE-bench Verified0.00

MATH-5000.00

AIME 202470.68

LiveCodeBench55.84

Free commercial

217

Qwen3-32B

320B

MMLU Pro0.00

GPQA Diamond68.40

SWE-bench Verified0.00

MATH-50097.20

AIME 202481.40

LiveCodeBench0.00

Free commercial

218

OpenAI o3-mini

MMLU Pro0.00

GPQA Diamond70.60

SWE-bench Verified40.80

MATH-50095.80

AIME 202460.00

LiveCodeBench0.00

不开源

219

Magistral-Medium-2506

MMLU Pro0.00

GPQA Diamond70.83

SWE-bench Verified0.00

MATH-5000.00

AIME 202473.59

LiveCodeBench59.36

不开源

220

Qwen3-235B-A22B

2350B

MMLU Pro0.00

GPQA Diamond71.10

SWE-bench Verified0.00

MATH-50098.00

AIME 202485.70

LiveCodeBench70.70

Free commercial

221

Step3

3210B

MMLU Pro0.00

GPQA Diamond73.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench67.10

Free commercial

222

Qwen3-4B-2507

40B

MMLU Pro0.00

GPQA Diamond62.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench35.10

Free commercial

223

GLM-4.7-Flash

310B

MMLU Pro0.00

GPQA Diamond75.20

SWE-bench Verified59.20

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

Free commercial

224

ERNIE-4.5-VL-424B-A47B-Base

4240B

MMLU Pro0.00

GPQA Diamond76.80

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench38.80

Free commercial

225

Claude Sonnet 3.7

MMLU Pro0.00

GPQA Diamond77.00

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

226

GPT-5

MMLU Pro0.00

GPQA Diamond77.80

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

227

Gemini 2.5 Flash

MMLU Pro0.00

GPQA Diamond78.30

SWE-bench Verified50.00

MATH-5000.00

AIME 202488.00

LiveCodeBench41.10

不开源

228

OpenAI o3-mini (high)

MMLU Pro0.00

GPQA Diamond79.70

SWE-bench Verified49.30

MATH-50097.90

AIME 202487.00

LiveCodeBench69.50

不开源

229

Grok 3

MMLU Pro0.00

GPQA Diamond80.40

SWE-bench Verified0.00

MATH-5000.00

AIME 202484.20

LiveCodeBench70.60

不开源

230

Claude Opus 4.1

MMLU Pro0.00

GPQA Diamond80.90

SWE-bench Verified74.50

MATH-5000.00

AIME 20240.00

LiveCodeBench65.00

不开源

231

DeepSeek V3.2

6710B

MMLU Pro0.00

GPQA Diamond82.40

SWE-bench Verified70.20

MATH-5000.00

AIME 20240.00

LiveCodeBench83.30

Free commercial

232

GPT-5.4 nano

MMLU Pro0.00

GPQA Diamond82.80

SWE-bench Verified0.00

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源

233

Gemini 2.5 Flash

MMLU Pro0.00

GPQA Diamond82.80

SWE-bench Verified48.90

MATH-5000.00

AIME 20240.00

LiveCodeBench55.40

不开源

234

GLM-4.6

3550B

MMLU Pro0.00

GPQA Diamond82.90

SWE-bench Verified68.00

MATH-5000.00

AIME 20240.00

LiveCodeBench84.50

Free commercial

235

Gemini-2.5-Pro-Preview-05-06

MMLU Pro0.00

GPQA Diamond83.00

SWE-bench Verified63.20

MATH-50098.80

AIME 202492.00

LiveCodeBench77.10

不开源

236

OpenAI o3

MMLU Pro0.00

GPQA Diamond83.30

SWE-bench Verified69.10

MATH-5000.00

AIME 20240.00

LiveCodeBench0.00

不开源