LLM Agent Benchmark Leaderboard

Name: LLM Agent Benchmark Leaderboard
Creator: DataLearner
License: https://creativecommons.org/licenses/by/4.0/

This page provides the LLM Agent benchmark leaderboard, covering Aider-Polyglot, τ²-Bench, Terminal Bench 2.0, Tool Decathlon, and OSWorld-Verified. Compare GPT, Claude, Qwen, and DeepSeek on tool use, task planning, and autonomous execution.

Updated on 2026-09-14 15:33:45

As of 2026-09, this page covers Aider-Polyglot, τ²-Bench, Terminal Bench 2.0, Tool Decathlon and related benchmarks for LLM Agent Benchmark Leaderboard, making it straightforward to compare within the same task family.

Click any model name to check context length, licensing, and pricing on its detail page. See Data Methodology for scoring details.

Benchmark

Agent能力评测Aider-Polyglot τ²-Bench

AI Agent - 工具使用Terminal Bench 2.0 Tool Decathlon OSWorld-Verified

More Benchmarks

Model Size:All 3B and below 7B 13B 34B 65B 100B and above

Model Type:All Reasoning Models Foundation Models Instruction/Chat Models Coding Models

Source:All Open Source Closed Source

Origin:All China

Model release cutoff:

Top picks

Ranked by Aider-Polyglot

Current SOTA

DeepSeek V3.2-Exp

DeepSeek-AI

74.20Aider-Polyglot

View model

Best Open-Source

DeepSeek V3.2-Exp

DeepSeek-AI

74.20Aider-Polyglot

View model

Best China-Made

DeepSeek V3.2-Exp

DeepSeek-AI

74.20Aider-Polyglot

View model

LLM Performance Results

Data source: DataLearnerAI

Click any row to open the model page. Tick the checkboxes to compare up to 4 models side by side.

Rank	Model						License
	DeepSeek V3.2-Exp Thinking Enabled DeepSeek-AI	74.20	—	—	—	—	Free commercial	Details
	DeepSeek-R1-0528 Thinking Enabled DeepSeek-AI	71.40	—	—	—	—	Free commercial	Details
	DeepSeek V3.2-Exp DeepSeek-AI	70.20	—	—	—	—	Free commercial	Details
4	Qwen3-235B-A22B 阿里巴巴	59.60	—	—	—	—	Free commercial	Details
5	Kimi K2 Moonshot AI	59.10	—	—	—	—	Free commercial	Details
6	DeepSeek-R1 Thinking Enabled DeepSeek-AI	56.90	—	—	—	—	Free commercial	Details
7	DeepSeek-V3-0324 DeepSeek-AI	55.10	—	—	—	—	Free commercial	Details
8	DeepSeek-V3 DeepSeek-AI	48.40	—	—	—	—	Free commercial	Details
9	Qwen3-32B 阿里巴巴	40.00	—	—	—	—	Free commercial	Details
10	Qwen2.5-Max 阿里巴巴	21.80	—	—	—	—	Proprietary	Details
11	QwQ-32B Thinking Enabled 阿里巴巴	20.90	—	—	—	—	Free commercial	Details
12	DeepSeek-V2-236B-Chat DeepSeek-AI	17.80	—	—	—	—	Free commercial	Details
13	Qwen2.5-Coder-32B-Instruct 阿里巴巴	16.40	—	—	—	—	Free commercial	Details
14	Qwen3.6-35B-A3B Thinking Enabled 阿里巴巴	—	—	51.50	26.90	—	Free commercial	Details
15	Qwen3.7 Max Thinking EnabledTools 阿里巴巴	—	—	69.70	—	—	Proprietary	Details
16	MiniMax M2.5 Thinking EnabledTools MiniMaxAI	—	—	51.70	—	—	Free commercial	Details
17	Doubao Seed 2.0 Pro Thinking EnabledTools 字节跳动Seed团队	—	—	55.80	—	—	Proprietary	Details
18	DeepSeek-V4-Flash Thinking EnabledTools DeepSeek-AI	—	—	56.60	—	—	Free commercial	Details
19	DeepSeek-V4-Flash Thinking Level · Extra HighTools DeepSeek-AI	—	—	56.90	—	—	Free commercial	Details
20	MiniMax-M2.7 Thinking EnabledTools MiniMaxAI	—	—	57.00	—	—	Non-commercial	Details
21	DeepSeek-V4-Pro Standard ModeTools DeepSeek-AI	—	—	59.10	—	—	Free commercial	Details
22	Qwen3.6-27B Thinking EnabledTools 阿里巴巴	—	—	59.30	—	—	Free commercial	Details
23	Qwen3.6-Max-Preview Thinking EnabledTools 阿里巴巴	—	—	61.60	—	—	Proprietary	Details
24	Qwen 3.6 Plus Preview Thinking EnabledTools 阿里巴巴	—	—	61.60	39.80	—	Proprietary	Details
25	DeepSeek-V4-Pro Thinking EnabledTools DeepSeek-AI	—	—	63.30	—	—	Free commercial	Details
26	GLM 5.1 Thinking EnabledTools 智谱AI	—	—	63.50	40.70	—	Free commercial	Details
27	Qwen3.6-Max-Preview Deep Thinking ModeTools 阿里巴巴	—	—	65.40	—	—	Proprietary	Details
28	Kimi K2.6 Thinking EnabledTools Moonshot AI	—	—	66.70	50.00	73.10	Free commercial	Details
29	DeepSeek-V4-Pro Thinking Level · Extra HighTools DeepSeek-AI	—	—	67.90	—	—	Free commercial	Details
30	MiniMax M3 Thinking EnabledTools MiniMaxAI	—	—	—	—	70.00	Non-commercial	Details
31	Qwen3.8-27B Thinking EnabledTools 阿里巴巴	—	—	—	—	84.30	Free commercial	Details
32	Kimi K3 Thinking Level · HighTools Moonshot AI	—	—	—	—	84.80	Conditional	Details
33	Kimi K2.5 Thinking EnabledTools Moonshot AI	—	—	50.80	—	—	Free commercial	Details
34	GLM-5.2 Thinking EnabledTools 智谱AI	—	—	—	48.20	—	Free commercial	Details
35	Hy3 Thinking EnabledTools 腾讯AI实验室	—	—	—	48.50	—	Free commercial	Details
36	Qwen3-Coder-Next Standard ModeTools 阿里巴巴	—	—	36.20	—	—	Free commercial	Details
37	M2.1 Thinking EnabledTools MiniMaxAI	—	—	47.90	—	—	Free commercial	Details
38	DeepSeek-V4-Flash Standard ModeTools DeepSeek-AI	—	—	49.10	—	—	Free commercial	Details
39	Qwen3 Max (Preview) Standard ModeTools 阿里巴巴	—	74.00	—	—	—	Proprietary	Details
40	GLM-4.6 Thinking EnabledTools 智谱AI	—	75.90	—	—	—	Free commercial	Details
41	MiniMax M2 Thinking EnabledTools MiniMaxAI	—	77.20	—	—	—	Free commercial	Details
42	ERNIE 5.0 Thinking Enabled 百度	—	78.79	—	—	—	Proprietary	Details
43	Qwen3.5-27B Thinking EnabledTools 阿里巴巴	—	79.00	41.60	—	56.20	Free commercial	Details
44	GLM-4.7-Flash Thinking EnabledTools 智谱AI	—	79.50	—	—	—	Free commercial	Details
45	DeepSeek V3.2 Thinking EnabledTools DeepSeek-AI	—	80.30	46.40	—	—	Free commercial	Details
46	Qwen3-Max-Thinking Thinking EnabledTools 阿里巴巴	—	82.10	—	—	—	Proprietary	Details
47	Qwen3.5-397B-A17B Thinking EnabledTools 阿里巴巴	—	86.70	52.50	38.30	62.20	Free commercial	Details
48	GLM-4.7 Thinking EnabledTools 智谱AI	—	87.40	41.00	—	—	Free commercial	Details
49	Step 3.5 Flash Thinking EnabledTools StepFunAI	—	88.20	51.00	—	—	Free commercial	Details
50	GLM-5 Thinking EnabledTools 智谱AI	—	89.70	61.10	—	—	Free commercial	Details

DeepSeek V3.2-Exp DeepSeek-AI

Thinking Enabled

Aider-Polyglot74.20

τ²-Bench—

Terminal Bench 2.0—

Tool Decathlon—

OSWorld-Verified—

Free commercial

DeepSeek-R1-0528 DeepSeek-AI

Thinking Enabled

Aider-Polyglot71.40

τ²-Bench—

Terminal Bench 2.0—

Tool Decathlon—

OSWorld-Verified—

Free commercial

DeepSeek V3.2-Exp DeepSeek-AI

Aider-Polyglot70.20

τ²-Bench—

Terminal Bench 2.0—

Tool Decathlon—

OSWorld-Verified—

Free commercial

Qwen3-235B-A22B 阿里巴巴

Aider-Polyglot59.60

τ²-Bench—

Terminal Bench 2.0—

Tool Decathlon—

OSWorld-Verified—

Free commercial

Kimi K2 Moonshot AI

Aider-Polyglot59.10

τ²-Bench—

Terminal Bench 2.0—

Tool Decathlon—

OSWorld-Verified—

Free commercial

DeepSeek-R1 DeepSeek-AI

Thinking Enabled

Aider-Polyglot56.90

τ²-Bench—

Terminal Bench 2.0—

Tool Decathlon—

OSWorld-Verified—

Free commercial

DeepSeek-V3-0324 DeepSeek-AI

Aider-Polyglot55.10

τ²-Bench—

Terminal Bench 2.0—

Tool Decathlon—

OSWorld-Verified—

Free commercial

DeepSeek-V3 DeepSeek-AI

Aider-Polyglot48.40

τ²-Bench—

Terminal Bench 2.0—

Tool Decathlon—

OSWorld-Verified—

Free commercial

Qwen3-32B 阿里巴巴

Aider-Polyglot40.00

τ²-Bench—

Terminal Bench 2.0—

Tool Decathlon—

OSWorld-Verified—

Free commercial

Qwen2.5-Max 阿里巴巴

Aider-Polyglot21.80

τ²-Bench—

Terminal Bench 2.0—

Tool Decathlon—

OSWorld-Verified—

Proprietary

QwQ-32B 阿里巴巴

Thinking Enabled

Aider-Polyglot20.90

τ²-Bench—

Terminal Bench 2.0—

Tool Decathlon—

OSWorld-Verified—

Free commercial

DeepSeek-V2-236B-Chat DeepSeek-AI

Aider-Polyglot17.80

τ²-Bench—

Terminal Bench 2.0—

Tool Decathlon—

OSWorld-Verified—

Free commercial

Qwen2.5-Coder-32B-Instruct 阿里巴巴

Aider-Polyglot16.40

τ²-Bench—

Terminal Bench 2.0—

Tool Decathlon—

OSWorld-Verified—

Free commercial

Qwen3.6-35B-A3B 阿里巴巴

Thinking Enabled

Aider-Polyglot—

τ²-Bench—

Terminal Bench 2.051.50

Tool Decathlon26.90

OSWorld-Verified—

Free commercial

Qwen3.7 Max 阿里巴巴

Thinking EnabledTools

Aider-Polyglot—

τ²-Bench—

Terminal Bench 2.069.70

Tool Decathlon—

OSWorld-Verified—

Proprietary

MiniMax M2.5 MiniMaxAI

Thinking EnabledTools

Aider-Polyglot—

τ²-Bench—

Terminal Bench 2.051.70

Tool Decathlon—

OSWorld-Verified—

Free commercial

Doubao Seed 2.0 Pro 字节跳动Seed团队

Thinking EnabledTools

Aider-Polyglot—

τ²-Bench—

Terminal Bench 2.055.80

Tool Decathlon—

OSWorld-Verified—

Proprietary

DeepSeek-V4-Flash DeepSeek-AI

Thinking EnabledTools

Aider-Polyglot—

τ²-Bench—

Terminal Bench 2.056.60

Tool Decathlon—

OSWorld-Verified—

Free commercial

DeepSeek-V4-Flash DeepSeek-AI

Thinking Level · Extra HighTools

Aider-Polyglot—

τ²-Bench—

Terminal Bench 2.056.90

Tool Decathlon—

OSWorld-Verified—

Free commercial

MiniMax-M2.7 MiniMaxAI

Thinking EnabledTools

Aider-Polyglot—

τ²-Bench—

Terminal Bench 2.057.00

Tool Decathlon—

OSWorld-Verified—

Non-commercial

DeepSeek-V4-Pro DeepSeek-AI

Standard ModeTools

Aider-Polyglot—

τ²-Bench—

Terminal Bench 2.059.10

Tool Decathlon—

OSWorld-Verified—

Free commercial

Qwen3.6-27B 阿里巴巴

Thinking EnabledTools

Aider-Polyglot—

τ²-Bench—

Terminal Bench 2.059.30

Tool Decathlon—

OSWorld-Verified—

Free commercial

Qwen3.6-Max-Preview 阿里巴巴

Thinking EnabledTools

Aider-Polyglot—

τ²-Bench—

Terminal Bench 2.061.60

Tool Decathlon—

OSWorld-Verified—

Proprietary

Qwen 3.6 Plus Preview 阿里巴巴

Thinking EnabledTools

Aider-Polyglot—

τ²-Bench—

Terminal Bench 2.061.60

Tool Decathlon39.80

OSWorld-Verified—

Proprietary

DeepSeek-V4-Pro DeepSeek-AI

Thinking EnabledTools

Aider-Polyglot—

τ²-Bench—

Terminal Bench 2.063.30

Tool Decathlon—

OSWorld-Verified—

Free commercial

GLM 5.1 智谱AI

Thinking EnabledTools

Aider-Polyglot—

τ²-Bench—

Terminal Bench 2.063.50

Tool Decathlon40.70

OSWorld-Verified—

Free commercial

Qwen3.6-Max-Preview 阿里巴巴

Deep Thinking ModeTools

Aider-Polyglot—

τ²-Bench—

Terminal Bench 2.065.40

Tool Decathlon—

OSWorld-Verified—

Proprietary

Kimi K2.6 Moonshot AI

Thinking EnabledTools

Aider-Polyglot—

τ²-Bench—

Terminal Bench 2.066.70

Tool Decathlon50.00

OSWorld-Verified73.10

Free commercial

DeepSeek-V4-Pro DeepSeek-AI

Thinking Level · Extra HighTools

Aider-Polyglot—

τ²-Bench—

Terminal Bench 2.067.90

Tool Decathlon—

OSWorld-Verified—

Free commercial

MiniMax M3 MiniMaxAI

Thinking EnabledTools

Aider-Polyglot—

τ²-Bench—

Terminal Bench 2.0—

Tool Decathlon—

OSWorld-Verified70.00

Non-commercial

Qwen3.8-27B 阿里巴巴

Thinking EnabledTools

Aider-Polyglot—

τ²-Bench—

Terminal Bench 2.0—

Tool Decathlon—

OSWorld-Verified84.30

Free commercial

Kimi K3 Moonshot AI

Thinking Level · HighTools

Aider-Polyglot—

τ²-Bench—

Terminal Bench 2.0—

Tool Decathlon—

OSWorld-Verified84.80

Conditional

Kimi K2.5 Moonshot AI

Thinking EnabledTools

Aider-Polyglot—

τ²-Bench—

Terminal Bench 2.050.80

Tool Decathlon—

OSWorld-Verified—

Free commercial

GLM-5.2 智谱AI

Thinking EnabledTools

Aider-Polyglot—

τ²-Bench—

Terminal Bench 2.0—

Tool Decathlon48.20

OSWorld-Verified—

Free commercial

Hy3 腾讯AI实验室

Thinking EnabledTools

Aider-Polyglot—

τ²-Bench—

Terminal Bench 2.0—

Tool Decathlon48.50

OSWorld-Verified—

Free commercial

Qwen3-Coder-Next 阿里巴巴

Standard ModeTools

Aider-Polyglot—

τ²-Bench—

Terminal Bench 2.036.20

Tool Decathlon—

OSWorld-Verified—

Free commercial

M2.1 MiniMaxAI

Thinking EnabledTools

Aider-Polyglot—

τ²-Bench—

Terminal Bench 2.047.90

Tool Decathlon—

OSWorld-Verified—

Free commercial

DeepSeek-V4-Flash DeepSeek-AI

Standard ModeTools

Aider-Polyglot—

τ²-Bench—

Terminal Bench 2.049.10

Tool Decathlon—

OSWorld-Verified—

Free commercial

Qwen3 Max (Preview)阿里巴巴

Standard ModeTools

Aider-Polyglot—

τ²-Bench74.00

Terminal Bench 2.0—

Tool Decathlon—

OSWorld-Verified—

Proprietary

GLM-4.6 智谱AI

Thinking EnabledTools

Aider-Polyglot—

τ²-Bench75.90

Terminal Bench 2.0—

Tool Decathlon—

OSWorld-Verified—

Free commercial

MiniMax M2 MiniMaxAI

Thinking EnabledTools

Aider-Polyglot—

τ²-Bench77.20

Terminal Bench 2.0—

Tool Decathlon—

OSWorld-Verified—

Free commercial

ERNIE 5.0 百度

Thinking Enabled

Aider-Polyglot—

τ²-Bench78.79

Terminal Bench 2.0—

Tool Decathlon—

OSWorld-Verified—

Proprietary

Qwen3.5-27B 阿里巴巴

Thinking EnabledTools

Aider-Polyglot—

τ²-Bench79.00

Terminal Bench 2.041.60

Tool Decathlon—

OSWorld-Verified56.20

Free commercial

GLM-4.7-Flash 智谱AI

Thinking EnabledTools

Aider-Polyglot—

τ²-Bench79.50

Terminal Bench 2.0—

Tool Decathlon—

OSWorld-Verified—

Free commercial

DeepSeek V3.2 DeepSeek-AI

Thinking EnabledTools

Aider-Polyglot—

τ²-Bench80.30

Terminal Bench 2.046.40

Tool Decathlon—

OSWorld-Verified—

Free commercial

Qwen3-Max-Thinking 阿里巴巴

Thinking EnabledTools

Aider-Polyglot—

τ²-Bench82.10

Terminal Bench 2.0—

Tool Decathlon—

OSWorld-Verified—

Proprietary

Qwen3.5-397B-A17B 阿里巴巴

Thinking EnabledTools

Aider-Polyglot—

τ²-Bench86.70

Terminal Bench 2.052.50

Tool Decathlon38.30

OSWorld-Verified62.20

Free commercial

GLM-4.7 智谱AI

Thinking EnabledTools

Aider-Polyglot—

τ²-Bench87.40

Terminal Bench 2.041.00

Tool Decathlon—

OSWorld-Verified—

Free commercial

Step 3.5 Flash StepFunAI

Thinking EnabledTools

Aider-Polyglot—

τ²-Bench88.20

Terminal Bench 2.051.00

Tool Decathlon—

OSWorld-Verified—

Free commercial

GLM-5 智谱AI

Thinking EnabledTools

Aider-Polyglot—

τ²-Bench89.70

Terminal Bench 2.061.10

Tool Decathlon—

OSWorld-Verified—

Free commercial

Sort by:

Showing 50 of 59 modelsView Aider-Polyglot benchmark page