LLM Agent Benchmark Leaderboard

Name: LLM Agent Benchmark Leaderboard
Creator: DataLearner
License: https://creativecommons.org/licenses/by/4.0/

This page provides the LLM Agent benchmark leaderboard, covering Aider-Polyglot, τ²-Bench, Terminal Bench 2.0, Tool Decathlon, and OSWorld-Verified. Compare GPT, Claude, Qwen, and DeepSeek on tool use, task planning, and autonomous execution.

Updated on 2026-06-13 11:57:39

As of 2026-06, this page covers Aider-Polyglot, τ²-Bench, Terminal Bench 2.0, Tool Decathlon and related benchmarks for LLM Agent Benchmark Leaderboard, making it straightforward to compare within the same task family.

Click any model name to check context length, licensing, and pricing on its detail page. See Data Methodology for scoring details.

Benchmark

Agent能力评测Aider-Polyglot τ²-Bench

AI Agent - 工具使用Terminal Bench 2.0 Tool Decathlon OSWorld-Verified

More Benchmarks

Model Size:All 3B and below 7B 13B 34B 65B 100B and above

Model Type:All Reasoning Models Foundation Models Instruction/Chat Models Coding Models

Source:All Open Source Closed Source

Origin:All China

Model release cutoff:

Top picks

Ranked by Aider-Polyglot

Current SOTA

o3-pro

OpenAI

84.90Aider-Polyglot

View model

Best Open-Source

DeepSeek-V3.1

DeepSeek-AI

76.30Aider-Polyglot−8.60

View model

Best China-Made

DeepSeek-V3.1

DeepSeek-AI

76.30Aider-Polyglot−8.60

View model

LLM Performance Results

Data source: DataLearnerAI

Click any row to open the model page. Tick the checkboxes to compare up to 4 models side by side.

Rank	Model						License
	o3-pro Thinking Level · High OpenAI	84.90	—	—	—	—	Proprietary	Details
	Gemini 2.5-Pro Thinking Enabled Google Deep Mind	83.10	—	—	—	—	Proprietary	Details
	OpenAI o3 Thinking Level · High OpenAI	81.30	—	—	—	—	Proprietary	Details
4	Grok 4 Thinking Enabled xAI	79.60	—	—	—	—	Proprietary	Details
5	DeepSeek-V3.1 Thinking Enabled DeepSeek-AI	76.30	—	—	—	—	Free commercial	Details
6	DeepSeek-V3.1 Terminus DeepSeek-AI	76.10	—	—	—	—	Free commercial	Details
7	DeepSeek V3.2-Exp Thinking EnabledTools DeepSeek-AI	74.50	66.70	—	—	—	Free commercial	Details
8	OpenAI o4 - mini Thinking Level · High OpenAI	72.00	—	—	—	—	Proprietary	Details
9	Claude Opus 4 Thinking Enabled Anthropic	72.00	—	—	—	—	Proprietary	Details
10	DeepSeek-R1-0528 Thinking Enabled DeepSeek-AI	71.40	—	—	—	—	Free commercial	Details
11	Claude Opus 4 Anthropic	70.10	—	—	—	—	Proprietary	Details
12	DeepSeek V3.2 Thinking EnabledTools DeepSeek-AI	69.90	80.30	46.40	—	—	Free commercial	Details
13	DeepSeek-V3.1 DeepSeek-AI	68.40	—	—	—	—	Free commercial	Details
14	Qwen3-Coder-Next Standard ModeTools 阿里巴巴	66.20	—	36.20	—	—	Free commercial	Details
15	Claude Sonnet 3.7 Thinking Enabled Anthropic	64.90	—	—	—	—	Proprietary	Details
16	Claude Sonnet 4 Thinking Enabled Anthropic	61.30	—	—	—	—	Proprietary	Details
17	M2.1 Thinking EnabledTools MiniMaxAI	61.00	—	47.90	—	—	Free commercial	Details
18	Claude Sonnet 3.7 Anthropic	60.40	—	—	—	—	Proprietary	Details
19	Kimi K2 Moonshot AI	59.10	—	—	—	—	Free commercial	Details
20	Gemini 2.5 Flash Thinking Enabled Google Deep Mind	56.70	—	—	—	—	Proprietary	Details
21	DeepSeek-V3-0324 DeepSeek-AI	55.10	—	—	—	—	Free commercial	Details
22	GLM-4.7 Thinking EnabledTools 智谱AI	52.10	87.40	41.00	—	—	Free commercial	Details
23	Claude 3.5 Sonnet New Anthropic	51.60	—	—	—	—	Proprietary	Details
24	Qwen3-Next 阿里巴巴	49.80	—	—	—	—	Free commercial	Details
25	Qwen3-32B Thinking Enabled 阿里巴巴	40.00	—	—	—	—	Free commercial	Details
26	GPT-4o(2025-03-27) OpenAI	27.10	—	—	—	—	Proprietary	Details
27	Claude Sonnet 4.6 Thinking EnabledTools Anthropic	—	—	59.10	—	72.50	Proprietary	Details
28	Qwen3.6-27B Thinking EnabledTools 阿里巴巴	—	—	59.30	—	—	Free commercial	Details
29	GPT-5.4 mini Thinking Level · Extra HighTools OpenAI	—	—	60.00	42.90	72.10	Proprietary	Details
30	Qwen3.6-Max-Preview Thinking EnabledTools 阿里巴巴	—	—	61.60	—	—	Proprietary	Details
31	Qwen 3.6 Plus Preview Thinking EnabledTools 阿里巴巴	—	—	61.60	39.80	—	Proprietary	Details
32	Composer 2 Thinking Enabled Cursor	—	—	61.70	—	—	Proprietary	Details
33	DeepSeek-V4-Pro Thinking EnabledTools DeepSeek-AI	—	—	63.30	—	—	Free commercial	Details
34	GLM 5.1 Thinking EnabledTools 智谱AI	—	—	63.50	40.70	—	Free commercial	Details
35	Qwen3.6-Max-Preview Deep Thinking ModeTools 阿里巴巴	—	—	65.40	—	—	Proprietary	Details
36	Kimi K2.6 Thinking EnabledTools Moonshot AI	—	—	66.70	50.00	73.10	Free commercial	Details
37	DeepSeek-V4-Pro Thinking Level · Extra HighTools DeepSeek-AI	—	—	67.90	—	—	Free commercial	Details
38	Composer 2.5 Thinking Enabled Cursor	—	—	69.30	—	—	Proprietary	Details
39	Opus 4.7 Extended ThinkingTools Anthropic	—	—	69.40	—	78.00	Proprietary	Details
40	Qwen3.7-Max-Preview Thinking EnabledTools 阿里巴巴	—	—	69.70	—	—	Proprietary	Details
41	GPT-5.4 Thinking Level · Extra HighTools OpenAI	—	—	75.10	—	75.00	Proprietary	Details
42	GPT-5.3 Codex Standard ModeTools OpenAI	—	—	77.30	—	—	Proprietary	Details
43	Claude Mythos Preview Extended ThinkingTools Anthropic	—	—	82.00	—	79.60	Proprietary	Details
44	Claude Sonnet 4 Thinking EnabledTools Anthropic	—	—	—	—	42.20	Proprietary	Details
45	GPT-5.5 Thinking EnabledTools OpenAI	—	—	82.70	—	78.70	Proprietary	Details
46	Composer 1.5 Thinking Enabled Cursor	—	—	47.90	—	—	Proprietary	Details
47	MiniMax M3 Thinking EnabledTools MiniMaxAI	—	—	—	—	70.00	Non-commercial	Details
48	Gemini 3.5 Flash Thinking EnabledTools Google Deep Mind	—	—	—	—	78.40	Proprietary	Details
49	Claude Opus 4.8 Extended ThinkingTools Anthropic	—	—	—	—	83.40	Proprietary	Details
50	Claude Fable 5 Thinking EnabledTools Anthropic	—	—	—	—	85.00	Proprietary	Details

o3-pro OpenAI

Thinking Level · High

Aider-Polyglot84.90

τ²-Bench—

Terminal Bench 2.0—

Tool Decathlon—

OSWorld-Verified—

Proprietary

Gemini 2.5-Pro Google Deep Mind

Thinking Enabled

Aider-Polyglot83.10

τ²-Bench—

Terminal Bench 2.0—

Tool Decathlon—

OSWorld-Verified—

Proprietary

OpenAI o3 OpenAI

Thinking Level · High

Aider-Polyglot81.30

τ²-Bench—

Terminal Bench 2.0—

Tool Decathlon—

OSWorld-Verified—

Proprietary

Grok 4 xAI

Thinking Enabled

Aider-Polyglot79.60

τ²-Bench—

Terminal Bench 2.0—

Tool Decathlon—

OSWorld-Verified—

Proprietary

DeepSeek-V3.1 DeepSeek-AI

Thinking Enabled

Aider-Polyglot76.30

τ²-Bench—

Terminal Bench 2.0—

Tool Decathlon—

OSWorld-Verified—

Free commercial

DeepSeek-V3.1 Terminus DeepSeek-AI

Aider-Polyglot76.10

τ²-Bench—

Terminal Bench 2.0—

Tool Decathlon—

OSWorld-Verified—

Free commercial

DeepSeek V3.2-Exp DeepSeek-AI

Thinking EnabledTools

Aider-Polyglot74.50

τ²-Bench66.70

Terminal Bench 2.0—

Tool Decathlon—

OSWorld-Verified—

Free commercial

OpenAI o4 - mini OpenAI

Thinking Level · High

Aider-Polyglot72.00

τ²-Bench—

Terminal Bench 2.0—

Tool Decathlon—

OSWorld-Verified—

Proprietary

Claude Opus 4 Anthropic

Thinking Enabled

Aider-Polyglot72.00

τ²-Bench—

Terminal Bench 2.0—

Tool Decathlon—

OSWorld-Verified—

Proprietary

DeepSeek-R1-0528 DeepSeek-AI

Thinking Enabled

Aider-Polyglot71.40

τ²-Bench—

Terminal Bench 2.0—

Tool Decathlon—

OSWorld-Verified—

Free commercial

Claude Opus 4 Anthropic

Aider-Polyglot70.10

τ²-Bench—

Terminal Bench 2.0—

Tool Decathlon—

OSWorld-Verified—

Proprietary

DeepSeek V3.2 DeepSeek-AI

Thinking EnabledTools

Aider-Polyglot69.90

τ²-Bench80.30

Terminal Bench 2.046.40

Tool Decathlon—

OSWorld-Verified—

Free commercial

DeepSeek-V3.1 DeepSeek-AI

Aider-Polyglot68.40

τ²-Bench—

Terminal Bench 2.0—

Tool Decathlon—

OSWorld-Verified—

Free commercial

Qwen3-Coder-Next 阿里巴巴

Standard ModeTools

Aider-Polyglot66.20

τ²-Bench—

Terminal Bench 2.036.20

Tool Decathlon—

OSWorld-Verified—

Free commercial

Claude Sonnet 3.7 Anthropic

Thinking Enabled

Aider-Polyglot64.90

τ²-Bench—

Terminal Bench 2.0—

Tool Decathlon—

OSWorld-Verified—

Proprietary

Claude Sonnet 4 Anthropic

Thinking Enabled

Aider-Polyglot61.30

τ²-Bench—

Terminal Bench 2.0—

Tool Decathlon—

OSWorld-Verified—

Proprietary

M2.1 MiniMaxAI

Thinking EnabledTools

Aider-Polyglot61.00

τ²-Bench—

Terminal Bench 2.047.90

Tool Decathlon—

OSWorld-Verified—

Free commercial

Claude Sonnet 3.7 Anthropic

Aider-Polyglot60.40

τ²-Bench—

Terminal Bench 2.0—

Tool Decathlon—

OSWorld-Verified—

Proprietary

Kimi K2 Moonshot AI

Aider-Polyglot59.10

τ²-Bench—

Terminal Bench 2.0—

Tool Decathlon—

OSWorld-Verified—

Free commercial

Gemini 2.5 Flash Google Deep Mind

Thinking Enabled

Aider-Polyglot56.70

τ²-Bench—

Terminal Bench 2.0—

Tool Decathlon—

OSWorld-Verified—

Proprietary

DeepSeek-V3-0324 DeepSeek-AI

Aider-Polyglot55.10

τ²-Bench—

Terminal Bench 2.0—

Tool Decathlon—

OSWorld-Verified—

Free commercial

GLM-4.7 智谱AI

Thinking EnabledTools

Aider-Polyglot52.10

τ²-Bench87.40

Terminal Bench 2.041.00

Tool Decathlon—

OSWorld-Verified—

Free commercial

Claude 3.5 Sonnet New Anthropic

Aider-Polyglot51.60

τ²-Bench—

Terminal Bench 2.0—

Tool Decathlon—

OSWorld-Verified—

Proprietary

Qwen3-Next 阿里巴巴

Aider-Polyglot49.80

τ²-Bench—

Terminal Bench 2.0—

Tool Decathlon—

OSWorld-Verified—

Free commercial

Qwen3-32B 阿里巴巴

Thinking Enabled

Aider-Polyglot40.00

τ²-Bench—

Terminal Bench 2.0—

Tool Decathlon—

OSWorld-Verified—

Free commercial

GPT-4o(2025-03-27)OpenAI

Aider-Polyglot27.10

τ²-Bench—

Terminal Bench 2.0—

Tool Decathlon—

OSWorld-Verified—

Proprietary

Claude Sonnet 4.6 Anthropic

Thinking EnabledTools

Aider-Polyglot—

τ²-Bench—

Terminal Bench 2.059.10

Tool Decathlon—

OSWorld-Verified72.50

Proprietary

Qwen3.6-27B 阿里巴巴

Thinking EnabledTools

Aider-Polyglot—

τ²-Bench—

Terminal Bench 2.059.30

Tool Decathlon—

OSWorld-Verified—

Free commercial

GPT-5.4 mini OpenAI

Thinking Level · Extra HighTools

Aider-Polyglot—

τ²-Bench—

Terminal Bench 2.060.00

Tool Decathlon42.90

OSWorld-Verified72.10

Proprietary

Qwen3.6-Max-Preview 阿里巴巴

Thinking EnabledTools

Aider-Polyglot—

τ²-Bench—

Terminal Bench 2.061.60

Tool Decathlon—

OSWorld-Verified—

Proprietary

Qwen 3.6 Plus Preview 阿里巴巴

Thinking EnabledTools

Aider-Polyglot—

τ²-Bench—

Terminal Bench 2.061.60

Tool Decathlon39.80

OSWorld-Verified—

Proprietary

Composer 2 Cursor

Thinking Enabled

Aider-Polyglot—

τ²-Bench—

Terminal Bench 2.061.70

Tool Decathlon—

OSWorld-Verified—

Proprietary

DeepSeek-V4-Pro DeepSeek-AI

Thinking EnabledTools

Aider-Polyglot—

τ²-Bench—

Terminal Bench 2.063.30

Tool Decathlon—

OSWorld-Verified—

Free commercial

GLM 5.1 智谱AI

Thinking EnabledTools

Aider-Polyglot—

τ²-Bench—

Terminal Bench 2.063.50

Tool Decathlon40.70

OSWorld-Verified—

Free commercial

Qwen3.6-Max-Preview 阿里巴巴

Deep Thinking ModeTools

Aider-Polyglot—

τ²-Bench—

Terminal Bench 2.065.40

Tool Decathlon—

OSWorld-Verified—

Proprietary

Kimi K2.6 Moonshot AI

Thinking EnabledTools

Aider-Polyglot—

τ²-Bench—

Terminal Bench 2.066.70

Tool Decathlon50.00

OSWorld-Verified73.10

Free commercial

DeepSeek-V4-Pro DeepSeek-AI

Thinking Level · Extra HighTools

Aider-Polyglot—

τ²-Bench—

Terminal Bench 2.067.90

Tool Decathlon—

OSWorld-Verified—

Free commercial

Composer 2.5 Cursor

Thinking Enabled

Aider-Polyglot—

τ²-Bench—

Terminal Bench 2.069.30

Tool Decathlon—

OSWorld-Verified—

Proprietary

Opus 4.7 Anthropic

Extended ThinkingTools

Aider-Polyglot—

τ²-Bench—

Terminal Bench 2.069.40

Tool Decathlon—

OSWorld-Verified78.00

Proprietary

Qwen3.7-Max-Preview 阿里巴巴

Thinking EnabledTools

Aider-Polyglot—

τ²-Bench—

Terminal Bench 2.069.70

Tool Decathlon—

OSWorld-Verified—

Proprietary

GPT-5.4 OpenAI

Thinking Level · Extra HighTools

Aider-Polyglot—

τ²-Bench—

Terminal Bench 2.075.10

Tool Decathlon—

OSWorld-Verified75.00

Proprietary

GPT-5.3 Codex OpenAI

Standard ModeTools

Aider-Polyglot—

τ²-Bench—

Terminal Bench 2.077.30

Tool Decathlon—

OSWorld-Verified—

Proprietary

Claude Mythos Preview Anthropic

Extended ThinkingTools

Aider-Polyglot—

τ²-Bench—

Terminal Bench 2.082.00

Tool Decathlon—

OSWorld-Verified79.60

Proprietary

Claude Sonnet 4 Anthropic

Thinking EnabledTools

Aider-Polyglot—

τ²-Bench—

Terminal Bench 2.0—

Tool Decathlon—

OSWorld-Verified42.20

Proprietary

GPT-5.5 OpenAI

Thinking EnabledTools

Aider-Polyglot—

τ²-Bench—

Terminal Bench 2.082.70

Tool Decathlon—

OSWorld-Verified78.70

Proprietary

Composer 1.5 Cursor

Thinking Enabled

Aider-Polyglot—

τ²-Bench—

Terminal Bench 2.047.90

Tool Decathlon—

OSWorld-Verified—

Proprietary

MiniMax M3 MiniMaxAI

Thinking EnabledTools

Aider-Polyglot—

τ²-Bench—

Terminal Bench 2.0—

Tool Decathlon—

OSWorld-Verified70.00

Non-commercial

Gemini 3.5 Flash Google Deep Mind

Thinking EnabledTools

Aider-Polyglot—

τ²-Bench—

Terminal Bench 2.0—

Tool Decathlon—

OSWorld-Verified78.40

Proprietary

Claude Opus 4.8 Anthropic

Extended ThinkingTools

Aider-Polyglot—

τ²-Bench—

Terminal Bench 2.0—

Tool Decathlon—

OSWorld-Verified83.40

Proprietary

Claude Fable 5 Anthropic

Thinking EnabledTools

Aider-Polyglot—

τ²-Bench—

Terminal Bench 2.0—

Tool Decathlon—

OSWorld-Verified85.00

Proprietary

Sort by:

Showing 50 of 100 modelsView Aider-Polyglot benchmark page