DataLearner logo

GPT-5.1 Benchmark Details

GPT-5.1 currently shows benchmark results led by MMMU (2 / 29, score 85.40), Terminal Bench Hard (2 / 13, score 43), GPQA Diamond (31 / 187, score 88.10). This page also compares it with 2 competitor models and 2 predecessor or same-series models, including performance and pricing views when available. 2 source links are attached for reference.

Benchmark Results

GPT-5.1

Benchmark Results

Thinking
Tool usage
Internet

General Knowledge

16 evaluations
Benchmark / mode
Score
Rank/total
88.10
31 / 187
88.10
31 / 187
GPQA Diamond
Thinking Level · High
88.10
31 / 187
72.80
27 / 67
57.70
39 / 67
33.20
52 / 67
LiveBench
Standard Mode
42.65
106 / 115
LiveBench
Thinking Level · Low
59.95
71 / 115
LiveBench
Thinking Level · Medium
69.17
41 / 115
LiveBench
Thinking Level · High
72.04
29 / 115
26.50
95 / 170
HLE
Thinking Level · High
25.70
98 / 170
HLE
Thinking Level · HighToolsInternet
42.70
52 / 170
17.60
35 / 61
6.50
43 / 61
1.90
52 / 61

Coding and Software Engineer

4 evaluations
Benchmark / mode
Score
Rank/total
76.30
33 / 111
SWE-bench Verified
Thinking Level · HighTools
76.30
33 / 111
IC SWE-Lancer(Diamond)
Thinking Level · High
69.70
3 / 8
SWE-Bench Pro - Public
Thinking Level · High
50.80
37 / 51

Math and Reasoning

6 evaluations
Benchmark / mode
Score
Rank/total
94
28 / 107
AIME2025
Thinking Level · High
94
28 / 107
FrontierMath
Thinking Level · HighTools
26.70
13 / 60
FrontierMath - Tier 4
Thinking Level · Medium
4.20
40 / 80
FrontierMath - Tier 4
Thinking Level · High
12.50
29 / 80
FrontierMath - Tier 4
Thinking Level · HighTools
12.50
29 / 80

Multimodal Understanding

2 evaluations
Benchmark / mode
Score
Rank/total
85.40
2 / 29
MMMU
Thinking Level · High
85.40
2 / 29

Common Sense Reasoning

1 evaluations
Benchmark / mode
Score
Rank/total
Simple Bench
Thinking Level · High
53.20
23 / 63

Agent Level Benchmark

2 evaluations
Benchmark / mode
Score
Rank/total
τ²-Bench - Telecom
Thinking Level · HighTools
95.60
14 / 35
Terminal Bench Hard
Thinking Level · HighTools
43
2 / 13

AI Agent - Information Search

1 evaluations
Benchmark / mode
Score
Rank/total
BrowseComp
Thinking Level · High
50.80
42 / 52

AI Agent - Tool Usage

2 evaluations
Benchmark / mode
Score
Rank/total
MCP-Atlas
Thinking Level · HighTools
50.10
25 / 27
Terminal Bench 2.0
Thinking Level · HighTools
47.60
38 / 47

Competitor Comparison

Benchmark scores for GPT-5.1 compared against top models in its class

Benchmark categories:
The chart shows each model’s highest score per benchmark within the current filter. Out-of-100 benchmarks use raw heights; out-of-range benchmarks are scaled within that benchmark while labels keep the original scores.

12 benchmarks with comparable scores. Each model shows its best score; mode label is displayed below.

BenchmarkGPT-5.1CurrentClaude Opus 4Gemini 2.5-Pro
ARC-AGI
综合评估
72.80Thinking Level · High
35.70Standard Mode
37.00Thinking Enabled
ARC-AGI-2
综合评估
17.60Thinking Level · High
8.60Standard Mode
4.90Thinking Enabled
GPQA Diamond
综合评估
88.10Thinking Enabled
79.60Standard Mode
86.40Thinking Enabled
HLE
综合评估
42.70Thinking Level · High | Tools
10.70Standard Mode
21.60Thinking Enabled
LiveBench
综合评估
72.04Thinking Level · High
--
58.33Thinking Level · High
SWE-bench Verified
编程与软件工程
76.30Thinking Level · High
72.50Standard Mode
67.20Thinking Enabled
AIME2025
数学推理
94.00Thinking Level · High
75.50Standard Mode
88.00Thinking Enabled
FrontierMath
数学推理
26.70Thinking Level · High | Tools
4.50Standard Mode
11.00Standard Mode
12.50Thinking Level · High | Tools
4.20Thinking Enabled
2.10Standard Mode
MMMU
多模态理解
85.40Thinking Level · High
--
82.00Thinking Enabled
Simple Bench
常识推理
53.20Thinking Level · High
58.80Thinking Enabled
62.40Thinking Enabled
Terminal Bench Hard
Agent能力评测
43.00Thinking Level · High | Tools
--
25.00Thinking Enabled | Tools
3 additional benchmarks remain in the chart above.

Standard API Pricing: GPT-5.1 vs. Peer Models

Shows standard text input and output pricing side by side for each model. If extended-context pricing exists, the chart keeps the base rate and explains the threshold below.

Source: DataLearnerAI. Standard text prices shown here use the default supplier. · USD / 1M tokens

When a context threshold exists, the charted base price only applies within these limits:

Gemini 2.5-Pro: Base price applies to <= 200000
ModelSupplierStandard inputStandard outputBase price applies to
GPT-5.1
OpenAI$1.25 / 1M tokens$10 / 1M tokens
Claude Opus 4
Anthropic$15 / 1M tokens$75 / 1M tokens
Gemini 2.5-Pro
Google Deep Mind$1.25 / 1M tokens$10 / 1M tokens<= 200000

Version History

How each version of the GPT-5.1 series stacks up on benchmark tests

Benchmark categories:
The chart shows each model’s highest score per benchmark within the current filter. Out-of-100 benchmarks use raw heights; out-of-range benchmarks are scaled within that benchmark while labels keep the original scores.

7 benchmarks with comparable scores. Each model shows its best score; mode label is displayed below.· Click a row to view its trend chart.

BenchmarkGPT-5.1CurrentGPT-5GPT-4.5
ARC-AGI
综合评估
72.80Thinking Level · High
65.70Thinking Level · High
--
ARC-AGI-2
综合评估
17.60Thinking Level · High
9.90Thinking Level · High
--
GPQA Diamond
综合评估
88.10Thinking Enabled
87.30Thinking Enabled | Tools
71.40Standard Mode
HLE
综合评估
42.70Thinking Level · High | Tools
35.20Thinking Enabled | Tools
--
SWE-bench Verified
编程与软件工程
76.30Thinking Level · High
72.80Thinking Level · High
38.00Standard Mode
AIME2025
数学推理
94.00Thinking Level · High
99.60Thinking Enabled | Tools
--
MMMU
多模态理解
85.40Thinking Level · High
84.20Thinking Level · High
--

Single-Benchmark Version Trend

Viewing: ARC-AGI · 综合评估

Benchmark
NormalNormal + ToolsThinkingThinking + ToolsDeepDeep + Tools

X-axis shows model and release date, Y-axis shows score; solid lines connect the same mode across versions, while dotted guides align modes within the same generation.

Standard API Pricing Across the GPT-5.1 Series

Shows standard text input and output pricing side by side for each model. If extended-context pricing exists, the chart keeps the base rate and explains the threshold below.

Source: DataLearnerAI. Standard text prices shown here use the default supplier. · USD / 1M tokens

ModelSupplierStandard inputStandard outputBase price applies to
GPT-5.1
OpenAI$1.25 / 1M tokens$10 / 1M tokens
GPT-5
OpenAI$1.25 / 1M tokens$10 / 1M tokens

Sources