DataLearner logo

Claude Sonnet 3.7 Benchmark Details

Claude Sonnet 3.7 currently shows benchmark results led by LiveBench (24 / 52, score 68.64), GPQA Diamond (89 / 179, score 77), SWE-bench Verified (55 / 108, score 70.30). 1 source link is attached for reference.

Benchmark Results

Claude Sonnet 3.7

Benchmark Results

Thinking

General Knowledge

5 evaluations
Benchmark / mode
Score
Rank/total
GPQA Diamond
77
89 / 179
GPQA Diamond
68
123 / 179
LiveBench
68.64
24 / 52
LiveBench
60.40
43 / 52
HLE
10.30
133 / 159

Coding and Software Engineer

2 evaluations
Benchmark / mode
Score
Rank/total
SWE-bench Verified
70.30
55 / 108
SWE-bench Verified
62.30
74 / 108

Math and Reasoning

5 evaluations
Benchmark / mode
Score
Rank/total
MATH-500
82.20
41 / 44
AIME2025
54.80
84 / 106
AIME 2024
23.30
58 / 62
FrontierMath
4.10
41 / 60
FrontierMath
3.10
46 / 60

常识推理

2 evaluations
Benchmark / mode
Score
Rank/total
Simple Bench
46.40
14 / 27
Simple Bench
44.90
16 / 27

Agent Level Benchmark

5 evaluations
Benchmark / mode
Score
Rank/total
Aider-Polyglot
64.90
15 / 26
Aider-Polyglot
60.40
18 / 26
τ²-Bench
61.80
29 / 40
τ²-Bench - Telecom
55
31 / 35
Terminal Bench Hard
21
13 / 13

Productivity Knowledge

1 evaluations
Benchmark / mode
Score
Rank/total
GDPval-AA
28
20 / 21

Long Context

1 evaluations
Benchmark / mode
Score
Rank/total
AA-LCR
61
13 / 13

AI Agent - Tool Usage

1 evaluations
Benchmark / mode
Score
Rank/total
Compare with other models

Sources

anthropic.comanthropic.com