DataLearner logo

Claude3-Opus Benchmark Details

Claude3-Opus currently shows benchmark results led by GSM8K (9 / 71, score 95), MMLU (28 / 124, score 86.80), HumanEval (37 / 140, score 84.90).

Benchmark Results

Claude3-Opus

Benchmark Results

Thinking

General Knowledge

4 evaluations
Benchmark / mode
Score
Rank/total
MMLU
Standard Mode
86.80
28 / 124
MMLU-Pro
Standard Mode
68.45
106 / 176
MMLU-Pro
unknown
68.45
106 / 176
HLE
Standard Mode
2.80
561 / 565

Math and Reasoning

2 evaluations
Benchmark / mode
Score
Rank/total
GSM8K
Standard Mode
95
9 / 71
MATH
Standard Mode
60.10
31 / 42

Coding and Software Engineer

2 evaluations
Benchmark / mode
Score
Rank/total
HumanEval
Standard Mode
84.90
37 / 140
LiveCodeBench
Standard Mode
27.90
229 / 251

Common Sense Reasoning

2 evaluations
Benchmark / mode
Score
Rank/total
HellaSwag
Standard Mode
95.40
1 / 3
SimpleBench
Standard Mode
23.50
82 / 93

Reading Comprehension

1 evaluations
Benchmark / mode
Score
Rank/total
DROP
Standard Mode
83.10
6 / 9

Other

1 evaluations
Benchmark / mode
Score
Rank/total
GPQA Diamond
Standard Mode
50.40
409 / 463

Multimodal Understanding

1 evaluations
Benchmark / mode
Score
Rank/total
MMMU
unknown
59.40
61 / 74
Compare with other models