Claude3-Opus Benchmark Details

Claude3-Opus currently shows benchmark results led by GSM8K (8 / 26, score 95), HellaSwag (1 / 3, score 95.40), MMLU (27 / 66, score 86.80).

Benchmark Results

Claude3-Opus

Benchmark Results

General Knowledge

3 evaluations

Benchmark / mode

Score

Rank/total

MMLU

86.80

27 / 66

MMLU Pro

68.45

99 / 132

GPQA Diamond

50.40

159 / 187

Math and Reasoning

2 evaluations

Benchmark / mode

Score

Rank/total

GSM8K

8 / 26

MATH

60.10

31 / 42

Coding and Software Engineer

1 evaluations

Benchmark / mode

Score

Rank/total

HumanEval

84.90

21 / 39

Common Sense Reasoning

1 evaluations

Benchmark / mode

Score

Rank/total

HellaSwag

95.40

1 / 3

Reading Comprehension

1 evaluations

Benchmark / mode

Score

Rank/total

DROP

83.10

6 / 9

Compare with other models