Claude3-Sonnet Benchmark Details

Claude3-Sonnet currently shows benchmark results led by MMLU-Pro (126 / 175, score 56.80), ECI (130 / 167, score 120.69), MMMU (64 / 74, score 53.10).

Benchmark Results

Claude3-Sonnet

Benchmark Results

Knowledge Exams

2 evaluations

Benchmark / mode

Score

Rank/total

Standard Mode

56.80

126 / 175

unknown

56.80

126 / 175

Visual Understanding

1 evaluations

Benchmark / mode

Score

Rank/total

unknown

53.10

64 / 74

Capability Indices

1 evaluations

Benchmark / mode

Score

Rank/total

unknown

120.69

130 / 167

Compare with other models