ERNIE-4.5-300B-A47B Benchmark Details

ERNIE-4.5-300B-A47B currently shows benchmark results led by GSM8K (1 / 26, score 96.60), BBH (1 / 20, score 94.30), DROP (2 / 9, score 91.10).

Benchmark Results

ERNIE-4.5-300B-A47B

Benchmark Results

General Knowledge

3 evaluations

Benchmark / mode

Score

Rank/total

BBH

94.30

1 / 20

MMLU

86.50

28 / 65

MMLU Pro

78.40

67 / 126

Math and Reasoning

4 evaluations

Benchmark / mode

Score

Rank/total

GSM8K

96.60

1 / 26

MATH-500

96.40

17 / 44

AIME 2024

54.80

44 / 62

AIME2025

35.10

98 / 106

阅读理解

1 evaluations

Benchmark / mode

Score

Rank/total

DROP

91.10

2 / 9

Common Sense

1 evaluations

Benchmark / mode

Score

Rank/total

SimpleQA

45.90

14 / 45

Coding and Software Engineer

1 evaluations

Benchmark / mode

Score

Rank/total

LiveCodeBench

38.80

100 / 120

Compare with other models