ERNIE 5.0 Thinking Preview Benchmark Details

ERNIE 5.0 Thinking Preview currently shows benchmark results led by LiveCodeBench (45 / 250, score 81.20), AIME2025 (76 / 215, score 85), τ²-Bench - Telecom (98 / 264, score 83.90). 1 source link is attached for reference.

Benchmark Results

ERNIE 5.0 Thinking Preview

Benchmark Results

General Knowledge

2 evaluations

Benchmark / mode

Score

Rank/total

HLE

Thinking Mode

13.30

355 / 563

CritPt

Thinking Mode

1.40

135 / 200

Other

1 evaluations

Benchmark / mode

Score

Rank/total

GPQA Diamond

Thinking Mode

77.70

259 / 462

Coding and Software Engineer

1 evaluations

Benchmark / mode

Score

Rank/total

LiveCodeBench

Thinking Mode

81.20

45 / 250

Math and Reasoning

1 evaluations

Benchmark / mode

Score

Rank/total

AIME2025

Thinking Mode

76 / 215

Agent Level Benchmark

2 evaluations

Benchmark / mode

Score

Rank/total

τ²-Bench - Telecom

Thinking ModeTools

83.90

98 / 264

Terminal Bench Hard

Thinking ModeTools

128 / 244

Instruction Following

1 evaluations

Benchmark / mode

Score

Rank/total

IF Bench

Thinking Mode

41.40

208 / 282

Claw-style Agent Evaluation

1 evaluations

Benchmark / mode

Score

Rank/total

Claw Bench

Thinking Mode

29 / 29

Multimodal Understanding

1 evaluations

Benchmark / mode

Score

Rank/total

MMMU-Pro

Thinking Mode

64.60

155 / 227

Compare with other models

Sources

clawbenchlabs.comclawbenchlabs.com