DataLearner logo

Gemini 1.5 Pro Benchmark Details

Gemini 1.5 Pro currently shows benchmark results led by MBPP (2 / 28, score 87.80), HumanEval (9 / 39, score 89), MATH (11 / 42, score 82.90).

Benchmark Results

Gemini 1.5 Pro

Benchmark Results

Thinking

General Knowledge

4 evaluations
Benchmark / mode
Score
Rank/total
MMLU
87.10
25 / 66
MMLU Pro
76.10
79 / 132
GPQA Diamond
53.50
156 / 187
BBH
0
20 / 21

Math and Reasoning

2 evaluations
Benchmark / mode
Score
Rank/total
MATH
82.90
11 / 42
GSM8K
0
24 / 26

Coding and Software Engineer

2 evaluations
Benchmark / mode
Score
Rank/total
HumanEval
89
9 / 39
MBPP
87.80
2 / 28

Other

1 evaluations
Benchmark / mode
Score
Rank/total
Compare with other models