DataLearner logo

Gemini 1.5 Pro Benchmark Details

Gemini 1.5 Pro currently shows benchmark results led by MBPP (2 / 70, score 87.80), HumanEval (9 / 101, score 89), MMLU (26 / 124, score 87.10).

Benchmark Results

Gemini 1.5 Pro

Benchmark Results

Thinking

General Knowledge

3 evaluations
Benchmark / mode
Score
Rank/total
MMLU
Standard Mode
87.10
26 / 124
MMLU Pro
Standard Mode
76.10
80 / 133
BBH
Standard Mode
0
20 / 21

Math and Reasoning

2 evaluations
Benchmark / mode
Score
Rank/total
MATH
Standard Mode
82.90
11 / 42
GSM8K
Standard Mode
0
68 / 70

Coding and Software Engineer

2 evaluations
Benchmark / mode
Score
Rank/total
HumanEval
Standard Mode
89
9 / 101
MBPP
Standard Mode
87.80
2 / 70

Other

1 evaluations
Benchmark / mode
Score
Rank/total
TruthfulQA
Standard Mode
0
2 / 4

Other

1 evaluations
Benchmark / mode
Score
Rank/total
GPQA Diamond
Standard Mode
53.50
237 / 270
Compare with other models