Gemini-ultra Benchmark Details

Gemini-ultra currently shows benchmark results led by MMLU (10 / 124, score 90.04), GSM8K (11 / 68, score 94.40), HumanEval (47 / 140, score 74.40).

Benchmark Results

Gemini-ultra

Benchmark Results

Knowledge Exams

1 evaluations

Benchmark / mode

Score

Rank/total

Standard Mode

90.04

10 / 124

Mathematics

1 evaluations

Benchmark / mode

Score

Rank/total

Standard Mode

94.40

11 / 68

Code Generation & Editing

1 evaluations

Benchmark / mode

Score

Rank/total

Standard Mode

74.40

47 / 140

Compare with other models