Gemma 2 - 9B Benchmark Details

Gemma 2 - 9B currently shows benchmark results led by ARC (1 / 4, score 68.20), MBPP (26 / 70, score 62.20), GSM8K (31 / 70, score 70.70).

Benchmark Results

Gemma 2 - 9B

Benchmark Results

General Knowledge

3 evaluations

Benchmark / mode

Score

Rank/total

MMLU

Standard Mode

71.30

70 / 124

BBH

Standard Mode

68.20

14 / 21

MMLU Pro

Standard Mode

44.70

126 / 133

Math and Reasoning

2 evaluations

Benchmark / mode

Score

Rank/total

GSM8K

Standard Mode

70.70

31 / 70

MATH

Standard Mode

37.70

39 / 42

Coding and Software Engineer

2 evaluations

Benchmark / mode

Score

Rank/total

MBPP

Standard Mode

62.20

26 / 70

HumanEval

Standard Mode

37.80

64 / 101

Common Sense Reasoning

1 evaluations

Benchmark / mode

Score

Rank/total

ARC

Standard Mode

68.20

1 / 4

Other

1 evaluations

Benchmark / mode

Score

Rank/total

GPQA Diamond

Standard Mode

32.80

215 / 224

Compare with other models