Gemma 3 - 12B (IT) Benchmark Details

Gemma 3 - 12B (IT) currently shows benchmark results led by MATH (9 / 42, score 83.80), MMLU Pro (106 / 126, score 60.60), GPQA Diamond (165 / 179, score 40.90).

Benchmark Results

Gemma 3 - 12B (IT)

Benchmark Results

General Knowledge

2 evaluations

Benchmark / mode

Score

Rank/total

MMLU Pro

60.60

106 / 126

GPQA Diamond

40.90

165 / 179

Math and Reasoning

1 evaluations

Benchmark / mode

Score

Rank/total

MATH

83.80

9 / 42

Common Sense

1 evaluations

Benchmark / mode

Score

Rank/total

SimpleQA

6.30

44 / 45

Coding and Software Engineer

1 evaluations

Benchmark / mode

Score

Rank/total

LiveCodeBench

24.60

120 / 120

Compare with other models