Gemma 3 - 12B (IT) Benchmark Details

Gemma 3 - 12B (IT) currently shows benchmark results led by MATH (9 / 42, score 83.80), MMLU Pro (110 / 132, score 60.60), GPQA Diamond (172 / 187, score 40.90).

Benchmark Results

Gemma 3 - 12B (IT)

Benchmark Results

General Knowledge

2 evaluations

Benchmark / mode

Score

Rank/total

MMLU Pro

60.60

110 / 132

GPQA Diamond

40.90

172 / 187

Math and Reasoning

1 evaluations

Benchmark / mode

Score

Rank/total

MATH

83.80

9 / 42

Common Sense

1 evaluations

Benchmark / mode

Score

Rank/total

SimpleQA

6.30

46 / 47

Coding and Software Engineer

1 evaluations

Benchmark / mode

Score

Rank/total

LiveCodeBench

24.60

123 / 123

Compare with other models