Gemma 3 - 12B (IT) Benchmark Details

Gemma 3 - 12B (IT) currently shows benchmark results led by MATH (9 / 42, score 83.80), Creative Writing (85 / 106, score 1123.40), MMLU Pro (112 / 134, score 60.60).

Benchmark Results

Gemma 3 - 12B (IT)

Benchmark Results

General Knowledge

1 evaluations

Benchmark / mode

Score

Rank/total

MMLU Pro

Standard Mode

60.60

112 / 134

Math and Reasoning

1 evaluations

Benchmark / mode

Score

Rank/total

MATH

Standard Mode

83.80

9 / 42

Other

1 evaluations

Benchmark / mode

Score

Rank/total

GPQA Diamond

Standard Mode

40.90

259 / 274

Common Sense

1 evaluations

Benchmark / mode

Score

Rank/total

SimpleQA

Standard Mode

6.30

46 / 47

Coding and Software Engineer

1 evaluations

Benchmark / mode

Score

Rank/total

LiveCodeBench

Standard Mode

24.60

128 / 128

Writing and Creative Capabilities

1 evaluations

Benchmark / mode

Score

Rank/total

Creative Writing

Standard Mode

1123.40

85 / 106

Compare with other models