Gemma 3 - 12B (IT) Benchmark Details

Gemma 3 - 12B (IT) currently shows benchmark results led by MATH (9 / 42, score 83.80), MMLU-Pro (122 / 176, score 60.60), Creative Writing (85 / 106, score 1123.40).

Benchmark Results

Gemma 3 - 12B (IT)

Benchmark Results

General Knowledge

1 evaluations

Benchmark / mode

Score

Rank/total

MMLU-Pro

Standard Mode

60.60

122 / 176

Math and Reasoning

1 evaluations

Benchmark / mode

Score

Rank/total

MATH

Standard Mode

83.80

9 / 42

Other

1 evaluations

Benchmark / mode

Score

Rank/total

GPQA Diamond

Standard Mode

40.90

431 / 463

Common Sense

1 evaluations

Benchmark / mode

Score

Rank/total

SimpleQA

Standard Mode

6.30

46 / 47

Coding and Software Engineer

1 evaluations

Benchmark / mode

Score

Rank/total

LiveCodeBench

Standard Mode

24.60

233 / 251

Writing and Creative Capabilities

1 evaluations

Benchmark / mode

Score

Rank/total

Creative Writing

Standard Mode

1123.40

85 / 106

Multimodal Understanding

1 evaluations

Benchmark / mode

Score

Rank/total

MMMU

unknown

59.60

60 / 74

Compare with other models