Gemma 4 31B vs Mistral Medium 3.5 benchmark comparison

Each axis is the mean percentage score of one benchmark domain. It is an average, not a capability rating.

Method: for each model and benchmark, all scores in the current mode scope are averaged (not the best score), then those benchmark scores are averaged within each domain. Only benchmarks scored on a 0-100 scale by at least two of the selected models count — Elo and rating-scale benchmarks such as Codeforces or Arena are excluded, because averaging a 1500 rating with an 85% accuracy produces a meaningless number. Missing values are not counted as zero, and the averages are unweighted, so domains with harder benchmarks read lower.