GPT-4.1 mini Benchmark Details

GPT-4.1 mini currently shows benchmark results led by MMLU (22 / 66, score 87.50), IC SWE-Lancer(Diamond) (4 / 8, score 33), FrontierMath (39 / 60, score 4.50).

Benchmark Results

GPT-4.1 mini

Benchmark Results

General Knowledge

2 evaluations

Benchmark / mode

Score

Rank/total

MMLU

87.50

22 / 66

GPQA Diamond

137 / 187

Coding and Software Engineer

2 evaluations

Benchmark / mode

Score

Rank/total

IC SWE-Lancer(Diamond)

4 / 8

SWE-bench Verified

23.60

110 / 112

Math and Reasoning

2 evaluations

Benchmark / mode

Score

Rank/total

AIME 2024

49.60

48 / 62

FrontierMath

4.50

39 / 60

Agent Level Benchmark

2 evaluations

Benchmark / mode

Score

Rank/total

τ²-Bench

33 / 43

Aider-Polyglot

Standard Mode

32.40

44 / 59

Compare with other models