OpenAI o1-mini Benchmark Details

OpenAI o1-mini currently shows benchmark results led by HumanEval (4 / 39, score 92.40), MMLU Pro (62 / 132, score 80.30), MMLU (40 / 66, score 85.20).

Benchmark Results

OpenAI o1-mini

Benchmark Results

General Knowledge

3 evaluations

Benchmark / mode

Score

Rank/total

MMLU

85.20

40 / 66

MMLU Pro

80.30

62 / 132

GPQA Diamond

146 / 187

Coding and Software Engineer

2 evaluations

Benchmark / mode

Score

Rank/total

HumanEval

92.40

4 / 39

LiveCodeBench

88 / 123

Math and Reasoning

4 evaluations

Benchmark / mode

Score

Rank/total

MATH-500

37 / 44

AIME 2024

63.60

41 / 62

FrontierMath

1.70

49 / 60

FrontierMath

1.40

51 / 60

Common Sense Reasoning

1 evaluations

Benchmark / mode

Score

Rank/total

Simple Bench

Standard Mode

18.10

61 / 63

Agent Level Benchmark

1 evaluations

Benchmark / mode

Score

Rank/total

Aider-Polyglot

Standard Mode

32.90

43 / 59

Compare with other models