M2.1 Benchmark Details

M2.1 currently shows benchmark results led by MMLU Pro (7 / 126, score 88), SWE-bench Verified (32 / 105, score 74.80), GPQA Diamond (68 / 177, score 81).

Benchmark Results

M2.1

Benchmark Results

综合评估

3 evaluations

Benchmark / mode

Score

Rank/total

MMLU Pro

Thinking Enabled

7 / 126

GPQA Diamond

Thinking Enabled

68 / 177

HLE

Thinking Enabled

91 / 154

编程与软件工程

2 evaluations

Benchmark / mode

Score

Rank/total

SWE-bench Verified

Thinking Enabled

74.80

32 / 105

SWE-Bench Pro - Public

Thinking EnabledTools

32.60

39 / 40

数学推理

1 evaluations

Benchmark / mode

Score

Rank/total

AIME2025

Thinking Enabled

56 / 106

Agent能力评测

2 evaluations

Benchmark / mode

Score

Rank/total

τ²-Bench - Telecom

Thinking EnabledTools

22 / 35

Aider-Polyglot

Thinking EnabledTools

17 / 26

指令跟随

1 evaluations

Benchmark / mode

Score

Rank/total

IF Bench

Thinking EnabledTools

12 / 29

AI Agent - 信息收集

1 evaluations

Benchmark / mode

Score

Rank/total

BrowseComp

Thinking EnabledTools

47.40

35 / 43

AI Agent - 工具使用

1 evaluations

Benchmark / mode

Score

Rank/total

Terminal Bench 2.0

Thinking EnabledTools

47.90

35 / 46

OpenClaw智能体能力综合测评

1 evaluations

Benchmark / mode

Score

Rank/total

Pinch Bench

Thinking EnabledTools

84.30

18 / 37

Compare with other models