DataLearner logo

M2.1 Benchmark Details

M2.1 currently shows benchmark results led by MMLU Pro (7 / 126, score 88), SWE-bench Verified (36 / 109, score 74.80), GPQA Diamond (71 / 180, score 81).

Benchmark Results

M2.1

Benchmark Results

Thinking
Tool usage

General Knowledge

3 evaluations
Benchmark / mode
Score
Rank/total
MMLU Pro
88
7 / 126
GPQA Diamond
81
71 / 180
HLE
22
101 / 164

Coding and Software Engineer

2 evaluations
Benchmark / mode
Score
Rank/total

Math and Reasoning

1 evaluations
Benchmark / mode
Score
Rank/total
AIME2025
81
56 / 106

常识推理

1 evaluations
Benchmark / mode
Score
Rank/total
Simple Bench
Standard Mode
34.70
45 / 63

Agent Level Benchmark

1 evaluations
Benchmark / mode
Score
Rank/total

Instruction Following

1 evaluations
Benchmark / mode
Score
Rank/total
IF Bench
70
12 / 29

AI Agent - Information Search

1 evaluations
Benchmark / mode
Score
Rank/total
BrowseComp
47.40
40 / 49

AI Agent - Tool Usage

1 evaluations
Benchmark / mode
Score
Rank/total
Terminal Bench 2.0
47.90
35 / 46

Claw-style Agent Evaluation

1 evaluations
Benchmark / mode
Score
Rank/total
Pinch Bench
Thinking EnabledTools
84.30
18 / 37
Compare with other models