Step 3.5 Flash Benchmark Details

Step 3.5 Flash currently shows benchmark results led by AIME2025 (6 / 107, score 99.80), LiveCodeBench (13 / 123, score 86.40), τ²-Bench (5 / 43, score 88.20).

Benchmark Results

Step 3.5 Flash

Benchmark Results

General Knowledge

2 evaluations

Benchmark / mode

Score

Rank/total

ARC-AGI

56.50

42 / 68

ARC-AGI

53.50

45 / 68

Coding and Software Engineer

2 evaluations

Benchmark / mode

Score

Rank/total

LiveCodeBench

86.40

13 / 123

SWE-bench Verified

74.40

43 / 113

Math and Reasoning

4 evaluations

Benchmark / mode

Score

Rank/total

AIME2025

99.80

6 / 107

AIME2025

97.30

18 / 107

IMO-AnswerBench

86.70

7 / 21

IMO-AnswerBench

85.40

9 / 21

Agent Level Benchmark

1 evaluations

Benchmark / mode

Score

Rank/total

τ²-Bench

88.20

5 / 43

AI Agent - Information Search

1 evaluations

Benchmark / mode

Score

Rank/total

BrowseComp

29 / 53

AI Agent - Tool Usage

1 evaluations

Benchmark / mode

Score

Rank/total

Terminal Bench 2.0

33 / 47

Claw-style Agent Evaluation

2 evaluations

Benchmark / mode

Score

Rank/total

Pinch Bench

Thinking EnabledTools

85.30

15 / 37

Claw Bench

Thinking EnabledTools

84.90

16 / 29

Compare with other models