Qwen3.5-397B-A17B Benchmark Details

Qwen3.5-397B-A17B currently shows benchmark results led by MMLU Pro (10 / 126, score 87.80), Pinch Bench (3 / 37, score 89.10), IF Bench (3 / 29, score 76.50). 1 source link is attached for reference.

Benchmark Results

Qwen3.5-397B-A17B

Benchmark Results

综合评估

5 evaluations

Benchmark / mode

Score

Rank/total

C-Eval

Thinking Mode

3 / 9

GPQA Diamond

Thinking Mode

88.40

25 / 177

MMLU Pro

Thinking Mode

87.80

10 / 126

HLE

Thinking Mode

28.70

77 / 154

HLE

Thinking ModeToolsInternet

48.30

25 / 154

编程与软件工程

4 evaluations

Benchmark / mode

Score

Rank/total

LiveCodeBench

Thinking Mode

83.60

20 / 120

SWE-bench Verified

Thinking ModeTools

76.40

26 / 105

SWE-bench Multilingual

Thinking Mode

69.30

17 / 20

SWE-Bench Pro - Public

Thinking Mode

50.90

26 / 40

多模态理解

1 evaluations

Benchmark / mode

Score

Rank/total

MMMU

Thinking Mode

4 / 28

Agent能力评测

1 evaluations

Benchmark / mode

Score

Rank/total

τ²-Bench

Thinking ModeTools

86.70

7 / 40

指令跟随

1 evaluations

Benchmark / mode

Score

Rank/total

IF Bench

Thinking Mode

76.50

3 / 29

AI Agent - 信息收集

2 evaluations

Benchmark / mode

Score

Rank/total

BrowseComp

Thinking ModeToolsInternet

78.60

13 / 43

BrowseComp

Thinking ModeTools

20 / 43

AI Agent - 工具使用

3 evaluations

Benchmark / mode

Score

Rank/total

OSWorld-Verified

Thinking ModeTools

62.20

10 / 15

Terminal Bench 2.0

Thinking ModeTools

52.50

29 / 46

Tool Decathlon

Thinking ModeTools

38.30

5 / 7

数学推理

2 evaluations

Benchmark / mode

Score

Rank/total

AIME 2026

Thinking Mode

91.30

11 / 14

IMO-AnswerBench

Thinking Mode

80.90

15 / 19

长上下文能力

1 evaluations

Benchmark / mode

Score

Rank/total

AA-LCR

Thinking Mode

68.70

5 / 13

OpenClaw智能体能力综合测评

1 evaluations

Benchmark / mode

Score

Rank/total

Pinch Bench

Thinking ModeTools

89.10

3 / 37

Compare with other models

Sources

qwen.aiqwen.ai