DataLearner 标志

Agent Arena 智能体能力排行榜

Arena 的 Agent Arena 让真实用户在 Agent Mode 中与随机分配的模型长时间协作,再用因果追踪估计每个模型作为智能体编排者相对平均模型的净提升。分数可正可负,正值代表优于平均水平。

榜首模型

Claude Opus 5.5 (Max) · +20.77

会话数

2,557,423

模型数

55

数据版本

2026-10-23

数据来源: Arena Agent Arena

这个榜单怎么读

真实会话而非两两对战:每个 Agent Mode 会话随机分配一个编排模型,用户与单个智能体持续交互,有时长达数百轮,不是看两个匿名回答投票。

因果追踪而非 Elo:对每个行为信号估计“换成这个模型”相对平均模型的处理效应(百分点)。综合分是各信号的加权平均,其中 Bash 可靠性按半权重计。

相对且动态:基线是当前所有模型的平均水平,新模型加入会让所有分数随之变化;置信区间重叠较多的模型应视为接近,名次区间给出统计上可能的名次范围。

评分信号

确认成功
用户明确确认任务已完成的频率。
赞扬 vs 抱怨
任务过程中用户的正面表达是否多于负面表达。
可引导性
用户纠正或反驳后,模型的下一次回复能否被接受。
Bash 可靠性(半权重)
Shell 命令执行成功的可靠性,网络、权限等非模型原因的失败不计入;综合分中按半权重计。
工具幻觉控制
调用不存在工具的情况;数值已统一为越高越好,即幻觉越少。

模型排名

排名模型净提升确认成功赞扬 vs 抱怨可引导性Bash 可靠性工具幻觉控制会话数单任务成本 P50单任务耗时 P50
1AnthropicClaude Opus 5.5 (Max)Anthropic+20.77±2.38+22.08±3.38+45.32±9.27+17.60±1.99+15.77±0.50+0.57±0.1312,057$6.3817.9 分钟
22–7AnthropicClaude Sonnet 5.5 (Max)Anthropic+13.99±3.04+21.70±4.75+23.20±11.70+10.82±3.58+13.17±0.88+0.65±0.138,097$4.4918.2 分钟
32–7OpenAIGPT-6 Astra (Max)OpenAI+13.96±2.08+13.25±3.59+29.76±7.58+14.46±2.13+9.29±1.29+0.71±0.0814,567$4.3610.7 分钟
42–7AnthropicClaude Fable 5.1 (Max)Anthropic+13.94±1.93+13.86±3.44+27.66±7.13+15.33±2.14+10.56±0.97+0.61±0.1417,062$8.0712.2 分钟
52–7OpenAIGPT-6.1 Sol (Max)OpenAI+13.64±1.63+13.73±2.75+31.26±5.97+13.70±1.62+3.93±1.10+0.75±0.0616,092$0.80110.1 分钟
62–7GoogleGemini 4 Argon (High)Google+11.75±0.91+13.51±1.61+26.62±3.19+14.40±0.99-4.03±1.15+0.35±0.1445,840$1.087.5 分钟
72–10MetaMuse Wonder Full (Max)Meta+10.74±1.39+11.78±2.62+19.97±4.94+11.81±1.65+8.73±0.70+0.39±0.1914,474$0.28211.0 分钟
87–12OpenAIGPT-6 Sol (Max)OpenAI+8.57±1.71+6.90±3.42+14.10±5.86+11.07±1.84+11.66±0.62+0.64±0.0710,305$1.546.9 分钟
97–12AnthropicClaude Opus 5 (Max)Anthropic+8.22±1.63+11.58±2.98+12.36±5.48+6.69±2.11+11.30±0.82+0.70±0.0824,440$5.1411.9 分钟
108–12AnthropicClaude Fable 5 (High)Anthropic+7.75±1.40+3.43±2.75+15.28±4.48+9.60±1.92+11.89±1.29+0.64±0.1743,567$3.474.5 分钟
117–15MoonshotKimi K3.1 Pro (Max)初步结果Moonshot+7.61±3.00+2.03±5.86+19.04±10.12+8.30±3.36+8.27±1.56+0.75±0.064,071$1.207.0 分钟
128–15OpenAIGPT-5.6 Sol (xHigh)OpenAI+6.06±1.34+1.86±2.80+10.37±4.19+8.41±1.83+11.99±0.93+0.62±0.1037,542$1.684.5 分钟
1311–19DeepSeekDeepSeek-V4.1-Flash-20261017 (Max)DeepSeek+4.37±0.86+7.12±1.82+5.97±2.75+3.56±1.15+5.13±0.42+0.42±0.0934,721$0.1997.2 分钟
1411–27AnthropicClaude Sonnet 5 (High)Anthropic+3.75±1.70-1.05±3.54+3.81±5.24+5.96±2.33+15.44±0.87+0.45±0.1533,991$1.295.4 分钟
1511–29MetaMuse Wonder (Max)Meta+3.31±1.57+7.67±3.26+1.07±4.72+3.73±2.14+6.47±0.97-0.84±2.1811,134$1.574.5 分钟
1613–24MiMo-V2.6-ProXiaomi+3.30±0.81+6.87±1.66+4.12±2.56+2.11±1.16+3.68±0.57-0.06±0.2343,983$0.13015.5 分钟
1713–26GoogleGemini 3.8 Flash (High)Google+3.17±1.08+2.91±2.26+4.17±3.25+1.16±1.59+10.92±0.54+0.56±0.1139,719$0.8189.2 分钟
1813–25MetaMuse Spark 1.3 (Max)Meta+3.05±0.83+4.26±1.71+2.87±2.64+4.81±1.10+2.29±0.85+0.66±0.0878,017$0.4734.8 分钟
1913–31SpaceXAIGrok 4.7 (xHigh)SpaceXAI+3.02±1.57+6.04±3.24+3.55±4.92-1.50±2.32+9.68±0.66+0.68±0.0716,639$2.4714.8 分钟
2014–24OpenAIGPT-6 Luna (Max)OpenAI+2.79±0.42+0.46±0.92+0.50±1.35+5.65±0.54+10.69±0.28+0.61±0.07194,437$0.0846.3 分钟
2114–27DeepSeekDeepSeek-V4.1-Flash-20260910 (Max)DeepSeek+2.25±0.34+5.79±0.72+2.94±1.09+0.99±0.49-0.23±0.26+0.55±0.07259,479$0.1486.4 分钟
2214–31MiMo-V2.6-FlashXiaomi+2.10±1.33+6.17±2.67+2.56±4.29+4.65±1.68-1.86±1.02-2.99±0.4422,895$0.06314.5 分钟
2314–31TencentHy4 previewTencent+2.02±0.64+5.10±1.35+3.44±2.03+1.56±0.85-2.22±0.47+0.09±0.1893,764$0.42616.9 分钟
2414–31Z.aiGLM-5.2 (Max)Z.ai+1.69±0.82+2.83±1.72+4.78±2.53+1.30±1.26-4.02±0.95+0.73±0.0790,051$0.96113.9 分钟
2516–31MoonshotKimi K3 (Max)Moonshot+1.57±0.75+5.16±1.57+2.03±2.24+0.29±1.20-2.33±0.97+0.75±0.06139,480$1.2013.5 分钟
2618–31Z.aiGLM-5.3 (Max)Z.ai+1.22±0.84+2.57±1.78+4.77±2.52-0.24±1.25-4.66±1.08+0.70±0.0888,117$0.93113.3 分钟
2717–32AnthropicClaude Haiku 5.5 (High)Anthropic+1.14±1.03+1.71±2.41-4.00±3.18+4.53±1.32+7.55±0.60-0.89±0.6527,887$0.1022.1 分钟
2820–31AlibabaQwen3.8-MaxAlibaba+1.13±0.61+3.83±1.30+1.10±1.85+1.43±0.87-0.87±0.71-0.83±0.2075,307$1.0513.1 分钟
2920–34SpaceXAIGrok 4.6 (xHigh)SpaceXAI+0.63±1.12-1.80±2.41-1.28±3.29+0.49±1.64+9.60±1.03+0.61±0.1029,832$1.349.5 分钟
3021–36OpenAIGPT-5.6 Terra (xHigh)OpenAI+0.22±1.32-4.36±2.73+2.03±4.01+2.03±2.02+1.45±1.52+0.55±0.1425,167$0.5972.7 分钟
3121–37DeepSeekDeepSeek-V4-Pro (High, 20260813)DeepSeek-0.27±1.73-3.18±3.91+0.59±5.25-0.38±2.45+2.37±1.32+0.59±0.137,331——
3228–37OpenAIGPT-6 Luna (Medium)OpenAI-0.56±0.89-5.61±2.12-3.07±2.71+2.08±1.21+6.99±0.79+0.61±0.1228,207$0.0251.8 分钟
3329–37GoogleGemini 3.7 Flash (High)Google-1.27±0.96-2.91±2.08-2.16±2.63-4.53±1.60+6.77±1.23+0.48±0.1456,113$0.5526.3 分钟
3431–37Z.aiGLM-5.3-FlashZ.ai-1.77±0.67+2.44±1.53-2.89±1.89-3.27±1.08-9.89±0.84+0.70±0.0792,133$0.1506.5 分钟
3530–41StepFunStep 5 PreviewStepFun-2.03±1.44-0.53±3.30-4.76±4.24+0.41±2.06-9.88±1.41+0.66±0.1215,412$0.5169.7 分钟
3629–42MiniMaxMiniMax-M3.1-Flash初步结果MiniMax-2.25±1.92+3.05±4.37-5.05±5.85-5.60±3.09-5.48±1.34+0.21±0.259,625$0.1897.2 分钟
3730–44Beam 1.0 501B A23BReflection-3.04±2.47-7.20±4.83-2.21±7.67-5.57±3.29+4.45±3.31-0.94±0.7512,147$0.31553 秒
3835–42AlibabaQwen3.8-Flash-NextAlibaba-3.27±0.70+1.62±1.56-3.83±2.09-2.05±1.00-19.43±0.74-0.75±0.15105,281$0.21511.1 分钟
3935–42AlibabaQwen3.8-27BAlibaba-4.10±0.79-2.58±1.81-6.53±2.22-3.74±1.24-11.05±1.29-0.08±0.1962,625$0.3888.2 分钟
4035–45GoogleGemini 3.1 Pro PreviewGoogle-4.45±1.32-12.28±2.62-2.37±3.28-6.39±2.74+2.25±3.32-0.09±0.6387,676$0.5463.0 分钟
4136–44OpenAIGPT-6 Luna (Low)OpenAI-4.59±1.02-12.61±2.57-8.69±2.88-0.67±1.37+1.27±1.12+0.69±0.1118,454$0.01047 秒
4235–47MistralMistral Large 4Mistral-5.06±1.98-0.33±3.96-5.09±5.36+0.11±3.61+1.06±1.66-18.00±1.7314,080$0.84710.6 分钟
4339–47AlibabaQwen3.7-MaxAlibaba-6.43±1.16-9.93±2.60-10.22±2.83-10.53±2.15+3.96±2.87-0.23±0.3742,729$0.3322.1 分钟
4439–48TencentHy3Tencent-6.80±1.44-11.58±2.96-7.89±3.72-0.76±2.01-12.55±3.81-4.08±2.3831,979$0.0743.2 分钟
4542–47MetaMuse Spark 1.1Meta-6.86±0.65-6.22±1.48-12.72±1.56-11.52±1.22-1.40±1.49+0.27±0.10149,239$0.4471.6 分钟
4642–48MetaMuse Spark 1.2 (xHigh)Meta-7.02±0.83-9.15±2.09-11.76±2.15-9.24±1.34-3.35±1.24+0.24±0.2153,539$0.4922.2 分钟
4741–49AlibabaQwen3.7-PlusAlibaba-7.44±1.77-10.23±3.57-10.31±3.97-10.75±2.80+1.70±2.98-3.06±3.5623,985$0.1324.6 分钟
4845–49MiMo-V2.5-ProXiaomi-8.66±1.00-10.73±2.37-14.28±2.41-12.78±2.00-0.29±2.03-1.03±0.3549,530$0.0715.7 分钟
4947–51MiniMaxMiniMax-M3MiniMax-10.07±1.21-17.20±2.74-16.22±2.47-9.99±2.11-0.12±2.11-1.85±2.5543,703$0.1421.9 分钟
5049–53MistralMistral Medium 3.5Mistral-12.13±1.73-17.51±3.95-17.44±3.83-12.82±3.03-6.67±4.55-3.46±1.4413,468$0.4912.8 分钟
5150–54NvidiaNVIDIA-Nemotron-3.5-Super-VL-120B-A12B (NVFP4)Nvidia-13.56±1.99-18.29±5.34-20.40±4.58-11.24±3.08-12.04±3.42-5.06±2.325,172$0.2033.7 分钟
5249–55NvidiaNemotron 3 UltraNvidia-14.71±3.94-23.01±8.29-16.44±8.71-16.76±7.88-18.61±15.39-0.68±1.1413,313$0.0993.6 分钟
5350–54InklingThinky-14.90±1.44-25.06±3.48-22.99±2.68-18.11±3.11+0.30±4.06-1.03±0.7543,905$0.3641.9 分钟
5451–54Inkling-SmallThinky-16.14±1.80-27.49±4.71-21.79±3.50-23.22±3.70+3.06±3.29-1.65±1.0314,421$0.1642.3 分钟
5554–55Solar Pro 4Upstage-20.25±2.16-29.37±5.80-22.49±4.28-15.27±3.51-42.70±8.18-2.65±1.6110,622$0.0502.8 分钟

分数为相对平均模型的百分点差值,所有信号均已统一为数值越高越好;± 为 95% 置信区间。成本与耗时为近 14 天单任务中位数。