GPT-4o(2024-11-20) leads on the shared-benchmark average
Ahead on 2 of 3 shared benchmarks, averaging 4.2 points higher
Summarised only from the 3 percentage-scale benchmarks scored by every selected model; details are below.
“Best available” takes each model’s best recorded non-parallel result in the metric’s stated direction per benchmark, so it may combine modes into a virtual configuration that does not exist. Read it with the mode breakdown.
Benchmark-by-benchmark comparison. Changing the thinking mode or tool filters updates the chart and table below.
“Best available” picks the best non-parallel result in the metric’s stated direction separately for each benchmark. The resulting series can combine several reasoning levels and is not one reproducible runtime configuration. Choose a mode filter to compare like-for-like runs.
Data sourced primarily from official releases (GitHub, Hugging Face, papers), then benchmark leaderboards, then third-party evaluators. Learn about our data methodology
Each axis is the mean percentage score of one benchmark domain. It is an average, not a capability rating.
Relative edge: none clear / Relative gap: 数学推理 -8.4
Relative edge: 数学推理 +8.4 / Relative gap: none clear
Method: for each model and benchmark, all scores in the current mode scope are averaged (not the best score), then those benchmark scores are averaged within each domain. Only benchmarks scored on a 0-100 scale by at least two of the selected models count — Elo and rating-scale benchmarks such as Codeforces or Arena are excluded, because averaging a 1500 rating with an 85% accuracy produces a meaningless number. Missing values are not counted as zero, and the averages are unweighted, so domains with harder benchmarks read lower.
Every model and runtime mode, benchmark by benchmark. Values are comparable along a row, not between different benchmarks.
4 benchmarks with comparable scores. Each model shows its best score; mode label is displayed below.
Official list prices per model API, split by input and output. Unit: USD per 1M tokens.
Architecture, licensing and API modalities. "Not provided" means the field is missing from our database.
| Features & specs | Claude3-OpusAnthropic | GPT-4o(2024-11-20)OpenAI |
|---|---|---|
Core specsRelease | 2024-03-04 | 2024-11-20 |
Context length | 200K | 128K |
Architecture | Undisclosed | Undisclosed |
Availability & licensingCode availability | Not public | Not public |
Weight availability | Not public | Not public |
Use & commercial terms | Official service only; subject to provider terms | Official service only; subject to provider terms |
ResourcesPaper / report | Introducing the next generation of Claude | Not provided |
DataLearner blog | 评测结果超过GPT-4，Anthropic发布第三代大语言模型Claude3，具有多模态能力，实际评测表现优秀！ | Not provided |
GPT-4o(2024-11-20)
OpenAI
