GPT-4o(2024-11-20)vsGPT-4o
Across 8 shared benchmarks, GPT-4o leads overall: GPT-4o(2024-11-20) wins 2, GPT-4o wins 3, with 3 ties and an average score difference of -1.81.
GPT-4o(2024-11-20)
OpenAI · 2024-11-20 · Chat model
GPT-4o
OpenAI · 2024-05-13 · Multimodal model
GPT-4o(2024-11-20)2 wins(25%)Ties3(38%)3 winsGPT-4o
Benchmark scores
Grouped by capability, sorted by largest gap within each. 8 shared benchmarks.
Coding and Software Engineer
GPT-4o(2024-11-20) 1/2| Benchmark | GPT-4o(2024-11-20) | GPT-4o | Diff |
|---|---|---|---|
| HumanEval | 90.2015 / 140Normal (No Tools) | 9016 / 140Normal (No Tools) | +0.20 |
| SWE-bench Verified | 31111 / 116Normal (No Tools) | 31111 / 116Normal (No Tools) | — |
General Knowledge
GPT-4o 1/2| Benchmark | GPT-4o(2024-11-20) | GPT-4o | Diff |
|---|---|---|---|
| MMLU | 85.7039 / 124Normal (No Tools) | 88.7016 / 124Normal (No Tools) | -3 |
| MMLU Pro | 77.9077 / 176Normal (No Tools) | 77.9077 / 176Normal (No Tools) | — |
Math and Reasoning
GPT-4o 1/2| Benchmark | GPT-4o(2024-11-20) | GPT-4o | Diff |
|---|---|---|---|
| MATH | 68.5024 / 42Normal (No Tools) | 75.9016 / 42Normal (No Tools) | -7.40 |
| FrontierMath | 0.3057 / 60Normal (No Tools) | 0.3057 / 60Normal (No Tools) | — |
Agent Level Benchmark
GPT-4o 1/1| Benchmark | GPT-4o(2024-11-20) | GPT-4o | Diff |
|---|---|---|---|
| Aider-Polyglot | 18.2050 / 59Normal (No Tools) | 23.1046 / 59Normal (No Tools) | -4.90 |
Common Sense
GPT-4o(2024-11-20) 1/1| Benchmark | GPT-4o(2024-11-20) | GPT-4o | Diff |
|---|---|---|---|
| SimpleQA | 38.8021 / 47Normal (No Tools) | 38.2022 / 47Normal (No Tools) | +0.60 |
Specs
| Field | GPT-4o(2024-11-20) | GPT-4o |
|---|---|---|
| Publisher | OpenAI | OpenAI |
| Release date | 2024-11-20 | 2024-05-13 |
| Model type | Chat model | Multimodal model |
| Architecture | Dense | Dense |
| Parameters | Not available | Not available |
| Context length | 128K | 128K |
| Max output | Not available | 16K |
API pricing
Prices use DataLearner records when available; missing fields are not inferred.
| Item | GPT-4o(2024-11-20) | GPT-4o |
|---|---|---|
| Text input | Not public | $2.5 / 1M tokens |
| Text output | Not public | $10 / 1M tokens |
One or both models have incomplete public pricing.
Summary
- GPT-4o(2024-11-20)leads in:Coding and Software Engineer (1/2), Common Sense (1/1)
- GPT-4oleads in:General Knowledge (1/2), Math and Reasoning (1/2), Agent Level Benchmark (1/1)
On average across the 8 shared benchmarks, GPT-4o scores 1.81 higher.
Largest single-benchmark gap: MATH — GPT-4o(2024-11-20) 68.50 vs GPT-4o 75.90 (-7.40).
Page generated from structured model, pricing and benchmark records. No real-time LLM is used to write the prose.