A long-horizon software engineering benchmark from Datacurve with 113 original tasks across 91 active open-source repositories and five programming languages. It emphasizes multi-file changes, behavioral correctness, and reduced contamination risk.
Browse the latest scores, model modes, release dates, and parameter sizes for DeepSWE.
Data sourced primarily from official releases (GitHub, Hugging Face, papers), then benchmark leaderboards, then third-party evaluators. Learn about our data methodology
| Rank | Model | License | |||
|---|---|---|---|---|---|
 GPT-5.6 Sol Thinking Level · Extra HighTools | 72.70 | 2026-06-26 | Unknown | Closed | |
 Claude Fable 5 Deep Thinking ModeTools | 70.00 | 2026-06-09 | Unknown | Closed | |
GPT-5.6 Terra Thinking Level · Extra HighTools | 69.60 | 2026-06-26 | Unknown | Closed | |
4 |  Kimi K3 Thinking Level · MaxTools | 67.50 | 2026-07-16 | 2800B | Free Commercial |
5 | GPT-5.6 Luna Thinking Level · Extra HighTools | 67.20 | 2026-06-26 | Unknown | Closed |
6 | GPT-5.5 Thinking Level · Extra HighTools | 67.00 | 2026-04-23 | Unknown | Closed |
7 | Claude Opus 4.8 Deep Thinking ModeTools | 59.00 | 2026-05-28 | Unknown | Closed |
8 | Claude Sonnet 5 Deep Thinking ModeTools | 54.00 | 2026-06-30 | Unknown | Closed |
9 |  Muse Spark 1.1 Thinking EnabledTools | 53.30 | 2026-07-09 | Unknown | Closed |
10 |  Grok 4.5 Thinking Level · HighTools | 53.00 | 2026-07-08 | Unknown | Closed |
11 | GPT-5.4 Thinking Level · Extra HighTools | 52.00 | 2026-03-05 | Unknown | Closed |
12 |  GLM-5.2 Deep Thinking ModeTools | 44.00 | 2026-06-13 | 753.3B | Free Commercial |
13 |  Gemini 3.5 Flash Thinking Level · MediumTools | 37.00 | 2026-06-20 | Unknown | Closed |
14 | Kimi K2.7 Code Standard ModeTools | 31.00 | 2026-06-12 | 1000B | Free Commercial |
15 | Claude Sonnet 4.6 Thinking Level · HighTools | 30.00 | 2026-02-17 | Unknown | Closed |
16 |  Hy3 Thinking Level · HighTools | 28.00 | 2026-07-06 | 295B | Free Commercial |
17 | Gemini 3.1 Pro Preview Thinking Level · HighTools | 12.00 | 2026-02-20 | Unknown | Closed |
