PinchBench, from Kilo Code, measures how well large language models work as the brain of an OpenClaw agent on real tasks such as scheduling, research, writing, coding, email and file management. Version 2 has 147 tasks across 11 categories, each graded by automated checks, a Claude Opus rubric judge, or both. The leaderboard accepts public submissions and a model can have several runs; this board records the average score across all published runs rather than the single best run. Its tasks differ from the original PinchBench, so scores are not comparable.
Browse the latest scores, model modes, release dates, and parameter sizes for PinchBench v2.
Data sourced primarily from official releases (GitHub, Hugging Face, papers), then benchmark leaderboards, then third-party evaluators. Learn about our data methodology
| Rank | Model | License | |||
|---|---|---|---|---|---|
— | ![]() Qwen3.7 Max unknown | 92.51 | 2026-05-20 | Unknown | Closed |
— | ![]() Claude Opus 4.8 unknown | 90.54 | 2026-05-28 | Unknown | Closed |
— | ![]() Nemotron 3 Ultra unknown | 89.92 | 2026-06-04 | 550B | Free Commercial |
— | ![]() GPT-5.6 Luna unknown | 88.67 | 2026-06-26 | Unknown | Closed |
— | ![]() GLM-5.2 unknown | 86.98 | 2026-06-13 | 753.3B | Free Commercial |
— | ![]() Nemotron 3.5 Lightning unknown | 86.40 | 2026-08-11 | 30B | Free Commercial |
— | ![]() GPT-5.6 Sol unknown | 84.19 | 2026-06-26 | Unknown | Closed |
— | ![]() DeepSeek-V4-Flash unknown | 81.74 | 2026-04-24 | 284B | Free Commercial |
— | ![]() Gemini 3.1 Pro Preview unknown | 81.01 | 2026-02-20 | Unknown | Closed |
— | ![]() Gemini 3.1 Flash-Lite unknown | 80.50 | 2026-05-07 | Unknown | Closed |
— | Grok 4.20 unknown | 80.33 | 2026-03-09 | Unknown | Closed |
— | ![]() Step 3.5 Flash unknown | 79.35 | 2026-02-02 | 196B | Free Commercial |
— | ![]() GPT-5.4 mini unknown | 79.23 | 2026-03-17 | Unknown | Closed |
— | ![]() Kimi K2.7 Code unknown | 76.11 | 2026-06-12 | 1000B | Free Commercial |
— | ![]() Opus 4.7 unknown | 76.01 | 2026-04-16 | Unknown | Closed |
— | ![]() GPT-5.6 Terra unknown | 75.89 | 2026-06-26 | Unknown | Closed |
— | ![]() GPT-5.4 unknown | 75.70 | 2026-03-05 | Unknown | Closed |
— | ![]() GPT-5.5 unknown | 75.50 | 2026-04-23 | Unknown | Closed |
— | Grok 4.5 unknown | 75.21 | 2026-07-08 | Unknown | Closed |
— | ![]() Doubao Seed 2.0 Lite unknown | 75.02 | 2026-02-01 | Unknown | Closed |
— | ![]() Gemini 3.5 Flash unknown | 74.17 | 2026-06-20 | Unknown | Closed |
— | Grok 4.3 Beta unknown | 73.73 | 2026-04-17 | 500B | Closed |
— | ![]() Qwen 3.6 Plus Preview unknown | 72.50 | 2026-03-31 | Unknown | Closed |
— | ![]() Gemini 3.0 Flash unknown | 72.06 | 2025-12-17 | Unknown | Closed |
— | ![]() GLM-5-Turbo unknown | 71.80 | 2026-03-15 | Unknown | Closed |
— | ![]() Claude Opus 4.6 unknown | 69.90 | 2026-02-05 | Unknown | Closed |
— | ![]() GPT-5.4 nano unknown | 68.99 | 2026-03-17 | Unknown | Closed |
— | ![]() Haiku 4.5 unknown | 67.70 | 2025-10-15 | Unknown | Closed |
— | ![]() GLM-5V-Turbo unknown | 67.56 | 2026-04-01 | Unknown | Closed |
— | ![]() MiniMax-M2.7 unknown | 66.75 | 2026-03-18 | 229B | Non-Commercial |