← DeepSWE v1.1

DeepSWE v1.1: Score history

Benchmark scores get restated when harnesses change or models are re-run. This page keeps the trail instead of quietly overwriting it.

Timeline

No historical snapshots recorded yet — the current scores are shown below.

Current snapshot

#ModelScoreObserved
1Gemini 4 Argon77.9%2026-10-20
2DeepSeek V4.1-Flash 101777%2026-10-20
3DeepSeek V4.1-Flash 091074.2%2026-10-19
4Claude Opus 574%2026-10-19
5MiniMax M3.1 Flash73.7%2026-10-19
6GPT 5.6-Sol73%2026-10-19
7Grok 4.771%2026-10-19
8Kimi K367.5%2026-10-19
9GLM 5.366.9%2026-10-19
10DeepSeek V4-Pro 081362.7%2026-10-19
11DeepSeek V4-Flash 073154.4%2026-10-19

Overwritten scores

Nothing has been overwritten yet.