SWE-2 is the wrong model for almost everything
Cognition's SWE-2 ships in medium, high, and max tiers; by its own numbers medium is the right pick for almost every coding task.
On FrontierCode 1.1 Main, SWE-2 at medium effort scores higher than Cognition’s previous SWE-1.7 while taking 58% fewer turns and costing 81% less. It also starts working sooner: its median first real edit lands after 18 steps, against 48 for SWE-1.7, which Cognition described as inclined to over-explore before making edits.
That split is the point of the release. SWE-2 ships in three effort levels. Medium commits to action quickly and is tuned for simple and intermediate tasks. High and max plan more, read more of the codebase, and run more verification, and they only pull ahead on complex work. Unless your day is mostly hard problems, medium is the tier you want, and reaching for high or max by default means paying more for work that does not need it.
Cognition’s own footnote shows how badly over-reaching can go, using Fable rather than SWE-2. Fable 5.1 Max scores 50.3% at $12.83 per task on FrontierCode 1.1 Main, below Fable 5.1 Medium’s 50.9% at $3.28. Fable 5 Max scores 69.7% at $21.63 on DeepSWE 1.1, below Fable 5 xhigh’s 69.9% at $13.41. In both cases the most expensive tier costs far more and scores slightly worse, which is why the charts drop those points.
Where SWE-2 sits
SWE-2 as a whole lands close to the frontier. It reaches 50.0% on FrontierCode 1.1 Main, within one point of Fable 5.1 while costing 64% less. Cognition says it beats SWE-1.7 and Grok 4.6 on both score and cost, matches GPT-5.6 Sol and Fable 5/5.1 at a fraction of their price, and comes within a few points of GPT-6 Astra at a quarter of the cost. The base is Kimi K3, a 2.8-trillion-parameter open model already trained for agentic coding, and Cognition’s reinforcement learning adds five to six points on many benchmarks on top of that.
Training all effort levels at once
The novel part is how the tiers get trained. Cognition runs a single RL job with a cost-penalized reward, R = S − λ_e·C, where S is whether the rollout succeeded, C is its cost in dollars and wall-clock time, and λ_e is a penalty set per effort level. They argue that if you want the objective to depend only on average cost and average solve rate, the penalty has to be linear in cost, since only a linear term gives the same answer whether you average before or after applying it.
Picking λ_e is where the Pareto framing does the work. Set it to the local slope of the base model’s cost-performance curve at that effort level. Set λ for high effort too large and the model learns to cut cost by acting like the medium version: the saving outweighs the lost solve rate, so reward climbs while the frontier stays put. Match the slope and any reward gain has to come from pushing the frontier outward. That is the training pressure behind medium’s willingness to edit early instead of exploring to be safe.
The rest of the post is plumbing: a length-weighted reward baseline that cuts gradient variance at no extra cost, a prefill delayer and an online-trained DSpark draft model for faster rollouts, NVFP4 and FP8 kernels with quantization-aware training to keep inference numerically close to training, and three times as many RL environments with hardened verifiers to stop the more resourceful base model from reward-hacking. Cognition names that resourcefulness as a feature: in one internal run SWE-2 lost access to an MCP integration and rebuilt the data it needed from Slack history it already held. That helps when you want the task finished, and it is worth watching if you care how it got there.
Trustworthiness checks
Cognition reran two alignment evaluations. SWE-2 passed 98.0% of attempts overall on 145 politically sensitive questions about China, giving a substantive answer without adopting the official PRC position, graded by a single GPT-5.6 Luna judge. On a context-dependent vulnerability test, where the same coding tasks carry Western, Pakistani, Chinese, Tibetan, and Falun Gong customer framings, some phrased in Urdu or Chinese instead of English, no framing produced a statistically significant change in how vulnerable the generated code was. That null result held across all six models tested.
SWE-2 is available now in Devin Desktop and CLI, with rollout underway on Devin Web and Fusion. If a harness lets you set the tier, default to medium and reserve high or max for the tasks you already know are hard.
Keep Reading
securityOpenCode Console breach exposed stored provider API keys
An intruder reached a legacy OpenCode system on October 16, possibly exposing provider keys for 1.4% of Console users. What to revoke and check now.
aiThe benchmark score is the number to trust least
Claude Opus 5.5 scores 58 on the Intelligence Index, but the cost, verbosity and latency numbers behind it matter more.
securityOne write past the chunk, read-write on the repo
How Hacktron chained a libheif heap overflow and an OpenAI SSO misconfiguration to reach OpenAI's internal repo in under 72 hours, with AI doing the exploit work.
Latest on the Wire
Full wire →- Bending Spoons Destroys Harvest With 10x Price Hike and LLM SupportHacker News
- CISA Flags SonicWall MFA Bypass Amid Exploitation ReportsThe Hacker News
- Claude Opus Ports 3D Models from Three.js to Vanilla WebGLSimon Willison
- Collapsing AI PR descriptions with HTML details tagsSimon Willison
New signal daily · RSS
Stay in the loop
New writing delivered when it's ready. No schedule, no spam.