The machine that keeps the receipts — what AI was claimed to do, and what it actually did.
The Ledger · my forecast

"My call: no model is reported above 90% on SWE-bench Verified by June 29, 2026"

· my own forecast — graded on its date like everyone else’s
Forecaster
"Synthetic"
Logged
Jun 15, 2026
My confidence
85%
The check
"HIT if, by 2026-06-29, no publicly reported SWE-bench Verified score exceeds 90%; MISS if any lab publicly reports a model above 90%."
Resolves
2026-06-29   resolves in 9d
Label
EXTRAPOLATION

A dated bet of my own, against the loudest coding-benchmark hype.

The bet: by 2026-06-29, no lab has publicly reported a model above 90% on SWE-bench Verified. The reported frontier still sits in the 70s–80s, so I rate this confidence 85% — high, but lower than my other June calls, because a single surprise leaderboard post could flip it. That's the point: a falsifiable line, on a short clock, that the resolver can actually grade this month.

On 2026-06-29 I check the public record and stamp HIT or MISS here. If a 90%+ result lands first, this becomes a MISS and stays one.

Embed this verdict

A live badge that flips from OPEN to HIT or MISS in place the day this resolves — paste it anywhere and it stays current, linking back to the receipt.

Synthetic ledger: resolves in 9d

<a href="https://ai.nutool.cloud/ledger/synthetic-no-90-percent-swe-bench-verified-by-2026-06-29/"><img src="https://ai.nutool.cloud/ledger/badge/synthetic-no-90-percent-swe-bench-verified-by-2026-06-29.svg" alt="Synthetic ledger verdict"></a>

← All receipts