Same errors, right answers.
661 real failed transactions from DeepBook v3, Cetus CLMM, Bluefin Spot (CLMM), read through Tatum over 13 days. The first 435 taught Ticketwise. The last 226 were answered with memory off and on.
0 of 226 later tickets answered with what the team taught. Without memory it can only explain the abort code.
226 of 226 answered from a teammate's correction, 226 with the right meaning.
Day one knows nothing. Day two answers almost everything.
The same 661 failures, played forward one day at a time against a fresh Walrus Memory namespace. Each day's tickets are answered only from corrections taught on earlier days; at the end of the day the team teaches each new error once. 595 of 661 tickets (90%) were answered from memory with 10 corrections. Tickets for an error nobody had taught yet count as unanswered.
How the replay was run.
The failures are split by time, so nothing from the later part leaks into teaching. For each distinct error in the earlier part, one correction was saved to Walrus Memory, with its meaning taken from the contract's own source. The replay found 10 distinct errors, and 10 were taught. All 8 errors in the later part had already appeared earlier, so every later ticket had a correction to draw on. An error that only shows up later would stay unanswered until someone teaches it.
| Error | Name in contract source | Later tickets | Answered from memory | Taught earlier |
|---|---|---|---|---|
| deepbook::big_vector#5 | ENotFound | 76 | 76 | Yes |
| cetus::pool#11 | EWrongSqrtPriceLimit | 54 | 54 | Yes |
| bluefin::clmm_math#3018 | EINVALID_FIXED_TOKEN_TYPE | 38 | 38 | Yes |
| deepbook::balance_manager#3 | EBalanceManagerBalanceTooLow | 23 | 23 | Yes |
| bluefin::pool#1009 | EInvalidPriceLimit | 23 | 23 | Yes |
| bluefin::pool#1010 | ESlippageExceeds | 9 | 9 | Yes |
| bluefin::gateway#1033 | ECannotClaimZeroReward | 2 | 2 | Yes |
| bluefin::pool#1018 | ENonEmptyPosition | 1 | 1 | Yes |
Run 2026-11-10 08:21 UTC against Walrus Memory on Sui mainnet. Script: scripts/run-scorecard.mts.