| Keep-alive cost study | 5 repetitions at 100,026 tokens; smaller prefixes of 50,011 and 29,993 tokens ran once each 26 Oct 2026 | 90% Cheaper resume after 1 hour idle with keep-alive (Sonnet 5.5, 100,026-token cached prefix; the cold resume is modelled: $0.4004 vs ping + resume $0.0408) +$0.3597 Net saved per resume after 1 hour idle (1 ping; Sonnet 5.5, 100,026-token prefix, cold arm modelled) 85% Cheaper resume after 2 hours idle (2 pings, net +$0.3392) 80% Cheaper resume after 3 hours idle (3 pings, net +$0.3188) $0.0204 Cost of a chain nobody resumes after 1 hour (1 ping), nothing saved 5% Share of idle chains that must end in a resume for the pings to pay off after 1 hour (2 hours: 11%, 3 hours: 16%) | Cache: the one-hour expiry was not waited out; the cold resume is a never-seen prefix, which bills the same full cache write. Cache: how often people come back after an hour or more was not measured; the break-even shares say how often they must. | docs/evals/2026-10-26-cache-keepalive.md
|