Replace old large results
The relay replaces old, large tool results with short stubs and keeps the originals encrypted per key. The lab defaults were: keep 12 messages, results >= 1,500 estimated tokens.
Replace eligible old tool results with short stubs, keep the originals encrypted per key, and retrieve them when the model needs them.
API relay + recall tool · opt-inEvidence snapshot: 27 Oct 2026 · per-lever live deployment not verified
Availability differs between the API relay and the local plugin. Whether each lever is deployed on the live relay has not been independently checked.
The relay replaces old, large tool results with short stubs and keeps the originals encrypted per key. The lab defaults were: keep 12 messages, results >= 1,500 estimated tokens.
The Tokensitter recall tool retrieves an original result. Each recall adds an extra round trip, which belongs in the cost accounting.
The lever acts when the cache is cold or the expected saving repays rewriting it. It disables itself for a conversation if recalls become too frequent.
Exact line-number questions test source retrieval. Sessions where the model asked for the original back when the answer sat in a shortened result: 18 of 20. With so few sessions the result is compatible with a real quality drop of up to roughly 10 points, and it does not establish broad reasoning or editing equivalence.
Checks that would strengthen this evidence. They are not yet reported for this feature:
Check answers against an objective test, not against how plausible they look.
Include cache writes, cache reads, retries, recalls and helper calls when they apply.
Keep the tested model, task type and cache condition beside the result.
Keep observed misses and untested conditions visible.
5 synthetic agent sessions of 13-18 file reads each, built from files of public packages; Sonnet 5.5. The original transcript is compared with the same request passed through the lever. Warm busy sessions and cold resumes are separate conditions.
Results are copied from our lab reports (snapshot 27 Oct 2026) and were not re-run for this website.
| Experiment | Workload and date | Result | Limits | Report |
|---|---|---|---|---|
| Reversible-context study | 5 synthetic agent sessions of 13-18 file reads each; Sonnet 5.5 Run date 2026-10-26 | -63% Hono transcript, first turn after an idle gap with a cold cache: $0.1740 to $0.0644 -58% Undici transcript, first turn after an idle gap: $0.2275 to $0.0960 -56% Ajv transcript, first turn after an idle gap: $0.1206 to $0.0536 -51% MCP SDK transcript, first turn after an idle gap: $0.1625 to $0.0789 -38% Anthropic SDK transcript, first turn after an idle gap: $0.1353 to $0.0842 $0.00 Saved on a warm, busy session in all 5 transcripts: the lever held back by design 30 of 30 Line-number answers correct with the lever (30 of 30 without it) 18 of 20 Sessions where the model asked for the original back when the answer sat in a shortened result | Cost of recalls: 38 model calls for the 20 early-question sessions instead of 20. Scripted agent turns, one model, API keys through the relay only. |
|
Lab results at Anthropic API list prices on fixed tasks show what a lever did on those tasks, not what it will do on your bill. For plugin levers on Pro or Max, list-price values describe usage economics, not the subscription invoice. Relay levers apply to API keys only.
Read the measurement method and evidence limitsNo. Lab figures describe fixed tasks and settings. Read the quality outcomes and limits next to each result.
The workload, date, uncertainty and report name are in the table above. The repository is private, so there are no source links, and customer data is never included.
Add Tokensitter to Claude Code and see where your tokens go.