context-doctor
Profiles and optimizes OpenAI chat conversation contexts, providing token breakdowns, duplicate content removal, base64 stripping, and in-flight API request optimization via a proxy for GPT and ChatGPT.
Click on "Deploy Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@context-doctorProfile this conversation and suggest what to trim to save tokens."
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
context-doctor ๐ฉบ
See where your AI agent's tokens go, and stop paying for the ones that do nothing.
AI agents re-send their whole context on every message: old tool output, pasted files, long instructions. A 500k-token session pays for all of it again each time, and at full price after a coffee break, when the prompt cache has expired. context-doctor measures that waste on your own sessions, in dollars, and removes it at the moments it pays: before it enters the context, while it sits there, and on every request.
It runs on your machine, needs no API key, sends no telemetry, and works with Claude Code, Claude Desktop, Cursor, Codex, Gemini CLI, any app on the Anthropic, OpenAI or Gemini API, and CI. MIT licensed, Node 20+, macOS, Linux and Windows.
npx context-doctor savings # what your recent sessions cost, and what each fix would have savedQuick start
Pick where you work. Each takes about a minute and is fully reversible.
You use | Do this |
Claude Code (terminal, IDE, desktop app) | Inside Claude Code: |
Everything on this machine at once |
|
Claude Desktop, Cursor or any MCP client | Add the server to the client's MCP config (or install the one-click |
claude.ai, ChatGPT, phone apps |
|
Your own app on an LLM API | Run |
Python / RAG pipelines |
|
GitHub pull requests |
|
Related MCP server: Context Engine
What it does
Measure, in dollars, on your own history
savings: what your recent Claude Code sessions cost and what each fix below would have saved, replayed request by request against what you were billed.overhead: what every request re-reads before your message (system prompt, tools, MCP servers, CLAUDE.md, rules, memory), each file priced per month.tasks: cost per commit, per project, from each session's recorded usage and its owngit commitcalls.reads: the files read into session after session, and whether a CLAUDE.md summary orpackwould pay.session,watch,analyze,report,dashboard: token breakdown and wasted-context findings for any session, conversation file or agent trace.
Keep waste out of the context
pack(and thepack_contextMCP tool): only the chunks of a big document, PDF, log or codebase that a question needs, within a token budget, instead of the whole thing.overhead split: turns a heavy CLAUDE.md or memory file into a lean one plus a reference file the agent opens when needed, word for word, nothing lost.ciand the GitHub Action: review memory-file growth like any other cost.
Remove waste automatically
An every-prompt hook (Claude Code, Codex, Gemini CLI; Cursor after each tool call) tells the model its real context size and the largest waste, and offers
/compactwhen you return to a big session after the cache expired.compact-window: sets Claude Code's own auto-compact window, measured on your history first. Works in the desktop app too.Autopilot: a local proxy (or SDK wrapper) that clears stale tool output only when the prompt cache is cold, so a request never costs more.
What it has measured
On the author's own Claude Code history (mostly Opus and Fable models with the 1M window, priced at API list prices; savings computes yours the same way):
Compacting when you come back after the cache expired: 401 such returns in 133 days; compacting then would have saved $4,053 net, about $914 a month. Details โ
A 400k auto-compact window instead of ~970k: 55% less input cost over 30 days ($6,119 to $2,757), for 15 compactions a week instead of 5. The trade-off โ
Autopilot: 9.8% less input cost, no session made more expensive.
pack: 9 of 10 questions about this repository answered from 0.6% of its tokens. How โ
Counting Claude correctly: current Claude models pack 2.75 characters per token, not the 4 most tools assume, so estimates built on 4 undercount Claude by about 40%.
context-doctor accuracyre-checks the ratio on your own sessions.
On a Claude subscription you do not pay list price; the same tokens come out of your usage limit instead, so read the dollars as the size of the effect.
Built and maintained by gAI Ventures.
Which context-doctor is this? Several projects share the name. This one is
context-doctoron npm andio.github.KushalP1/context-doctorin the official MCP Registry.
A profile looks like this (npx context-doctor analyze conversation.json, or session for your latest Claude Code session):
Where the tokens go
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
Tool results โโโโโโโโโโโโโโโโโโโโโโโโโโโโ 57% ~41k
System prompt โโโโโโโโโโโโโโโโโโโโโโโโโโโโ 21% ~15k
Assistant replies โโโโโโโโโโโโโโโโโโโโโโโโโโโโ 13% ~9.4k
User messages โโโโโโโโโโโโโโโโโโโโโโโโโโโโ 9% ~6.5k
Findings (4)
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
โ Message #12 contains a base64/binary blob (~8.2k tokens). [save ~7.4k]
โ Never put base64 in text content โ use the provider's file/image APIs.
โฒ Tool result at message #7 (web_search) is ~6.1k tokens. [save ~4.9k]
โ Truncate or summarize large tool outputs before they enter history.What it saves
Measured, not modelled, on every Claude Code session on the author's machine (mostly Opus 5 and Fable 5 with the 1M window), priced the way the prompt cache bills it (cached reads 0.1x, writes 1.25x) at API list prices. context-doctor savings runs the same measurement on yours.
1. Compacting when you come back (every Claude Code surface, desktop app included). 133 days, 401 returns to a session over 150k tokens after more than 65 idle minutes; median context at the return, 517k tokens.
Net saving had you run | $4,053 (about $914 a month) |
Returns where it paid off | 296 of 401 |
Worst single case | โ$2.30 (a session left a few messages later) |
Each return counts only the messages up to the next return, and the compaction request is charged as a cost. Not counted: files the model may re-read after compacting, and what the summary leaves out. That is why this is advice with the numbers attached, not something done for you.
2. Autopilot (terminal and IDE sessions, API apps). 130 days, 43 sessions, replayed through the shipped autopilot code with real timestamps:
Without autopilot | With autopilot | Saved | |
Input tokens sent | 41.4 billion | 37.6 billion | 3.8 billion (9.2%) |
Input cost at API list price | $48,962 | $44,268 | $4,694 (9.8%) |
Sessions made more expensive | 0 of 43 |
The median session saves 1.9%, the best 37.7%: long sessions are where the money is (94% of input cost on that machine came from requests above 200k tokens). These sessions ran in the desktop app, which autopilot cannot reach, so for the author this is what the same sessions would have saved in a terminal; context-doctor savings separates the two for you.
3. Compacting earlier (automatic, every Claude Code surface, desktop app included). The offer in 1 is advice, and on the author's machine it was followed 1 time in 33. Claude Code has a native setting that needs nobody to follow anything: autoCompactWindow in ~/.claude/settings.json makes it compact as if the window were that size. context-doctor compact-window replays each session request by request at several sizes, priced as the cache bills (each simulated compaction pays its own request and a 20k-token summary at the output rate), and changes nothing until you pick one:
Window | Input cost, last 30 days | Saved | Compactions a week |
as now (~970k) | $6,119 | 5.1 | |
600k | $3,570 | $2,549 (42%) | 6.5 |
400k | $2,757 | $3,362 (55%) | 14.7 |
300k | $2,353 | $3,766 (62%) | 24.5 |
200k | $1,963 | $4,155 (68%) | 46.9 |
29 sessions. The replay's baseline came within 9% of what the transcripts say was billed, on the low side. The cost is real: each compaction replaces the session's history with a summary, so a smaller window trades detail for money. That is why the command shows the table first and sets a window only when you name one (context-doctor compact-window 400k; off undoes it, and a backup of settings.json is kept).
On a Claude subscription you do not pay list price; the same tokens come out of your usage limit instead. Anthropic does not publish how limits weight cached tokens, so read the dollars as the size of the effect, not as your bill.
What happens on each platform
Where you work | Automatic, every request | What you get on top |
Claude Code in the terminal, VS Code or JetBrains | Autopilot clears stale tool output (cold cache only, never more expensive). Hook on every prompt: real context size, largest waste, and a | |
Claude Code in the desktop app's Code tab | Hook, as above, including the cold-resume | Install via npm or as a plugin ( |
Cursor (agent) | A native after-tool-call hook ( | MCP tools, editor status bar extension, |
Codex (ChatGPT app's Codex tab, IDE extension, CLI) | Every-prompt hook with the API's own token counts | MCP tools, skill, |
Gemini CLI | Every-prompt hook ( | MCP tools, |
Your own apps on the Anthropic, OpenAI or Gemini API | Autopilot on | Exact usage and cache hit rates in |
Claude Desktop chat | Standing context rules in every chat; one cheap | One-click |
claude.ai, ChatGPT, the phone apps | Your account's standing preferences ( | Profile an exported chat with |
CI |
|
|
Not claimed, because no process on your machine sends those requests: trimming inside Claude Desktop chat, claude.ai, ChatGPT, Cursor's own subscription models, or Codex signed in with ChatGPT. Those get the rules and the measurements above, not autopilot.
Before it enters the context: pack and overhead
Everything above slims context that is already there. Two commands stop it getting in.
pack: only the parts of a document a question needs. A 60k-token manual pasted to answer one question is paid on that message and re-read on every message after it. pack splits files and folders along their own structure (markdown headings, top-level code declarations, paragraphs; one-line logs and minified files are cut too), ranks the chunks against your question with BM25, and returns the best ones that fit a budget. Every chunk carries an id and its line range, and the result names the next-best ids, so asking for more is one call. Without a question you get an outline to pick from.
context-doctor pack docs/ README.md --query "how do I rotate the signing key" --max-tokens 3000
context-doctor pack big-manual.md # outline: id, lines, tokens, heading per chunk
context-doctor pack big-manual.md --ids big-manual.md#12,big-manual.md#13
cat server.log | context-doctor pack - -q "timeout upstream"$ context-doctor pack README.md src -q "how is the ledger kept from growing" --max-tokens 2000
PACKED ~1.9k of ~315k tokens (1%) from 80 files: 7 of 1026 chunks for "how is the ledger kept from growing", budget 2.0k.
โโ src/ledger.ts#6 ยท L108-128 ยท export function recordLedger(entry: Omit<LedgerEntry, "ts">): void { ยท ~404
...
โโ src/test/ledger.test.ts#1 ยท L1-22 ยท The ledger is capped, and everything it feeds is a LIFETIME total. ยท ~409
...
Not included: 1019 chunk(s). Next best: src/watch.ts#1 (...); src/test/compactwindow.test.ts#4 (...)In Claude Desktop, Claude Code, Cursor and Codex the same thing is the pack_context MCP tool, and the standing instructions tell the model to use it when it needs to answer from a large file it is not editing. Ranking is lexical, offline and keyless; it misses pure paraphrase, which is what the outline is for. If you run Ollama with an embedding model (ollama pull nomic-embed-text), --semantic (or semantic: true on the MCP tool) also ranks by meaning and merges the two rankings; chunk vectors are cached, so repeat packs are fast. Without one it says so and stays lexical. Measured on this repository (README plus source, ~305k tokens): 9 of 10 factual questions were answered from a 2k-token pack. PDFs, Word (.docx, .doc, .rtf), PowerPoint and ODT files are read with tools the OS already has (pdftotext where installed, PDFKit and textutil on macOS, unzip elsewhere); when none is available, pack says what to install. Over HTTP (the ChatGPT connector mode) the tool reads no files, only text you pass.
overhead: what every request re-reads before your message. The system prompt, tool and MCP schemas, skills and your memory files ride on every request: cached, so each read is cheap, but read on every request of every session and written again at full price after each cold start. Transcripts never show them. overhead measures the fixed part from the first request of each recent Claude Code session (the API's own count, minus your first message), lists every memory file each agent loads in the current directory (Claude Code's CLAUDE.md with its @imports, rules and auto memory; Codex's AGENTS.md; Cursor's always-applied rules; GEMINI.md), and prices each per month from your own request and cold-start counts.
Claude Code, last 30 days: 71 sessions start at a median ~54k tokens (p90 ~62k) before the first message.
Memory files loaded here are ~3.4k of that; the rest is Claude Code's system prompt, tools, skills and MCP schemas.
At your usage (14,104 requests, 249 cold starts, claude-fable-5-1 list prices) every 1k tokens of it costs ~$16.97 a month;Findings point at files over 2k tokens, paragraphs loaded twice from two files, and long code blocks that could live in a file the agent opens when it needs them.
To act on a finding, context-doctor overhead split <file> plans the fix: sections over ~400 tokens (or mostly code) move word for word to <name>.reference.md, each run of them leaving one pointer the agent follows when a task needs it. Lists of links are indexes and stay, and an auto-memory MEMORY.md keeps only its index, as Claude Code intends. Nothing is written until you add --write, which backs up the original first. On a copy of the author's auto-memory index: ~3.4k to ~1.7k tokens on every request, about $28 a month, nothing lost.
MCP servers are part of the same overhead: each one's tool definitions ride on every request. overhead counts calls per server from your transcripts, including servers the app or its connectors provide, and overhead --mcp launches each configured server once to size its definitions, flagging the ones you never call with what they cost a month. When Claude Code's tool search is on (the report says how often it was used), definitions are deferred and an idle server costs about its tool names instead.
What's new
0.29 Python, and where the work goes: a dependency-free Python package (
python/) withpack_documentsfor LangChain and LlamaIndex results,pack_context,estimate_tokensandprofile_messages, held byte for byte to the TypeScript by parity tests.context-doctor readsshows the files read into session after session;context-doctor tasksshows cost per commit per project, from your own transcripts.0.28 Wider reach:
/context-doctor:overheadand/context-doctor:packin the Claude Code plugin;packreads a folder inside a git repository the way git does, so.gitignore'd build output and secrets stay out;withContextDoctorwraps Google's@google/genaiclient too;overheadmeasures the fixed start-of-session cost of Codex and Gemini CLI sessions as well as Claude Code's, priced with each provider's cache rules.0.27 Keep waste out:
packand thepack_contextMCP tool put only the chunks of big files (text, code, PDF, Word, PowerPoint) a question needs into the context, within a budget;overheadmeasures and prices the front matter every request re-reads (system prompt, tools, CLAUDE.md, rules, memory, AGENTS.md, Cursor rules, GEMINI.md). MCP servers sized and their use counted;overhead splitturns a heavy memory file into a lean one plus a reference file.withContextDoctor(client)runs autopilot inside an Anthropic or OpenAI SDK client, for apps with no proxy. Gemini joins:installwires Gemini CLI's MCP server and every-prompt hook,sessionandwatchread its chats, and the proxy and autopilot carry Google's Gemini API. A GitHub Action (andcontext-doctor ci) reports memory-file growth on every pull request and gates on a budget. Re-verified on every surface: 229 tests on macOS, Linux and Windows, plus MCP, OpenAI and Gemini end-to-end smoke runs, now in CI, MCP over stdio and HTTP, the OpenAI proxy, and a livedoctor.0.26 Checked on every platform, three fixes: tested end to end in Claude Code (terminal, desktop app, plugin from GitHub), Claude Desktop, Cursor, Codex on GPT-5.5, VS Code, the MCP server on every launch path, and the proxy on OpenAI's APIs. Found and fixed: Cursor's agent never received the hook's guidance (Cursor runs Claude Code's hook where output cannot add context), so
installnow adds a native Cursor hook; Codex blocked the MCP tools behind an approval it never grants incodex exec, so the tools are now marked read-only; autopilot skipped Codex's newest tools (exec,wait) and some of Cursor's. Also: a history imported into Codex no longer reads as "2136% of the window", and the chat-app settings paths are current.0.25 Compact earlier, by itself: the
/compactoffer at cold resumes was followed 1 time in 33 on the author's machine, so two changes. The hook now also shows you the notice (it went only to the model, which rarely raised it), with the dollar cost of the message you just sent. Andcontext-doctor compact-windowmeasures and sets Claude Code's own auto-compact window, which works without anyone acting on advice, in every surface including the desktop app: 55% less input cost at 400k on the author's last 30 days.savingsshows it as a third lever.0.20 Autopilot: stale tool output cleared from every Claude Code request, only when the prompt cache is cold, so it cannot cost more (measured: 9.8% less input cost, ~$1,080 a month on the author's usage, no session worse); runs as a login service on macOS, Linux and Windows; now also for GPT via OpenAI's Chat Completions and Responses APIs.
0.24 A full audit, fixed: the session parser now rebuilds API messages from Claude Code's one-row-per-block transcripts (it had split each reply into several messages, breaking tool pairing in exported conversations and inflating profiles); the proxy forwards every non-conversation endpoint and never re-encodes bodies it does not rewrite (model listing and file uploads failed or were corrupted through it);
reportand the dashboard no longer count compaction as tokens context-doctor saved, and MCP sketches no longer inflate them;watchfollows plain conversation files; MCP inputs are bounded. 0.23: four dependency vulnerabilities patched, no false/compactalarm after compacting,savings --share.0.22 Honest about where each lever works, and a new one that works everywhere: the every-prompt hook now offers
/compactwhen you return to a large session after the cache expired (measured: ~$914 a month on the author's history), including in the desktop app. Found and fixed: autopilot cannot reach the desktop app's Code tab, anddoctornow says so instead of reporting โ;savingscounted whole-file history as "last 30 days"; the hook quoted per-message cost at the uncached rate (10x too high).--versionadded.0.21 See it before you install it:
npx context-doctor savingsreplays your own recent sessions through autopilot and shows what it would have saved, against what you were actually billed. Install as a Claude Code plugin from inside Claude Code. Ready for the official MCP Registry (io.github.KushalP1/context-doctor), which every release now publishes to; any MCP client can launch it asnpx -y context-doctor mcp.0.20.1 Releases that finish themselves: one tag publishes to npm and creates a GitHub release with the Claude Desktop bundle (signed when a certificate is configured); the editor extension is ready for the VS Code Marketplace and Open VSX.
0.19 Measured Claude tokenizer: estimates were 40% low for Claude; fixed from the API's own counts, with a per-model check in
accuracy.0.18
proxy --tokenfor putting the proxy on a public URL safely. 0.17 Claude Desktop: aprofile_contextthe model can afford to call from chat,.mcpbbundle, standing preferences for web and mobile. 0.16 Codex. 0.15 Cursor.
Full history with the measurements behind each change: ROADMAP.md.
Setup details
install configures every app it detects and does not stop at the first problem: a corrupt Claude Desktop config still gets you Claude Code and Cursor. It does not pretend either. Any target that failed is named with a โ line, the summary reads "Done with N problem(s)" instead of "Done.", and the exit code is 1, so dotfiles and onboarding scripts can react. A broken config file is never overwritten; fix it and re-run.
npx context-doctor install works too, but autopilot needs the global install: a background service cannot point into npx's cache, which npm deletes at will.
No API keys, ever. Everything is deterministic local code; when an LLM is needed (summarizing pruned history), the model already running in your app does it. The proxy forwards your app's credentials untouched โ context-doctor itself holds nothing.
What install actually does โ and what happens in every session after
One run of context-doctor install writes these (each config edit makes a .backup first; uninstall reverses all of it):
Claude Desktop config (
claude_desktop_config.json) โ registers the MCP serverClaude Code config (
~/.claude.json) โ registers the MCP serverCursor config (
~/.cursor/mcp.json) โ registers the MCP serverAgent Skill โ
~/.claude/skills/context-doctor/โ context-hygiene playbook for Claude CodeEvery-prompt hook โ
~/.claude/settings.jsonโ the per-query context check for Claude CodeCursor hook, when Cursor is present โ
~/.cursor/hooks.json(postToolUse) โ the same check for Cursor's agent, after each tool callCodex, when present: MCP server in
~/.codex/config.toml, the hook in~/.codex/hooks.json, the skill in~/.codex/skills/With
--statusline: live context size, cache share and cost in Claude Code's status bar
context-doctor autopilot on is separate and opt-in: it adds the background proxy service and one line (env.ANTHROPIC_BASE_URL) to ~/.claude/settings.json, after the proxy has answered a health check.
In every chat afterward (Claude Desktop, Cursor): when the conversation starts, the app launches the MCP server, which hands the model standing instructions that stay in force for the whole chat:
summarize large pastes and tool results instead of carrying them verbatim,
reference earlier content instead of re-quoting it, never inline base64,
once the chat passes ~30 turns or accumulates big pastes, proactively offer to profile it,
answer any "what's eating my context / cost / latency" question by calling
profile_context, not by guessing.
In every Claude Code / Cowork session afterward: all of the above via MCP, plus two more layers:
the skill loads whenever context work is relevant, and
the hook runs on every single prompt you send: lean sessions cost a ~1ms file-size check; once a session is heavy it profiles on growth events and injects a note the model sees with your message โ actual token count, cost per message, the single largest recoverable waste โ with instructions to work leaner and offer you compaction. It re-fires only after ~40% further growth, can never break a prompt (any failure exits silently), and logs each deep check to a small local ledger that feeds
context-doctor report.
What it never does: delete or rewrite your history without asking (pruning is consent-only, and the model writes the replacement summary so nothing is lost silently), send data anywhere (everything runs on your machine), or touch an API key.
Do you need MCP? Only sometimes โ all the ways to use context-doctor
MCP is just one of seven delivery mechanisms. It's only required when you want the AI inside a chat app to run the tools itself. Everything else works without it:
How you use it | MCP needed? | What it requires |
CLI โ | โ No | Nothing but |
Autopilot โ every Claude Code session, and GPT API apps | โ No |
|
Proxy โ always-on optimization of your API apps | โ No |
|
Claude Code every-prompt hook | โ No | Written by |
Agent Skill โ hygiene behavior in Claude Code / claude.ai | โ No | A markdown file; |
Library โ | โ No |
|
In-chat tools โ Claude Desktop, ChatGPT desktop, Cursor chat | โ Yes | This is the only MCP piece โ so the model itself can call |
Practical upshot: a developer who only wants cheaper, faster API calls never touches MCP (proxy + CLI). A Claude Code user gets the hook and skill without MCP either โ the MCP server just adds in-chat tools on top. install sets up all of it at once precisely so you don't have to think about which mechanism is which.
All commands at a glance
Command | What it does |
| Wire (or remove) everything: MCP for Claude Desktop/Code/Cursor/Codex, the Agent Skill, the every-prompt hook |
| What your recent Claude Code sessions cost, and what |
| Replay your last 30 days at auto-compact windows from 200k to 800k: input cost, saving, and how many more compactions each means. |
| The MCP server as a subcommand, for clients and registries that launch |
| Every new Claude Code session goes through the local proxy, which clears stale tool output only when the prompt cache is cold: measured 9.8% less input cost, no session worse |
| The ~180-token standing rules (~120 on GPT) for claude.ai / ChatGPT preferences, for web and phones where no server runs |
| Only the chunks of big documents, logs or code a question needs, ranked and fit to |
| What every request re-reads before your message: measured first-request size (Claude Code, Codex and Gemini CLI sessions), each memory file (CLAUDE.md and imports, rules, auto memory, AGENTS.md, Cursor rules, GEMINI.md) priced per month, MCP calls per server; |
| Move a memory file's big or code-heavy sections word for word to |
| Memory files (CLAUDE.md, AGENTS.md, GEMINI.md, rules, their imports) at HEAD vs a base commit; exit 1 over budget. What the GitHub Action runs |
| Profile a conversation: token breakdown, findings, cost + latency estimates. |
| Apply the safe fixes; add |
| Profile a Claude Code session: live context, findings, measured tokens and prompt-cache economics, where the wall clock went per tool, and what its subagents cost (their own windows, your bill; never in the parent's profile). Also reads ChatGPT data exports ( |
| Write a |
| Run one task twice from the same commit, in a fresh session and forked from an |
| Compare two profiles: what moved by category, which findings were resolved or introduced, and what it saves in money and latency |
| How much of what you are billed for is visible in your transcript (the fixed harness baseline, per-turn injected content), plus a tokenizer check: real chars/token per model from the API's own counts, next to the ratio the estimator uses |
| Profile a chat from Cursor's local history (both storage formats) |
| Machine-wide impact report (proxy savings persist across restarts): exact proxy savings, hook activity, how often the cold-resume |
| Always-on local proxy that optimizes every Anthropic/OpenAI API request in flight ( |
| Live monitor of a growing session transcript or agent trace (Claude Code / Codex JSONL, or a plain OpenAI/Anthropic conversation JSON file): token/cost line per change, findings as they appear |
| Self-check the whole installation โ one pasteable โ/โ diagnosis with fixes |
| Local savings dashboard on 127.0.0.1: tokens saved per day, sessions by context in use vs recoverable, budget status |
| Claude Code status bar: live context vs window, cache share, cost. Wired by |
| The every-prompt Claude Code hook (registered by |
| The MCP server itself โ stdio by default (what the installer wires); |
What "always-on" means, per surface
Where you run LLMs | Mechanism | Guarantee |
Claude Code sessions, with autopilot on | The login-service proxy clears stale tool output from every request, only when the cache is cold | Every request; never more expensive (measured) |
Your own apps/agents (API) |
| Every call, automatic |
Claude Code / Cowork sessions |
| Every query checked |
Claude Desktop chat / Cursor | MCP server instructions โ standing hygiene directives injected into every conversation where the server is enabled, plus prescriptive tool triggers | Every conversation carries the rules |
claude.ai (web) / ChatGPT / phone apps |
| Every chat on that account carries the rules |
Without autopilot nothing runs in the background: the hook, skill, MCP server and its instructions are delivered by the apps themselves at the right moment. With autopilot, one small proxy runs as a login service (launchd / systemd user service / logon task) and is restarted by the service or by the next prompt's hook if it ever stops.
Or use the CLI directly, no install needed:
npx context-doctor analyze conversation.json --model claude-sonnet-5npx context-doctor optimize conversation.json --out slimmed.jsonInput is any of: OpenAI chat format, Anthropic messages format (with system and content blocks), or a bare [{role, content}] array. Use - to pipe from stdin.
Reports include dollar and latency estimates, not just tokens:
Cost: ~$3.30 input per call ยท ~$3302 per 1k calls ยท ~13.2s of latency per call (estimates)
...
Potential recovery: ~5.9k tokens (~73% of context) โ $17.69 per 1k calls, 0.2s faster per callProfile your actual Claude Code sessions
npx context-doctor session # profile your most recent session
npx context-doctor session --list # browse sessionsParses the transcripts Claude Code writes locally and answers "where did my tokens go today?" โ it will happily tell you that one giant skill load is 67% of your context.
Autopilot: every Claude Code session keeps its own context lean
context-doctor autopilot on # once; survives reboots
context-doctor autopilot status # what it has done
context-doctor autopilot pause # instant passthrough, nothing restarts
context-doctor autopilot off # remove itautopilot on runs the local proxy as a background service (launchd on macOS, a systemd user service on Linux, a logon task on Windows), waits until it answers, and only then points Claude Code at it through env.ANTHROPIC_BASE_URL in ~/.claude/settings.json. Every Claude Code session started afterwards in a terminal or an IDE sends its requests through it. Not the desktop app's Code tab: it runs Claude Code "host-orchestrated", sets ANTHROPIC_BASE_URL from its own account configuration, and drops the same key from settings files (checked in Claude Code 2.1.284). autopilot on, autopilot status and doctor look at which surface your recent sessions ran in and warn when autopilot cannot reach them; for desktop sessions the levers that work are the cold-resume advice and compact-window. Your login (subscription or API key) passes through untouched.
What it does to each request: once old tool output adds up to 20k+ tokens (file reads, shell output, search and web results, screenshots inside them), it replaces that output with a one-line note, keeping the 3 most recent results. The tool call stays in the history, so the model can simply run it again if it needs the output. Your messages, its answers, answers you gave to its questions, subagent reports and MCP results are never touched.
Why it cannot make a session more expensive. A prompt cache matches a byte-identical prefix, and changing old history re-bills everything after the change at the write rate (1.25x instead of 0.1x). So autopilot changes history only when the cache is cold anyway: after an idle gap longer than the cache lifetime the request itself declares (1 hour for Claude Code on a subscription, 5 minutes otherwise), when the whole prompt is re-written regardless. Once cleared, an output stays cleared on every later request, so the prefix is identical between clearings and the cache keeps hitting.
Measured before it shipped, by replaying every Claude Code session on the author's machine (43 sessions, 130 days) request by request through the shipped code, priced as the cache bills it, with real timestamps: 3.8 billion input tokens not sent and $4,694 at list price, ~$1,080 a month (details). scripts/replay-autopilot.mjs does this on yours:
Policy | Input cost saved | Worst session |
Autopilot: clear only when the cache is cold (default) | 9.8% (9.2% of raw input tokens; best session 37.7%) | 0.00%, no session worse |
Also clear on a warm cache when the saving "should" repay the rewrite | 9.9% | โ0.13% (one session worse) |
The proxy's general strategies (dedupe, trim, strip-base64) | 6.7% | โ13% (one session worse) |
94% of input cost on that machine came from requests above 200k tokens, which is where the clearing lands. Smaller requests also mean later auto-compaction and a faster first token.
Never in the way: anything it cannot parse is forwarded unchanged; only Anthropic /v1/messages requests are touched. It adds about 7 ms to a 2.9 MB (~1M token) request. If the proxy dies, the service restarts it within seconds, and the every-prompt hook checks it before each prompt and starts it if needed (measured: 0.6 s once, when it had to). pause turns it into a passthrough without restarting anything; off removes the setting before stopping the service, and sessions started while it was on need a restart.
What it cannot reach (no process on your machine sends those requests): Claude Desktop's chat tab and claude.ai, which use the standing instructions and the profile_context sketch instead; Cursor's own models (Cursor's servers call the model; with your own OpenAI key, see the tunnel section below); and Codex signed in with ChatGPT, where the every-prompt hook still reports context size.
Always-on: optimize every request automatically
Run the proxy and every Anthropic/OpenAI API call your apps make gets optimized in flight โ no code changes:
npx context-doctor proxyThen point your app or SDK at it:
export ANTHROPIC_BASE_URL=http://localhost:8787 # Anthropic SDKs / tools
export OPENAI_BASE_URL=http://localhost:8787/v1 # OpenAI SDKs / toolsThe proxy dedupes repeated content, trims stale tool results, and strips base64 blobs from the message history of each request, then forwards it to the real API. Your API key passes through in headers untouched, streaming (SSE) works unchanged, and per-request savings are logged with upstream latency:
[context-doctor] POST /v1/messages โ 200 in 842ms | optimized 7.3k โ 518 tokens (2 changes) | session total: 6.9k tokens โ $0.021 savedOnly conversation requests (/v1/messages, /v1/chat/completions, /v1/responses) are ever rewritten. Every other endpoint a client uses through the proxy (listing models, uploading files, counting tokens) is forwarded untouched, to Anthropic when the request carries anthropic-version or x-api-key and to OpenAI otherwise, and request bodies the proxy does not rewrite reach upstream byte for byte.
GET http://localhost:8787/stats returns cumulative savings (requests, tokens, estimated USD), exact upstream usage read from every response (JSON and SSE), and prompt-cache advisories โ the proxy watches your real traffic and flags big stable prefixes missing cache_control or prefix churn that silently re-bills the cache. Per-model behavior via --config: The advisor now says where: for a large system/tools prefix it names the block to mark (the last tool definition, or the last system block), and when the older messages were byte-identical to the previous request it names the exact message to put cache_control on, with the token count that run is re-billing each turn. Anyone who already placed breakpoints is left alone.
{ "routes": [{ "modelPrefix": "gpt", "strategies": ["strip-base64"], "keepRecent": 4 }] }Because prompt caching matches byte-identical prefixes, deterministic strategies are chosen so repeated requests stay stable โ but if you rely on aggressive cache prefixes, start with --strategy strip-base64 --strategy dedupe and add more as you verify.
Putting the proxy on a public URL (Cursor with your own OpenAI key, remote apps)
Some apps let you set a base URL but call it from their servers, not your machine. Cursor is one: with your own OpenAI key, "Override OpenAI Base URL" is sent to Cursor's backend inside the model configuration, and Cursor's servers make the request (only the key-verification ping is client-side; we checked the app bundle, 3.18.25). So 127.0.0.1 cannot work there; the proxy has to be reachable from the internet, and an open relay on the internet is a bad idea. Hence the token:
npx context-doctor proxy --token "$(openssl rand -hex 16)" # or CONTEXT_DOCTOR_PROXY_TOKEN=...
ngrok http 8787 # or any HTTPS tunnel / reverse proxyWith --token, every path except /health must start with /t/<token>/; anything else gets 401 before any upstream call, and the comparison is constant time. Then in Cursor: Settings > Models > OpenAI API Key > Override OpenAI Base URL = https://<your-host>/t/<token>/v1. Every agent request Cursor makes with your key now passes through the proxy: deduped, stale tool results trimmed, base64 stripped, real usage counted in /t/<token>/stats. This is the one Cursor path that is model-independent and needs no hook. It applies only to BYO-key traffic; Cursor's own subscription models never leave Cursor's servers.
Your API key still rides in the request headers, as before. The token protects the relay, not the key; keep the tunnel HTTPS.
Note on desktop chat apps: Claude Desktop and the ChatGPT app talk to their own backends โ no tool can sit in that path. For those, use the MCP integration below (Claude Desktop gets the standing rules and a cheap
profile_contextsketch call) andcontext-doctor instructions --copyfor the per-account preferences.
Use with the Claude & ChatGPT apps
context-doctor ships an MCP server, so the AI itself can profile and slim context on demand. Before the setup table, the honest question: on which surfaces does it act by itself, and on which does it only nudge? MCP gives a server no way to see the conversation or intercept a turn; only a hook or a place in the data path can do that.
Surface | Runs by itself | What that means |
Claude Code | Yes: hook on every prompt, status line on every refresh | Past ~80k tokens the model receives hygiene guidance naming the largest waste; compaction is offered. Measured: 115 automatic checks, 48 warnings, across 32 sessions on one machine |
Cursor | Yes, since 0.26: | In a heavy chat, the agent gets hygiene guidance and the largest recoverable waste, once per 40% of growth. Cursor's transcript records tool calls but not their output, and keeps turns Cursor has since summarized, so the note gives the chat's accumulated size, with no window share or price. Corrected in 0.26: Cursor also runs Claude Code's hook, but as |
API traffic through the proxy | Yes: every request rewritten in flight | Fewer tokens, guaranteed, model not consulted |
Claude Desktop | The standing instruction in every chat (we confirmed in the app bundle that Desktop's | Until 0.17 the tool wanted the whole conversation as its argument, so calling it from chat meant re-typing 50k tokens; nobody did, and Desktop's log showed zero calls in a month. Now the model passes a ~120-token sketch (turn count, the large or repeated blocks) and gets a sized estimate, findings and the fix to apply. Still a nudge, not a hook: Desktop chat has no hook API and no transcript on disk |
Codex (OpenAI): ChatGPT.app's Codex tab, the Codex IDE extension, the | Yes, since 0.16: | Same guidance as Claude Code, from measured tokens. One extra step, Codex's rule not ours: a new hook runs only after you trust it once (type |
ChatGPT chat UI | No | No MCP, no hooks, no data path in the chat product itself. Use Codex, or a developer-mode connector at a URL you host |
So "every chat inherently better" is true for Claude Code, Cursor, Codex and the proxy; for Claude Desktop it is "the rules ride in every chat and the checkup is one cheap tool call away"; and not a claim we make for the ChatGPT chat UI.
Where there is no hook and no MCP at all (claude.ai on the web, the Claude and ChatGPT phone apps, plain ChatGPT): the app's per-account preferences are read on every turn, which is the closest those surfaces have to a hook. context-doctor instructions --copy puts the ~180-token rules on your clipboard and tells you where to paste them (claude.ai Settings > General; ChatGPT Settings > Personalization > Custom instructions, "What traits should ChatGPT have?").
Do you need to configure anything by hand? Usually no:
App | Setup |
Claude Desktop |
|
Claude Code | Same command โ MCP + skill + every-prompt hook, all automatic |
Cursor | Same command โ writes |
Codex (OpenAI) | Same command โ |
ChatGPT (developer mode) | Manual + a reachable URL โ ChatGPT connects to servers over the internet, never local commands. Run |
For any other MCP client, the server entry is:
{
"mcpServers": {
"context-doctor": {
"command": "npx",
"args": ["-y", "context-doctor-mcp"]
}
}
}How it works in Claude Desktop, step by step
Run
npx context-doctor install(writes the config above for you) and restart Claude Desktop. Or open the.mcpbfrom the latest release: same server, no npm, installs as an Extension.From then on, every conversation carries context-doctor's standing instructions. The MCP server hands them to Desktop on connect and Desktop puts them in front of Claude: summarize big pastes instead of re-quoting them, refer to earlier content by name, never inline base64, and past ~30 turns or on any question about tokens, cost, speed or limits, call
profile_contextbefore answering.That call is cheap on purpose. Claude cannot export a Desktop chat, so it passes a sketch: how many turns, which blocks are large, repeated, stale or images, with one size hint each (~120 tokens). The server sizes it (usually within ยฑ20%, measured; see "Why token counts are ~"), prices the per-turn re-read (on a subscription that is what spends your usage limit), and returns ranked findings with the action for each: "summarize the nginx config into the points still needed", "refer to test output by name", "offer a 300-token handoff summary for a fresh chat". The reply ends with an instruction to apply the top one, not just suggest it.
One click instead of asking: the
context_checkupprompt in the + menu sends that request for you.Say "optimize it" on an exported conversation and Claude applies the safe fixes; if you agree to pruning old history, Claude itself writes the replacement summary (that's the no-API-key summarization).
For the same rules on your phone and on claude.ai, where no MCP server runs:
context-doctor instructions --copy, then paste into Settings > General > personal preferences.
What this does not do: read the chat behind Claude's back or trim it for you. Desktop chat has no hook API and no transcript on disk (checked in the app bundle, v2.2553). The model does the trimming, when the rules and the checkup tell it to.
How it works in ChatGPT, step by step (honest version)
ChatGPT's MCP support differs fundamentally from Claude Desktop's: it never spawns local processes. Its custom connectors (developer mode) have OpenAI's servers connect to a URL โ so the MCP server must be reachable from the internet.
Normal ChatGPT (no developer mode): no MCP at all. context-doctor still helps via the CLI: export the conversation and run
npx context-doctor analyze chat.json --model gpt-5/optimizeโ no account settings required.ChatGPT developer mode: run our HTTP transport somewhere reachable โ
context-doctor-mcp --http --port 8808on a small host (bind--host 0.0.0.0there), or expose your machine temporarily with a tunnel (ngrok http 8808). Then Settings โ Connectors โ Advanced โ Developer mode โ add connector with URLhttps://<your-host>/mcp.Once connected, GPT gets the same three tools, each marked read-only (they only read their input and return text), with the same trigger guidance: ask "what's eating my context?" โ it calls
profile_context; "optimize it" works the same, including GPT writing the pruning summary itself.
Security note for step 2: the HTTP endpoint is unauthenticated โ put it behind your tunnel's auth or a reverse proxy if it stays up long-term.
claude.ai on the web and the phone apps
Your local MCP server can't reach the website, but the behavior can. Two options: context-doctor instructions --copy and paste into Settings > General > personal preferences (applies everywhere you are signed in, phone included), or upload skills/context-doctor/SKILL.md under Settings โ Capabilities โ Skills. Either way web and mobile conversations gain the same standing habits: summarize, don't re-quote, offer a handoff when heavy.
MCP tools
Tool | What it does |
| Token breakdown by category, largest messages, findings with estimated savings. Takes either |
| Rewrites the conversation: dedupe, trim stale tool results, strip base64, optional history pruning |
| Only the chunks of large local files or folders (or passed |
| Curated checklist, optionally specialized for Anthropic / OpenAI |
Use it as a library
import { parseConversation, profileConversation, optimizeConversation } from "context-doctor";
const profile = profileConversation(parseConversation(chatJson), "claude-sonnet-5");
console.log(profile.totalTokens, profile.findings);
const { conversation, tokensBefore, tokensAfter } = optimizeConversation(chatJson, {
strategies: ["dedupe", "trim-tool-results", "strip-base64"],
});
// Autopilot without a proxy: wrap the SDK client (Anthropic or OpenAI)
import Anthropic from "@anthropic-ai/sdk";
import { withContextDoctor, contextDoctorStats } from "context-doctor";
const client = withContextDoctor(new Anthropic()); // use exactly as before
await client.messages.create({ model, max_tokens, messages });
console.log(contextDoctorStats(client)); // { requests, changed, tokensRemoved }
// RAG-style context packing: chunk, rank, fit a budget (no embeddings, no key)
import { packContext, renderPack } from "context-doctor";
const packed = packContext([{ name: "manual.md", text: manual }], { query: "rotate the signing key", budget: 3000 });
console.log(packed.selected.map((c) => `${c.id} L${c.startLine}-${c.endLine}`), renderPack(packed));Autopilot inside your app: withContextDoctor
For apps that cannot send traffic through a local proxy (serverless and edge functions, managed hosts), wrap the SDK client. messages.create / stream, chat.completions.create / stream / parse and responses.create / stream / parse (beta namespaces too) and Google's models.generateContent / generateContentStream go through the same autopilot as the proxy: stale tool output is cleared only when the prompt cache is cold. Each request is cloned before it changes, so the history your app holds is never rewritten; only the copy on the wire is slimmer. State lives in the process: one long-lived process per conversation stream behaves like the proxy, and a conversation the process has not seen counts as warm, so a fresh serverless instance never clears blind (pass statePath on shared storage if many instances serve the same conversations). Tested with the real @anthropic-ai/sdk and openai packages.
Subagents: their own windows, your bill
A subagent has its own context window, so its tokens are correctly absent from the parent's profile. They are not absent from the bill. Claude Code writes each one to <session>/subagents/agent-<id>.jsonl, and session now reads them:
Subagents (their own windows, your bill)
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
49 subagent(s) made 4560 API calls: 626.0M input billed, 1.0M output, ~$608.51.
That is 10% on top of the parent session's own input cost ($5846.45), and none of it appears in the profile above.
$42.52 51 calls ctx 319k 6m You are auditing part of a FastAPI backend at /Users/kp/tech
$37.48 107 calls ctx 229k 6m You are auditing the Turtle AI backend (FastAPI, Python) at
โฆ and 44 more
18 subagent(s) ended above 200k tokens of context. A subagent that big is doing a main session's job; give it a narrower brief, or split the task.Per subagent: what it was asked, how many calls it made, the context it ended with, how long it ran, and its cost at list price with cache reads and writes priced correctly. Models without a price on file are counted but marked unpriced rather than costed at zero. On this machine that was 195 subagents across 19 sessions and about $1,844 at list price that no profile had ever shown.
The same number inside VS Code and Cursor
An extension in vscode/ puts context health in the editor's own status bar:
โ ctx 848k ยท 85% ยท cache 100% โ It reads the newest Claude Code transcript for the open workspace folder, shows live context, share of window and cache share, turns to the warning colour past 70% (configurable), and opens a terminal running context-doctor session when clicked. Nothing leaves the machine; it only reads files Claude Code already writes. Until it is on the marketplace, build and install it locally:
cd vscode && npm ci && npm run package
code --install-extension context-doctor-vscode-0.1.0.vsix # or: cursor --install-extension โฆContext health in Claude Code's status bar
context-doctor install --statuslineClaude Code shows the first line a statusLine command prints, on every refresh, while you type. With this on, that line is the number that matters:
ctx 801k/1.0M โฎโฎโฎโฎโฎโฎโฎโฎโโ 80% โ ยท cache 100% ยท $12.34Live context against the model's window, a warning mark from 70%, the share served from cache, and the session's cost. It reads the size from the status payload when Claude Code provides it, and otherwise from the last 256KB of the transcript (about 1ms on a 20MB file; 80ms end to end including Node startup). It is opt-in and polite: there is only one status line, so it never overwrites one you already have, and uninstall removes only its own. Any failure prints nothing rather than an error.
The same number in VS Code and Cursor's status bar: see the editor extension.
Does a smaller context actually help? Measure it
Everything else in this tool measures what is in the context. None of it can tell you whether the task succeeded, so a smaller transcript can be a cheaper failure. experiment is the honest test:
context-doctor experiment \
--task "Add a null check to parseHeader in src/parse.ts and make the tests pass" \
--check "npm test" \
--existing 9c6f9dc9-457b-4d09-bf6d-a499c2f2f919 \
--model sonnet --budget 1It runs the task in a fresh session, resets the tree to the starting commit, then runs it again forked from your existing session (--resume โฆ --fork-session, so your real session is never touched), same model, same tools. For each arm it records what you were billed (input, cache read, cache write, output), cost, wall clock, turns, and whether your --check command passed, then puts them side by side:
fresh existing
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
billed input 20k 65k
of which cache read 0 60k
of which cache write 8.0k 4.0k
cost $0.110 $0.420
wall clock 4s 9s
check PASS FAIL (1)
Verdict: fresh was cheaper AND passed; existing failed the check. Clear win for fresh.The verdict line is the point: cheaper only counts if it also passed. Because this spends your Claude budget it caps spend per arm (--budget, default $1), refuses to start on a dirty tree (both arms must begin from one commit, and the tree is reset between them), and refuses to run from inside a Claude Code session, where the CLI cannot start. --dry-run shows the exact commands first.
Exact counts, and what they teach the estimator
The default token count is a chars-per-token heuristic so everything runs with no key and no tokenizer, with ratios per provider (see "Why token counts are ~" below). analyze --exact fetches a true count for the exact bytes just estimated (Anthropic's count-tokens API with ANTHROPIC_API_KEY; tiktoken for GPT if installed) and prints the drift.
Since 0.13.9 it also remembers the comparison, per model family, on this machine, and later estimates for that family are scaled by it. Nothing about this is silent: the profile header says estimates calibrated +12% from 3 exact count(s) you ran on this machine. No exact count ever run means no calibration and unchanged numbers; out-of-range samples are ignored; CONTEXT_DOCTOR_NO_CALIBRATION=1 returns to the raw heuristic. Samples are tied to the heuristic they were taken against: after 0.19 changed Claude's ratios, older samples are ignored and learning restarts, rather than stacking an old correction on a fixed estimator.
What it detects
Oversized tool results โ the #1 context killer in agent loops
Oversized tool calls โ a
Writeor acat > file <<EOFputs the whole file in context permanently. In file-heavy agent work these outweigh every tool result combined, and--strategy trim-tool-callsreclaims themDuplicate content โ the same doc/result pasted twice
Near-duplicates โ the same doc re-pasted with different surrounding words (shingle similarity, โฅ60%)
Repeated file reads โ the same file pulled in three or more times, every copy still in context. Counts shell reads too (
cat,head,tail,less), which is where most of them hide in agent sessionsRetained error output โ stack traces and failed commands kept verbatim long after the fix landed
Repeated identical tool calls, split into the two things they can mean: a retry (the same call after a failure, where the fix is in the error text, and three or more is a loop) and a re-read (the same call after a success, where the model forgot it already had the answer). Across 42 local sessions that was 15 retries against 151 re-reads, so the old combined advice was wrong for most of them
Base64 / binary blobs in text content โ checked by character distribution, not just alphabet, so hex digests and long identifiers are not mistaken for encoded binary
Long history past the point where models track the middle
Cache-hostile ordering โ volatile content before stable content breaks prompt caching (Anthropic
cache_control, OpenAI automatic prefix caching)Window pressure โ usage % against the target model's real context window
What it fixes (deterministically โ no LLM calls, no API keys)
Strategy | Lossy? | Default |
| No | โ |
| Mostly no | โ |
| No (for the model) | โ |
| Mostly no | opt-in |
| Yes | opt-in |
trim-tool-calls is the big one for agent sessions. Writing a file through a tool call puts the entire file in context permanently, so in file-heavy work the calls outweigh every tool result combined โ on a real 278k-token session, the default set reached 248k and adding trim-tool-calls reached 102k. It is opt-in because it edits what the model itself wrote, and that is measured, not cautious: across 42 real sessions, of 73 large writes 18 were later edited and 16 of those edits had no read in between, meaning the model built the edit from its own earlier Write input, at a median distance of 43 messages. Trimming those would turn each into a failed edit plus a recovery read. In the offline optimizer the rest of the conversation is known, so exactly those writes are left intact and the 63% never touched again are trimmed; in the live proxy the future is not known, which is why it stays off there unless you turn it on.
Optimization is cache-aware. Prompt caches match a byte-identical prefix, so editing a message in the middle invalidates everything after it โ and the naive "trim everything older than the last N messages" boundary moves every single turn. On a 25-turn agent conversation that invalidated the cached prefix on 22 of 24 turns, paying the 1.25x cache-write price on the whole prefix to save a few hundred tokens. The trim boundary is quantized so it holds still between steps (8 of 24 on the same fixture), while still reaching 15 of 20 tool results.
The step size is a trade-off, not a formula, and it is yours to set: "trimBoundaryStep": 20 in .contextdoctorrc (default 10). Measured on a growing agent session at 400 turns: a step of 10 invalidated the cache on 21% of turns with ~2 stale results waiting on average; 20 gave 12% and ~4; 40 gave 10% and ~9. Adaptive steps were worse everywhere, because a step that changes size moves the boundary by itself. Heavy API users who lean on caching want a bigger step; interactive users who want stale output gone promptly want a smaller one.
Everything the optimizer does is inspectable: it prints exactly which messages changed and how many tokens each change saved.
Summarization without an API key: when prune-history runs through the MCP tools, context-doctor hands a digest of the pruned turns back to the model that called it (the Claude/GPT already running in your app) and asks it to write the replacement summary โ LLM-quality compaction, zero extra cost, no keys.
The Agent Skill
skills/context-doctor/SKILL.md (installed by npx context-doctor install) teaches Claude to practice context hygiene proactively: summarize big tool results after consuming them, never re-paste duplicated content, keep stable content cache-friendly, and offer compaction when a session gets heavy. In Claude Code and Cursor the every-prompt hook enforces the heavy-session part; the skill covers the habits in between.
Measuring the impact: context-doctor report
npx context-doctor reportOne report for your whole machine, led by a headline of tokens context-doctor saved, built only from measured sources:
exact proxy savings (real before/after on every request),
exact savings from every optimization applied via the CLI or the in-chat tools โ split by model family (Claude vs GPT), with dollar estimates,
and, on its own line, not in the total: sessions that got smaller after a hygiene warning. That is mostly compaction, by you or by Claude Code, and a warning may or may not be why it happened, so it is not credited to context-doctor (until 0.24 it was, which overclaimed). The dashboard keeps the same split.
Honest measurement note: proxy numbers are exact. Session numbers are measured-now. What no tool can report is the counterfactual โ tokens Claude avoided adding because of the hygiene guidance โ since the same session can't be re-run without it. The report says so instead of inventing a number.
Context budgets (.contextdoctorrc)
Drop a .contextdoctorrc in a project (or your home directory) and context-doctor enforces your limits instead of its defaults:
{
"budget": { "maxTokens": 120000, "maxCostPerMessageUsd": 0.5, "maxWindowPct": 60 },
"strategies": ["dedupe", "trim-tool-results"],
"keepRecent": 6
}The nearest file wins (walking up from the working directory, then ~). analyze and session print a budget verdict, the every-prompt hook uses maxTokens as its warning threshold and names the breach to the model, and optimize/proxy pick up the defaults when you do not pass flags.
Prompt-cache economics (Claude Code sessions)
Caching is the largest lever on LLM cost, and transcripts record exactly how it went โ so session reports it as fact rather than estimate:
Prompt cache: 95.6% of input served from cache across 1117 requests
read 558.6M ยท written 25.5M ยท uncached 2k
input cost $438.88 โ caching saved $2481.89 against $2920.76 uncached (list prices)A cache read bills at ~10% of input while a write bills at ~125%, so a session that keeps invalidating its prefix can cost more than one with no caching at all. context-doctor warns on the two failure modes: a low hit rate (something early in the prompt changes every request) and cache churn (writes rivalling reads).
Enforce a budget in CI
Memory files on every pull request. CLAUDE.md, AGENTS.md, GEMINI.md and rules are re-read by every request of everyone working in the repository, so their growth deserves review. The repository is also a GitHub Action:
# .github/workflows/context.yml
on: pull_request
permissions:
contents: read
pull-requests: write # for the comment
jobs:
memory:
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v4
- uses: KushalP1/context-doctor@v0.27.0
with:
max-increase: "2000" # fail a PR that adds more than 2k tokens
requests-per-day: "5000" # optional: price the changeIt compares the memory files and their @imports at the PR head with the base branch, writes the table to the job summary, keeps one PR comment up to date, and fails over budget. Locally: context-doctor ci --base origin/main.
Conversation fixtures.
npx context-doctor analyze conversation.json --fail-over-budgetExits 1 when the .contextdoctorrc budget is breached, so a pull request can be gated on context size the same way it is gated on tests.
Sharing a profile safely
A profile quotes message previews and file paths, so pasting one into an issue pastes fragments of real work. --redact keeps every number and the finding structure but replaces content with [redacted] and masks paths:
npx context-doctor session --redactcontext-doctor doctor is safe to paste as-is: it reports integration status, never conversation content.
Performance: what context-doctor itself costs
A tool that promises speed must be near-free. Measured overhead per touchpoint:
Touchpoint | When it runs | Overhead |
Every-prompt hook (Claude Code) | Every prompt | ~80ms (Node startup; logic ~1ms). Lean sessions exit on a single |
MCP server | Spawned once per app session | Tools run only when called; standing instructions cost ~250 tokens per conversation on Claude, ~170 on GPT โ deliberately terse |
Proxy | Per API request | ~1โ3ms of CPU (parse โ optimize โ re-serialize) against typical model latencies of hundreds of ms; responses stream through chunk-by-chunk, never buffered |
Skill | Loads only when relevant | ~1k tokens while active; its always-present description is ~60 tokens |
Profiling a session | On demand, and on hook growth events | ~160ms for an 8.5MB / 1,855-message transcript (near-duplicate pairs that cannot clear the similarity bar are skipped without comparison) |
CLI / library | Only when you run it | Not in any hot path |
Net effect is strongly negative overhead: the tokens these touchpoints save on every subsequent call dwarf what they cost.
Why token counts are "~" (and where they are exact)
Counting exactly needs each provider's tokenizer, so the default is a chars-per-token heuristic, with ratios per provider and denser ones for code and JSON. It keeps the tool offline and zero-config.
Model | Prose | Code / tool output | Source |
Claude (Opus 4.7 to 5.x, Fable 5.x, Sonnet 5) | 2.75 chars/token | 2.4 | Measured from the API's own counts, below |
GPT, Gemini, unknown | 4.0 | 3.2 | Usual figures for o200k-class tokenizers; not re-measured here |
Which row applies: the model you pass, else the request's own model field, else the request's shape (Anthropic's system field or tool_use blocks mean Claude). Cursor transcripts record no model and use Anthropic-style blocks, so Cursor sessions are counted at Claude density; for a GPT model in Cursor that reads about 40% high.
How the Claude figures were measured, with no key. Claude Code transcripts record what the API billed, and two things in them are exact. A reply with no thinking block is billed as exactly its output_tokens, and all of it is visible text: 504 replies gave a median of 2.75 chars/token (p10 2.4, p90 3.0). Between two consecutive API calls the prompt grows by exactly what was appended; when that is one large block, its size is the growth minus the previous reply: 474 blocks of code and tool output gave 2.4 (p10 2.1, p90 2.8). The ratios this tool used until 0.19 (4.0 / 3.2 for everything) undercounted current Claude models by about 40%: hook warnings came late, savings and costs read low, and the proxy stayed silent on cacheable prefixes between 1,024 and ~1,670 tokens. context-doctor accuracy re-runs both measurements on your own sessions and prints them per model beside the ratio in use, so the next tokenizer change shows up as a number, not a surprise. On this machine every model lands within ยฑ9%.
Two ways to get real numbers instead of estimates:
analyze --exactuses the Anthropic count-tokens API for Claude models (setANTHROPIC_API_KEY; opt-in network call, key never stored) or tiktoken for GPT models (install it alongside), and reports how far the heuristic drifted.Sessions report measured tokens automatically. Claude Code transcripts record what the API actually charged, so
session, the hook and the reports use that figure when it is present โ no key, no estimate.
One honest caveat worth knowing: a transcript stores the conversation, not the harness's system prompt, tool schemas or skills (about 54k tokens before the first turn in Claude Code here), nor the reminders it injects each turn. With the corrected ratios the transcript accounts for a median 56% of each turn's billed growth; before 0.19 this read 39%, and about a third of that "invisible" gap was the estimator. That is why sessions prefer the reported figure, and why the message breakdown is labelled as covering messages only.
The chat-app sketch (Claude Desktop, see above) is coarser by design, because the model describes the chat instead of sending it. Its sizes are measured, not assumed: a plain exchange is 2,060 chars (median of 1,283), a code line 42 chars (719 source files), a log line 56 (2,095 tool outputs), a word 6.3, all converted with the model's own ratio. Measured error: the total for a chat of 30+ exchanges from its turn count alone is within -20% to +9% (p10 to p90); a code block sized by lines is within about ยฑ25%, by chars about ยฑ15%. Logs vary from 38 to 100 chars a line, so the tool asks for their size in chars.
Roadmap
See ROADMAP.md for the full plan, the per-surface coverage table and the measurements behind every shipped item. Next, in order of expected saving: the MCP schema tax per server in overhead; a Python package for RAG pipelines. Non-goals, permanently: cloud services, telemetry, silent history rewriting, mandatory API keys.
Contributions welcome โ this project is small on purpose. Open an issue before a big PR.
Releasing (maintainers)
One-time setup. Each row switches on one channel; any that is missing is skipped with a notice, never a failed run. Secrets go in the repo's Settings > Secrets and variables > Actions:
Secret | Turns on | Where to get it |
(no secret: npm trusted publishing) |
| npmjs.com > package |
| A signed Claude Desktop bundle, no install warning | A code-signing certificate from a trusted CA; paste the PEM text. |
| VS Code Marketplace on | Azure DevOps PAT, scope Marketplace > Manage, for the |
| Open VSX (where Cursor installs from) | open-vsx.org > Settings > Access Tokens |
Each release:
npm version minor # or patch/major: bumps package.json and tags vX.Y.Z
npm test # the full suite; CI runs it on 3 OSes x Node 20/22/24
git push --follow-tags # npm publish + GitHub release with the .mcpb attachedFor the editor extension: bump vscode/package.json, add a vscode/CHANGELOG.md entry, then git tag vscode-vX.Y.Z && git push --tags. The .vsix is attached to a GitHub release either way.
Locally, npm run build:mcpb builds the bundle (MCPB_SELF_SIGNED=1 exercises the signing path with a throwaway certificate; Desktop still warns for those).
What the npm download number measures. install writes npx -y context-doctor-mcp into MCP configs, and npx re-fetches the tarball whenever a new version exists. So every release is downloaded once by every active install within about a day, and the daily count is almost entirely those refreshes: on this package, release days run ~170 downloads and non-release days ~27. Read it as "size of the active installed base ร number of releases", not as new users โ a quiet week with no releases will look like a decline while nothing has changed. Two corollaries: the release-day figure is a live count of machines running context-doctor, and a broken release reaches all of them automatically, which is why prepublishOnly runs the full test suite. npm's stats also lag by several days and occasionally record a day as zero; a zero on a release day is a gap in their pipeline, not in usage.
Known gotcha: if npm publish fails with 404 Not Found - PUT โฆ/context-doctor on a package that clearly exists, the real cause is an expired npm login token โ npm reports unauthenticated publishes as a 404, not a 401. Check with npm whoami; if that errors, run npm login and publish again.
Also keep the MCP server version in src/mcp.ts in sync with package.json, and remember dist/ is committed โ run npm run build before committing so the CI dist-sync check passes.
Contributing
Issues and PRs welcome โ see CONTRIBUTING.md for the six rules that keep this tool trustworthy (no API keys, nothing leaves the machine, no silent data loss, measurements not guesses, the hot path stays cheap, tests with every change) and a list of good first issues. What is planned next lives in ROADMAP.md.
Two end-to-end checks beyond npm test, both run against a throwaway HOME:
HOME=$(mktemp -d) node scripts/smoke-mcp.mjs node dist/mcp.jsHOME=$(mktemp -d) node scripts/smoke-openai-proxy.mjsThe first connects to the MCP server the way a client does (it takes any launch command, npx -y context-doctor mcp included, or --http <url>), lists the tools and prompt, calls every tool and checks that bad input is rejected. The second runs the proxy against a local mock of OpenAI: streaming, the Responses API, usage capture and autopilot.
License
MIT ยฉ gAI Ventures
This server cannot be deployed
Maintenance
Related MCP Connectors
Cross-tool persistent memory and context for AI assistants over MCP.
Multiple MCP tools, persistent graph memory, token-saving data pointers, and more.
Share one project context across ChatGPT, Claude, Telegram and any MCP client.
A paid remote MCP for OpenAI Codex context compressor, built to return verdicts, receipts, usage log
Related MCP Servers
- AlicenseNot gradedqualityDmaintenanceEnables analyzing and optimizing context window token usage by measuring, compressing, and eliminating waste from MCP tool definitions.63 npmMIT
- AlicenseNot gradedqualityDmaintenanceA task-aware context compression layer for Agent workflows, RAG pipelines, and AI Coding assistants, reducing noisy logs, retrieval chunks, and code context into high-signal LLM inputs via CLI, Python SDK, and MCP.351MIT
- AlicenseAqualityCmaintenanceProvides MCP tools to migrate or compress conversation sessions between models based on context window capacity, including querying model context windows and listing known models.31MIT
- FlicenseNot gradedqualityBmaintenanceEnables MCP-compatible clients and autonomous agents to dynamically compress long-horizon context by pruning verbose tool outputs, HTML boilerplate, and semantic redundancy by 40-70%. It reduces token burn and latency through deterministic, zero-dependency processing.7-