A
licenseNot graded
qualityB
maintenanceEnables clients to optimize prompt prefix caching by matching longest common token prefixes with a radix trie, eliminating redundant prefill computation and reducing time-to-first-token.
7
MIT
DoboCache
by dobo123123
Related Servers
Alternatives to DoboCache
No user-submitted related servers found.
Related Servers
- AlicenseAqualityBmaintenanceEnables AI coding agents from any vendor to resume a task from the exact stopping point without model calls, re-reading old sessions, or re-exploring the code, by merging host hooks, agent checkpoints, and Git deltas into one compact brief. It also guards credits outside the model with a prompt clarity gate, a loop guard, and configurable token profiles.927 npmMIT
distil-mcpofficial
AlicenseNot gradedqualityBmaintenanceEnables an LLM agent to measure where a session's tokens actually go and whether rewriting history pays for the prompt-cache prefix it invalidates, so it can pick clearing thresholds or decline to compress. Exposes the token-cost accounting and cache-preserving optimization layers over MCP.1MIT- AlicenseNot gradedqualityNot gradedmaintenanceEnables inference engines to match longest common prompt token prefixes via a radix trie, so cached KV-cache blocks are reused instead of re-prefilled. This eliminates redundant prefill computation and lowers time-to-first-token, alongside paged attention allocation, speculative decoding verification, INT8 quantization, and latency telemetry.7MIT
- AlicenseAqualityBmaintenanceEnables coding agents to compact conversation contexts verbatim, make fast decisions through choice, boolean, and rubric scoring, and enforce command safety guardrails.6MIT
- AlicenseNot gradedqualityAmaintenanceEnables AI coding assistants to persist and restore context across sessions, preserving decisions, progress, files, and checkpoints. It supports topic-based channels, search, change tracking, git-aware correlation, batch operations, and shared memory across parallel sessions.228 npmMIT
This server cannot be deployed
Maintenance
ActivityMaintained
ResponsivenessNo recent community issues