llm_cache
Inspect and manage the LLM response cache: view hit rates, token and cost savings, list entries, prune expired data, or clear all.
Instructions
Manage the Dynamic Response Cache for external LLMs. Inspect cache hit rates, view token and USD savings, prune expired entries, or clear the cache.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| limit | No | Maximum number of entries to display when action is 'inspect'. Default is 10. | |
| action | Yes | Action to perform: 'stats' (view hit rate, savings, and disk usage), 'inspect' (view recent cached responses), 'prune' (evict expired entries), or 'clear' (empty entire cache). |