Skip to main content
Glama
libragik

universal-ai-agent-bridge

by libragik

llm_cache

Inspect and manage the LLM response cache: view hit rates, token and cost savings, list entries, prune expired data, or clear all.

Instructions

Manage the Dynamic Response Cache for external LLMs. Inspect cache hit rates, view token and USD savings, prune expired entries, or clear the cache.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
limitNoMaximum number of entries to display when action is 'inspect'. Default is 10.
actionYesAction to perform: 'stats' (view hit rate, savings, and disk usage), 'inspect' (view recent cached responses), 'prune' (evict expired entries), or 'clear' (empty entire cache).

Schema Changelog

Changes observed during successful MCP inspections.

  1. First observedv1.0.0

TDQS

A3.9/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations provided, the description carries full responsibility for disclosing behavioral traits. It mentions the actions, but does not warn that 'clear' empties the entire cache (a destructive, irreversible operation) or that 'prune' only removes expired entries. While the enum descriptions in the schema clarify the actions, the tool description itself omits risk-related context, which is a notable gap for a mutating tool.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a tight two-sentence summary that front-loads the core purpose ('Manage the Dynamic Response Cache') and then lists the four actions in a single sentence. There is no redundancy or fluff; every word contributes to understanding the tool.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The tool has only two parameters (one enum) and no output schema. The description covers the actions and their effects reasonably well, but it omits any caution about the destructive nature of 'clear' and does not hint at what return values to expect (e.g., stats output). Given the mutating capability, the description should at least flag irreversibility. It is adequate but not fully complete.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%: both 'action' and 'limit' are described in the schema with clear meanings. The tool description does not add new parameter-level information beyond what the schema provides—it only repeats the action names. Since the schema already does the heavy lifting, the description meets the baseline for this dimension.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool's purpose: 'Manage the Dynamic Response Cache for external LLMs' and enumerates the specific actions (inspect hit rates, view savings, prune, clear). It is distinct from all sibling tools, which focus on generation, compression, or model management, so there is no ambiguity about its scope.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies when to use the tool—whenever cache management is needed—and lists the four concrete actions. It does not explicitly name alternatives or exclusions, but given that no sibling tool overlaps with cache operations, the context is clear enough for an agent to select it appropriately.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.