cache-proxy
Server Details
LLM caching proxy (x402 USDC on Base) - exact + semantic cache. Free health.
- Status
- Healthy
- Last Tested
- Transport
- Streamable HTTP
- URL
Glama MCP Gateway
Connect through Glama MCP Gateway for full control over tool access and complete visibility into every call.
Full call logging
Every tool call is logged with complete inputs and outputs, so you can debug issues and audit what your agents are doing.
Tool access control
Enable or disable individual tools per connector, so you decide what your agents can and cannot do.
Managed credentials
Glama handles OAuth flows, token storage, and automatic rotation, so credentials never expire on your clients.
Usage analytics
See which tools your agents call, how often, and when, so you can understand usage patterns and catch anomalies.
Tool Definition Quality
Average 3.9/5 across 2 of 2 tools scored.
The two tools have completely distinct purposes: cache_query handles LLM requests through the proxy, while health is a simple status check. No ambiguity exists between them.
cache_query follows a verb_noun pattern, but health is a single noun without an action prefix. Minor deviation, but names are clear and readable.
With only 2 tools, the set feels slightly thin but appropriate for a focused proxy service. The core operation and a health check are the essentials.
The main lifecycle of a caching proxy is covered by cache_query. Missing cache-specific operations like invalidation could be useful but are not essential for basic proxy functionality.
Available Tools
2 toolscache_queryAInspect
Send an LLM request through the caching proxy. Returns cached response if available, otherwise proxies to upstream LLM.
| Name | Required | Description | Default |
|---|---|---|---|
| body | Yes | JSON request body as string | |
| path | Yes | API path (e.g. /v1/chat/completions) | |
| api_key | Yes | API key for the upstream provider | |
| provider | Yes | LLM provider to proxy to | |
| cache_ttl | No | Cache TTL in seconds (default 86400) |
Tool Definition Quality
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description carries the burden of disclosing behavior. It does explain the core caching logic (cached response if available, else proxy), which is good. However, it omits details like handling of proxy failures, cache key derivation, or side effects (e.g., writing to cache). These gaps leave behavior partially undisclosed.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is two sentences, front-loaded with the main purpose, and contains no redundant information. Every word earns its place, making it highly concise and well-structured.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
The description is adequate but incomplete given the absence of annotations and output schema. It specifies the core behavior (cached vs upstream response) but lacks details on error handling, response format, and cache TTL specifics. For a tool with 5 parameters and no output schema, a bit more context would be needed for full completeness.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The input schema has 100% description coverage for all parameters, so the baseline is 3. The description does not add any additional meaning to the parameters beyond the schema, but since the schema already documents each parameter, no deduction is warranted.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool's function: 'Send an LLM request through the caching proxy.' It uses a specific verb ('send') and resource ('LLM request'), and differentiates from the sibling tool 'health' by focusing on proxying and caching. The caching behavior further clarifies the purpose.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides clear context: it is used when needing to send an LLM request via the caching proxy, returning cached or upstream responses. No explicit alternatives are mentioned, but the only sibling is 'health,' which is not a substitute. There are no exclusions, and the intended use is obvious, though no explicit when-not-to-use guidance is provided.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
healthAInspect
Health check. Returns server status and optional echo.
| Name | Required | Description | Default |
|---|---|---|---|
| echo | No | Optional string to echo back |
Tool Definition Quality
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
The description discloses the primary behavior: returning server status and echoing an optional string. However, with no annotations provided, the description carries the full burden for behavioral disclosure. It doesn't mention safety, rate limits, or other side effects, but for a health check, the behavior is largely self-evident.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is extremely concise at two short sentences. Every word is purposeful, and it is front-loaded with the core purpose ('Health check') before the detail.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the simplicity of the tool (one optional parameter, no output schema, no annotations), the description is adequately complete. It explains the function and the optional parameter. It doesn't explain the response format, but for a health check, that is not essential.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The schema describes the single parameter 'echo' with full coverage, and the description merely says 'optional echo', adding no new meaning beyond what the schema already provides. Since schema coverage is 100%, the baseline of 3 applies.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description states a specific action ('Health check') and the resource is the server status. It clearly indicates a read-only health probe. While it doesn't explicitly mention the sibling tool, the distinction is obvious given the different names.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The phrase 'Health check' establishes a clear context: this is for verifying server status. It implies when to use it, and there are no exclusions. It doesn't name alternatives, but the sibling tool is different enough that additional guidance is unnecessary.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
Claim this connector by publishing a /.well-known/glama.json file on your server's domain with the following structure:
{
"$schema": "https://glama.ai/mcp/schemas/connector.json",
"maintainers": [{ "email": "your-email@example.com" }]
}The email address must match the email associated with your Glama account. Once published, Glama will automatically detect and verify the file within a few minutes.
Control your server's listing on Glama, including description and metadata
Access analytics and receive server usage reports
Get monitoring and health status updates for your server
Feature your server to boost visibility and reach more users
For users:
Full audit trail – every tool call is logged with inputs and outputs for compliance and debugging
Granular tool control – enable or disable individual tools per connector to limit what your AI agents can do
Centralized credential management – store and rotate API keys and OAuth tokens in one place
Change alerts – get notified when a connector changes its schema, adds or removes tools, or updates tool definitions, so nothing breaks silently
For server owners:
Proven adoption – public usage metrics on your listing show real-world traction and build trust with prospective users
Tool-level analytics – see which tools are being used most, helping you prioritize development and documentation
Direct user feedback – users can report issues and suggest improvements through the listing, giving you a channel you would not have otherwise
The connector status is unhealthy when Glama is unable to successfully connect to the server. This can happen for several reasons:
The server is experiencing an outage
The URL of the server is wrong
Credentials required to access the server are missing or invalid
If you are the owner of this MCP connector and would like to make modifications to the listing, including providing test credentials for accessing the server, please contact support@glama.ai.
Discussions
No comments yet. Be the first to start the discussion!
Related MCP Servers
AlicenseAqualityBmaintenancePre-trade DeFi intelligence for AI agents. 20 paid x402 endpoints, USDC on Base.23561MIT- AlicenseAqualityBmaintenanceUSDA nutrition API optimized for AI agents. x402 + USDC on Base41MIT
- FlicenseAquality-maintenanceTrust infrastructure for AI agents on Base. DEX Spread Oracle (live Uniswap V3 prices), on-chain escrow, insurance pool, and collective knowledge base. 7 smart contracts. Pay-per-query via x402 micropayments in USDC.6
- Alicense-qualityCmaintenanceOpenAI-compatible inference broker that routes AI requests to the cheapest qualifying model and settles payments per token in USDC on Base L2 via x402 micropayments.MIT