cache_route
Checks an in-process cache first, then routes prompts to the cheapest reachable model; repeated identical requests return the cached plan with cached=true.
Instructions
Same as route, but checks an in-process cache first. Demonstrates the advanced caching layer: repeated identical requests return the cached plan with cached=true. A persistent per-account cache is a hosted paid feature.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"prompt": "<prompt>"
},
"name": "cache_route"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| prompt | Yes | ||
| region | No | global | |
| priority | No | cost | |
| include_paid | No | ||
| max_output_tokens | No | ||
| required_capabilities | No |