cache_route
Checks an in-process cache first, then routes prompts to the cheapest reachable model; repeated identical requests return the cached plan with cached=true.
Instructions
Same as route, but checks an in-process cache first. Demonstrates the advanced caching layer: repeated identical requests return the cached plan with cached=true. A persistent per-account cache is a hosted paid feature.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| prompt | Yes | ||
| region | No | global | |
| priority | No | cost | |
| include_paid | No | ||
| max_output_tokens | No | ||
| required_capabilities | No |