cascade_llm
Process prompts via hardware-adaptive routing that runs local GPU models first and falls back to Gemini, reducing token costs.
Instructions
Run a query through the intelligent cascading gateway (RTX 5090 -> Gemini) with dynamic biasing.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"prompt": "<prompt>"
},
"name": "cascade_llm"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| prompt | Yes | The prompt to process. | |
| system_prompt | No | Optional system prompt. | You are an expert coding assistant. |