cascade_llm
Process prompts via hardware-adaptive routing that runs local GPU models first and falls back to Gemini, reducing token costs.
Instructions
Run a query through the intelligent cascading gateway (RTX 5090 -> Gemini) with dynamic biasing.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| prompt | Yes | The prompt to process. | |
| system_prompt | No | Optional system prompt. | You are an expert coding assistant. |