Intelligent Routed Chat
chat_routedRoutes chat prompts to a suitable AI model by analyzing prompt size, required context, and task category. Automatically balances cost and quality according to your priorities.
Instructions
Execute a chat completion with intelligent, automatic cost-aware model routing based on prompt size, required context length, and task attributes.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| prompt | Yes | The main prompt to run | |
| max_tokens | No | Maximum tokens to generate | |
| strictness | No | Routing prioritization strategy. 'cost' prefers the absolute cheapest; 'quality' weights model performance tiers. | cost |
| temperature | No | Sampling temperature (0-2) | |
| system_prompt | No | Optional system prompt | |
| task_category | No | The general category of the task | |
| require_vision | No | Whether the model must support image/vision inputs | |
| max_usd_price_per_1m_prompt | No | Strict maximum cost in USD per 1M prompt tokens (e.g., 2.50) |