dio_route_prompt
Route prompts to the optimal LLM backend via predictive latency scheduling, returning generated completions.
Instructions
Route a prompt through DIO's intelligent NLMS scheduler to the optimal backend and return the completion.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| model | No | Target model name (optional) | |
| prompt | Yes | Prompt text to send | |
| max_tokens | No | Maximum tokens to generate (default: 256) | |
| temperature | No | Sampling temperature (default: 0.7) |