dio_route_prompt
Route prompts to the optimal LLM backend via predictive latency scheduling, returning generated completions.
Instructions
Route a prompt through DIO's intelligent NLMS scheduler to the optimal backend and return the completion.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"prompt": "<prompt>"
},
"name": "dio_route_prompt"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| model | No | Target model name (optional) | |
| prompt | Yes | Prompt text to send | |
| max_tokens | No | Maximum tokens to generate (default: 256) | |
| temperature | No | Sampling temperature (default: 0.7) |