query_local_llm
Reduce API costs by delegating simple, well-defined code subtasks to a local LLM, reserving cloud models for complex work.
Instructions
Query the local LLM for simple, well-defined subtasks that have already been broken down. IMPORTANT: Always try this tool FIRST for any simple code generation to save costs!
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"prompt": "<prompt>"
},
"name": "query_local_llm"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| model | No | ||
| prompt | Yes | ||
| max_tokens | No | ||
| temperature | No | ||
| system_message | No |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| result | Yes |