query_local_llm
Reduce API costs by delegating simple, well-defined code subtasks to a local LLM, reserving cloud models for complex work.
Instructions
Query the local LLM for simple, well-defined subtasks that have already been broken down. IMPORTANT: Always try this tool FIRST for any simple code generation to save costs!
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| model | No | ||
| prompt | Yes | ||
| max_tokens | No | ||
| temperature | No | ||
| system_message | No |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| result | Yes |