local_llm_generate
Generate text using a local LLM with automatic fallback to cloud providers for offloadable tasks.
Instructions
Generate text using a local LLM (Ollama/LM Studio) for offloadable tasks. Falls back to cloud provider if local LLM is unavailable.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| prompt | Yes | The user prompt to send to the local LLM | |
| system | No | Optional system prompt | |
| maxTokens | No | Maximum output tokens (default: 4096) | |
| preferredModel | No | Preferred local model ID (e.g., "llama3.2:3b") |