local_llm
Run private or bulk text tasks on a local LLM, keeping data on your machine. Pass file paths for local processing; only the model's answer returns.
Instructions
Run a task on a local LLM on this machine. Nothing is sent to the cloud.
Use it for (1) private data that must not leave the machine: pass file paths in files instead of
reading them yourself; this server reads them and only the local model's answer comes back to you;
and (2) bulk, mechanical text work (summarizing, classifying, translating, reformatting) where a smaller
model is good enough. Do not use it for tasks that need strong reasoning or careful code changes.
Files must be under the home directory or /tmp and must not be hidden (no path component starting with ".").
Args: prompt: The instruction for the local model. Write it self-contained; the model sees nothing else. files: Text files to include after the prompt (UTF-8). Total input is capped (~60k characters). output_path: If set, the answer is written to this new file and only a short notice is returned, so even the answer stays out of the conversation. Existing files are never overwritten. system: Optional system prompt. max_tokens: Maximum tokens to generate. thinking: Enable the model's thinking mode, if it has one (slower, sometimes more accurate).
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| files | No | ||
| prompt | Yes | ||
| system | No | ||
| thinking | No | ||
| max_tokens | No | ||
| output_path | No |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| result | Yes |