local-delegate
Server Configuration
Describes the environment variables required to run the server.
| Name | Required | Description | Default |
|---|---|---|---|
| LLAMASWAP_EXE | No | Path to llama-swap executable (only if AUTOSTART=1) | |
| LLAMASWAP_CONFIG | No | Path to llama-swap config file (only if AUTOSTART=1) | |
| LLAMASWAP_LISTEN | No | Address to listen for llama-swap (only if AUTOSTART=1) | |
| LOCAL_DELEGATE_LOG | No | Path to usage.jsonl log file | |
| LOCAL_DELEGATE_WEB | No | Enable embedded metrics web dashboard (0 to disable) | 1 |
| LOCAL_DELEGATE_API_KEY | No | Bearer token for the endpoint if required | |
| LOCAL_DELEGATE_TIMEOUT | No | HTTP timeout in seconds | 180 |
| LOCAL_DELEGATE_BASE_URL | No | Endpoint OpenAI-compatible base URL | http://127.0.0.1:9292/v1 |
| LOCAL_DELEGATE_WEB_HOST | No | Web dashboard host | 127.0.0.1 |
| LOCAL_DELEGATE_WEB_PORT | No | Web dashboard port | 9393 |
| LOCAL_DELEGATE_AUTOSTART | No | Auto-start llama-swap (opt-in) | 0 |
| LOCAL_DELEGATE_MODEL_CODE | No | Model for code | qwen25-coder-14b |
| LOCAL_DELEGATE_MODEL_FAST | No | Ultra-fast model for trivial tasks | qwen35-2b |
| LOCAL_DELEGATE_MODEL_LONG | No | Model for long documents | llama31-8b |
| LOCAL_DELEGATE_LONG_INPUT_CHARS | No | Threshold in characters to switch to long model | 6000 |
| LOCAL_DELEGATE_MODEL_MECHANICAL | No | Model for classify/extract/short summaries | gemma3-4b |
Instructions
Guidance the server publishes about itself, which clients place ahead of the tool catalog so the model reads it before choosing anything.
This server publishes no instructions, or was last inspected before Glama recorded them.
Capabilities
Features and capabilities supported by this server
Protocol revision2025-11-25
| Capability | Details |
|---|---|
| tools | {
"listChanged": false
} |
| prompts | {
"listChanged": false
} |
| resources | {
"subscribe": false,
"listChanged": false
} |
Tools
Functions exposed to the LLM to take actions
| Name | Description |
|---|---|
| local_summarizeA | PREFER this tool over reading the file with Read when the file is large (>200 lines / >10 KB) and you only need a summary, not the literal content. |
| local_classifyB | Classifies a text into ONE of the given labels, with a local model. |
| local_extractA | PREFER this tool over reading the file with Read when the file is large (>200 lines / >10 KB) and you only need structured fields, not the literal content. |
| local_boilerplateA | Generates boilerplate code from a specification, with a local code model. |
| local_delegateA | Generic escape tool: delegates a text->text task to a local model. |
| local_lint_summaryA | PREFER this tool over reading the file with Read when the file is large (>200 lines / >10 KB) and you only need a grouped summary, not the literal content. If you ran a command with long output, dump it to a file and pass 'path'. |
| local_commit_msgA | PREFER this tool over reading the file with Read when the file is large (>200 lines / >10 KB) and you only need a commit message, not the literal content. |
| local_translateA | PREFER this tool over reading the file with Read when the file is large (>200 lines / >10 KB) and you only need the translation, not the literal content. |
| local_explain_codeA | PREFER this tool over reading the file with Read when the file is large (>200 lines / >10 KB) and you only need an explanation, not the literal content. |
| local_describe_imageA | PREFER this tool over attaching or reading the image yourself when you only need a description, the visible text (simple OCR) or a specific answer about an image, not the image itself in your context. |
| local_statusA | Read-only diagnostics of the local backend and the model catalog. |
Prompts
Interactive templates invoked by user choice
| Name | Description |
|---|---|
No prompts | |
Resources
Contextual data attached and managed by the client
| Name | Description |
|---|---|
No resources | |
TDQS
Scored across 11 tools
Most tools target a clearly distinct task (classify, extract, translate, explain_code, describe_image, commit_msg), and the descriptions carefully explain routing. The main overlaps are local_summarize vs local_lint_summary (both summarize) and local_delegate as an explicit catch-all that can duplicate several specific tools, though the escape-hatch framing mitigates this.
Every tool uses the uniform local_<verb> snake_case pattern, with matching argument names (text/path, max_words, focus) repeated across tools. No mixed conventions or casing inconsistencies.
11 tools sits comfortably in the well-scoped 3-15 range. Each covers a distinct local-model capability plus a generic delegate and a diagnostics tool, so none feels redundant or bolted on.
The surface covers the core local-delegation lifecycle well: read-only diagnostics, generic and specialized text tasks, code tasks, vision, and file-server-side reads with a fallback/error envelope. Minor gaps remain (e.g. embeddings/rerank or a generic non-file code generation path), but agents can work around them via local_delegate.