Local AI MCP Servers
Server Configuration
Describes the environment variables required to run the server.
| Name | Required | Description | Default |
|---|---|---|---|
| MM_ACCESS | No | Only needed when running mcp-modelmanager via command override: access mode (e.g. "direct"). | |
| LOCAL_HOST | No | Base URL of the local model backend. Defaults to "http://localhost:11434". | http://localhost:11434 |
| MM_VM_HOST | No | Only needed when running mcp-modelmanager via command override: hostname or IP address of the model machine. | |
| MM_VM_USER | No | Only needed when running mcp-modelmanager via command override: SSH user for the model machine. | |
| LOCAL_BACKEND | No | Backend for local model calls (e.g. "ollama" or "vllm"). Defaults to "ollama". | ollama |
| MM_CONTAINER_ROOT | No | Only needed when running mcp-modelmanager via command override: root directory on the model machine where models are stored (e.g. "/srv/models"). |
Instructions
Guidance the server publishes about itself, which clients place ahead of the tool catalog so the model reads it before choosing anything.
This server publishes no instructions, or was last inspected before Glama recorded them.
Capabilities
Features and capabilities supported by this server
Protocol revision2025-11-25
| Capability | Details |
|---|---|
| tools | {
"listChanged": false
} |
| prompts | {
"listChanged": false
} |
| resources | {
"subscribe": false,
"listChanged": false
} |
| experimental | {} |
Tools
Functions exposed to the LLM to take actions
| Name | Description |
|---|---|
| list_modelsA | Lists the models available on the local instance. Returns per model the name, parameter size, quantization and on-disk size, as far as the backend reports them. With vLLM it additionally shows whether an entry is a LoRA adapter and which base model it belongs to. Sensible before any other tool, to pick a fitting and actually present model name. |
| local_askA | Asks a local model a question and returns the answer as text. |
| local_structuredA | Has a local model return a result that conforms to a JSON schema. |
| local_embedA | Computes embedding vectors for a list of texts. |
Prompts
Interactive templates invoked by user choice
| Name | Description |
|---|---|
No prompts | |
Resources
Contextual data attached and managed by the client
| Name | Description |
|---|---|
No resources | |
TDQS
Scored across 4 tools
Each tool targets a clearly distinct capability: listing models, free-text generation, structured JSON generation, and embeddings. local_ask and local_structured are explicitly differentiated by output type, so an agent should not confuse them.
The local_* prefix gives most tools a consistent namespace, and local_ask/local_structured/local_embed are readable. list_models breaks the pattern slightly by using verb_noun without the prefix, but this is minor and still predictable.
Four tools is well-scoped for a local AI inference server: discovery, text generation, structured generation, and embeddings cover the core capabilities without bloat or redundancy.
The set covers the essential workflows for local model interaction: find available models, ask free-text questions, get schema-validated structured answers, and compute embeddings. There are no obvious dead ends or missing core operations for the stated purpose.