Local AI MCP Servers
Server Configuration
Describes the environment variables required to run the server.
| Name | Required | Description | Default |
|---|---|---|---|
| MM_ACCESS | No | Only needed when running mcp-modelmanager via command override: access mode (e.g. "direct"). | |
| LOCAL_HOST | No | Base URL of the local model backend. Defaults to "http://localhost:11434". | http://localhost:11434 |
| MM_VM_HOST | No | Only needed when running mcp-modelmanager via command override: hostname or IP address of the model machine. | |
| MM_VM_USER | No | Only needed when running mcp-modelmanager via command override: SSH user for the model machine. | |
| LOCAL_BACKEND | No | Backend for local model calls (e.g. "ollama" or "vllm"). Defaults to "ollama". | ollama |
| MM_CONTAINER_ROOT | No | Only needed when running mcp-modelmanager via command override: root directory on the model machine where models are stored (e.g. "/srv/models"). |
Instructions
Guidance the server publishes about itself, which clients place ahead of the tool catalog so the model reads it before choosing anything.
This server publishes no instructions, or was last inspected before Glama recorded them.
Capabilities
Features and capabilities supported by this server
Protocol revision2025-11-25
| Capability | Details |
|---|---|
| tools | {
"listChanged": false
} |
| prompts | {
"listChanged": false
} |
| resources | {
"subscribe": false,
"listChanged": false
} |
| experimental | {} |
Tools
Functions exposed to the LLM to take actions
| Name | Description |
|---|---|
| list_modelsA | Lists the models available on the local instance. Returns per model the name, parameter size, quantization and on-disk size, as far as the backend reports them. With vLLM it additionally shows whether an entry is a LoRA adapter and which base model it belongs to. Sensible before any other tool, to pick a fitting and actually present model name. |
| local_askA | Asks a local model a question and returns the answer as text. |
| local_structuredA | Has a local model return a result that conforms to a JSON schema. |
| local_embedA | Computes embedding vectors for a list of texts. |
Prompts
Interactive templates invoked by user choice
| Name | Description |
|---|---|
No prompts | |
Resources
Contextual data attached and managed by the client
| Name | Description |
|---|---|
No resources | |
Latest Blog Posts
- Who's Calling? MCP Hosts Are an Identity Blind Spot (And the Spec Knows It)By Om-Shree-0709 on .mcpAgent IdentityOAuth 2.1
- Your AI Chatbot Just Exposed Your CEO's Salary to an InternBy Om-Shree-0709 on .Agent IdentityMCP SecurityOAuth Delegation
- Why MCP Servers Need Execution Sandboxing (And Why Your Current Stack Isn't Enough)By Om-Shree-0709 on .Agentic AiPrompt InjectionWebAssembly
MCP directory API
We provide all the information about MCP servers via our MCP API.
curl -X GET 'https://glama.ai/api/mcp/v1/servers/setheerwagen/local-ai-mcp-servers'
If you have feedback or need assistance with the MCP directory API, please join our Discord server