Skip to main content
Glama

Server Configuration

Describes the environment variables required to run the server.

NameRequiredDescriptionDefault
MM_ACCESSNoOnly needed when running mcp-modelmanager via command override: access mode (e.g. "direct").
LOCAL_HOSTNoBase URL of the local model backend. Defaults to "http://localhost:11434".http://localhost:11434
MM_VM_HOSTNoOnly needed when running mcp-modelmanager via command override: hostname or IP address of the model machine.
MM_VM_USERNoOnly needed when running mcp-modelmanager via command override: SSH user for the model machine.
LOCAL_BACKENDNoBackend for local model calls (e.g. "ollama" or "vllm"). Defaults to "ollama".ollama
MM_CONTAINER_ROOTNoOnly needed when running mcp-modelmanager via command override: root directory on the model machine where models are stored (e.g. "/srv/models").

Instructions

Guidance the server publishes about itself, which clients place ahead of the tool catalog so the model reads it before choosing anything.

This server publishes no instructions, or was last inspected before Glama recorded them.

Capabilities

Features and capabilities supported by this server

Protocol revision2025-11-25

CapabilityDetails
tools
{
  "listChanged": false
}
prompts
{
  "listChanged": false
}
resources
{
  "subscribe": false,
  "listChanged": false
}
experimental
{}

Tools

Functions exposed to the LLM to take actions

NameDescription
list_modelsA

Lists the models available on the local instance.

Returns per model the name, parameter size, quantization and on-disk size, as far as the backend reports them. With vLLM it additionally shows whether an entry is a LoRA adapter and which base model it belongs to. Sensible before any other tool, to pick a fitting and actually present model name.

local_askA

Asks a local model a question and returns the answer as text.

For free-text tasks: writing, rewriting, summarizing, explaining. If a
machine-processable result is needed, use 'local_structured' instead.

Args:
    model: Model name as in 'list_models', for example 'llama3.2:3b'.
    prompt: The actual instruction for the model.
    system: Optional role/behavior instruction.
    temperature: 0 means as deterministic as possible (default), higher means more creative.
    max_tokens: Optional cap on the number of generated tokens.
    context: Optional text prepended to the prompt (source, excerpt, data).
    think: Enables the model's reasoning trace. Off by default, because the
        reasoning trace otherwise consumes the answer's token budget (with a
        tight 'max_tokens' the answer then comes back empty). Only for models
        with the 'thinking' capability.
local_structuredA

Has a local model return a result that conforms to a JSON schema.

Uses the respective backend's schema enforcement (Ollama's 'format' field,
vLLM's 'response_format' with 'json_schema') and then additionally validates
the answer against the schema itself. If the output does not satisfy the
schema, it retries up to twice, passing the model the concrete violations.
Only then an error, but then with the invalid raw output, so it is visible
what went wrong.

Args:
    model: Model name, for example 'llama3.2:3b'.
    prompt: Instruction on what should be extracted from which text.
    schema: JSON schema of the desired result (object with 'type', 'properties', ...).
    system: Optional role/behavior instruction.
    think: Enables the model's reasoning trace. Off by default, because the
        reasoning trace otherwise consumes the answer's token budget. Only
        for models with the 'thinking' capability.
local_embedA

Computes embedding vectors for a list of texts.

Useful for similarity comparisons, duplicate detection or a rough sort by
topic, without troubling a large language model.

Args:
    texts: List of texts to embed.
    model: Embedding model, with Ollama preset to 'nomic-embed-text'.

Prompts

Interactive templates invoked by user choice

NameDescription

No prompts

Resources

Contextual data attached and managed by the client

NameDescription

No resources

Latest Blog Posts

MCP directory API

We provide all the information about MCP servers via our MCP API.

curl -X GET 'https://glama.ai/api/mcp/v1/servers/setheerwagen/local-ai-mcp-servers'

If you have feedback or need assistance with the MCP directory API, please join our Discord server