Skip to main content
Glama
jaimenbell

vllm-ops-mcp

Server Configuration

Describes the environment variables required to run the server.

NameRequiredDescriptionDefault
VLLM_OPS_MCP_LIVENo1 to run real-infra smoke tests
VLLM_OPS_MCP_MODELNoserved-model-name, used in completion payloadsqwen3-14b
VLLM_OPS_MCP_BASE_URLNoOpenAI-compatible base URLhttp://127.0.0.1:8000/v1
VLLM_OPS_MCP_WSL_DISTRONoWSL distro hosting vLLMUbuntu-22.04
VLLM_OPS_MCP_RUNS_IN_WSLNo1 if this server process itself runs inside WSL2/Linux (skips the wsl -d hop); auto-detected via sys.platform
VLLM_OPS_MCP_SERVICE_UNITNosystemd unit namevllm
VLLM_OPS_MCP_NVIDIA_SMI_PATHNonvidia-smi binary overridenvidia-smi
VLLM_OPS_MCP_EXEC_SCRIPT_PATHNoWSL-side path to the serve exec script (fallback source)~/vllm-systemd-exec.sh
VLLM_OPS_MCP_SERVE_CONFIG_PATHNolocal file mirror of the exec script; if set, get_serve_config reads it directly instead of shelling into WSL as a fallback source
VLLM_OPS_MCP_DEEP_RATE_LIMIT_PER_MINNocap on check_health(deep=True) + test_completion calls/min20

Instructions

Guidance the server publishes about itself, which clients place ahead of the tool catalog so the model reads it before choosing anything.

This server publishes no instructions, or was last inspected before Glama recorded them.

Capabilities

Features and capabilities supported by this server

Protocol revision2025-11-25

CapabilityDetails
tools
{
  "listChanged": true
}
logging
{}
prompts
{
  "listChanged": false
}
resources
{
  "subscribe": false,
  "listChanged": false
}
extensions
{
  "io.modelcontextprotocol/ui": {}
}
experimental
{}

Tools

Functions exposed to the LLM to take actions

NameDescription
check_healthA

Two-stage health probe for the local vLLM server, mirroring check-vllm.cmd. deep=False (default): GET /v1/models liveness check only. deep=True: additionally fires one minimal real /v1/chat/completions call to confirm the server actually generates text, not just reports a model loaded (rate-limited -- this consumes real GPU inference cycles on shared infra). Returns {ok, status: up|degraded|down, tier, model_id, latency_ms, completion_s, error}.

list_modelsA

GET /v1/models passthrough -- lists model IDs currently loaded/served.

test_completionA

On-demand real /v1/chat/completions call with a caller-supplied prompt, for manual sanity-checking (same mechanism as check_health(deep=True) but user-controlled). Rate-limited -- consumes real GPU inference cycles on shared infra. max_tokens is clamped server-side to config.MAX_TEST_COMPLETION_TOKENS and the prompt is capped at config.MAX_TEST_COMPLETION_PROMPT_CHARS (oversized prompts are rejected) -- the rate limiter bounds call frequency, not the cost of a single call. Returns {ok, model_id, completion_s, text, error}.

get_gpu_statusA

nvidia-smi wrapper: per-GPU VRAM used/total and utilization%, plus per-process VRAM usage (to catch VRAM-overshoot). Read-only.

get_service_statusA

systemd unit status for the vLLM service (via wsl -d <distro> -- systemctl show, or native systemctl if this server runs inside WSL2/Linux). Returns load/active/sub state, restart count, main PID, and last-active timestamp. Read-only -- never starts/stops the unit.

get_serve_configA

Read-only introspection of the current vLLM launch flags. Prefers the LIVE process's real argv (/proc//cmdline of the systemd unit's MainPID) as ground truth; falls back to the static exec script if the process isn't currently up. vLLM does not expose its own launch flags over the API, so this never queries the server itself. Any argv value following a flag matching a known-sensitive pattern (token/key/secret/password/credential) is redacted before being returned.

Prompts

Interactive templates invoked by user choice

NameDescription

No prompts

Resources

Contextual data attached and managed by the client

NameDescription

No resources

Latest Blog Posts

MCP directory API

We provide all the information about MCP servers via our MCP API.

curl -X GET 'https://glama.ai/api/mcp/v1/servers/jaimenbell/vllm-ops-mcp'

If you have feedback or need assistance with the MCP directory API, please join our Discord server