vllm-ops-mcp
Server Configuration
Describes the environment variables required to run the server.
| Name | Required | Description | Default |
|---|---|---|---|
| VLLM_OPS_MCP_LIVE | No | 1 to run real-infra smoke tests | |
| VLLM_OPS_MCP_MODEL | No | served-model-name, used in completion payloads | qwen3-14b |
| VLLM_OPS_MCP_BASE_URL | No | OpenAI-compatible base URL | http://127.0.0.1:8000/v1 |
| VLLM_OPS_MCP_WSL_DISTRO | No | WSL distro hosting vLLM | Ubuntu-22.04 |
| VLLM_OPS_MCP_RUNS_IN_WSL | No | 1 if this server process itself runs inside WSL2/Linux (skips the wsl -d hop); auto-detected via sys.platform | |
| VLLM_OPS_MCP_SERVICE_UNIT | No | systemd unit name | vllm |
| VLLM_OPS_MCP_NVIDIA_SMI_PATH | No | nvidia-smi binary override | nvidia-smi |
| VLLM_OPS_MCP_EXEC_SCRIPT_PATH | No | WSL-side path to the serve exec script (fallback source) | ~/vllm-systemd-exec.sh |
| VLLM_OPS_MCP_SERVE_CONFIG_PATH | No | local file mirror of the exec script; if set, get_serve_config reads it directly instead of shelling into WSL as a fallback source | |
| VLLM_OPS_MCP_DEEP_RATE_LIMIT_PER_MIN | No | cap on check_health(deep=True) + test_completion calls/min | 20 |
Instructions
Guidance the server publishes about itself, which clients place ahead of the tool catalog so the model reads it before choosing anything.
This server publishes no instructions, or was last inspected before Glama recorded them.
Capabilities
Features and capabilities supported by this server
Protocol revision2025-11-25
| Capability | Details |
|---|---|
| tools | {
"listChanged": true
} |
| logging | {} |
| prompts | {
"listChanged": false
} |
| resources | {
"subscribe": false,
"listChanged": false
} |
| extensions | {
"io.modelcontextprotocol/ui": {}
} |
| experimental | {} |
Tools
Functions exposed to the LLM to take actions
| Name | Description |
|---|---|
| check_healthA | Two-stage health probe for the local vLLM server, mirroring check-vllm.cmd. deep=False (default): GET /v1/models liveness check only. deep=True: additionally fires one minimal real /v1/chat/completions call to confirm the server actually generates text, not just reports a model loaded (rate-limited -- this consumes real GPU inference cycles on shared infra). Returns {ok, status: up|degraded|down, tier, model_id, latency_ms, completion_s, error}. |
| list_modelsA | GET /v1/models passthrough -- lists model IDs currently loaded/served. |
| test_completionA | On-demand real /v1/chat/completions call with a caller-supplied prompt, for manual sanity-checking (same mechanism as check_health(deep=True) but user-controlled). Rate-limited -- consumes real GPU inference cycles on shared infra. max_tokens is clamped server-side to config.MAX_TEST_COMPLETION_TOKENS and the prompt is capped at config.MAX_TEST_COMPLETION_PROMPT_CHARS (oversized prompts are rejected) -- the rate limiter bounds call frequency, not the cost of a single call. Returns {ok, model_id, completion_s, text, error}. |
| get_gpu_statusA | nvidia-smi wrapper: per-GPU VRAM used/total and utilization%, plus per-process VRAM usage (to catch VRAM-overshoot). Read-only. |
| get_service_statusA | systemd unit status for the vLLM service (via |
| get_serve_configA | Read-only introspection of the current vLLM launch flags. Prefers the LIVE process's real argv (/proc//cmdline of the systemd unit's MainPID) as ground truth; falls back to the static exec script if the process isn't currently up. vLLM does not expose its own launch flags over the API, so this never queries the server itself. Any argv value following a flag matching a known-sensitive pattern (token/key/secret/password/credential) is redacted before being returned. |
Prompts
Interactive templates invoked by user choice
| Name | Description |
|---|---|
No prompts | |
Resources
Contextual data attached and managed by the client
| Name | Description |
|---|---|
No resources | |
Latest Blog Posts
- Who's Calling? MCP Hosts Are an Identity Blind Spot (And the Spec Knows It)By Om-Shree-0709 on .mcpAgent IdentityOAuth 2.1
- Your AI Chatbot Just Exposed Your CEO's Salary to an InternBy Om-Shree-0709 on .Agent IdentityMCP SecurityOAuth Delegation
- Why MCP Servers Need Execution Sandboxing (And Why Your Current Stack Isn't Enough)By Om-Shree-0709 on .Agentic AiPrompt InjectionWebAssembly
MCP directory API
We provide all the information about MCP servers via our MCP API.
curl -X GET 'https://glama.ai/api/mcp/v1/servers/jaimenbell/vllm-ops-mcp'
If you have feedback or need assistance with the MCP directory API, please join our Discord server