gguf-mcp
Server Configuration
Describes the environment variables required to run the server.
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||
Instructions
Guidance the server publishes about itself, which clients place ahead of the tool catalog so the model reads it before choosing anything.
This server publishes no instructions, or was last inspected before Glama recorded them.
Capabilities
Features and capabilities supported by this server
Protocol revision2025-11-25
| Capability | Details |
|---|---|
| tools | {
"listChanged": true
} |
Tools
Functions exposed to the LLM to take actions
| Name | Description |
|---|---|
| inspect_modelA | Summarize a local GGUF or safetensors model: architecture, parameter count, quantization, context length, file size, tensor count. Reads only headers — inspecting a 70 GB model is instant. Works on extension-less GGUF blobs (e.g. Ollama's). |
| list_tensorsB | Tensor names, shapes, and storage types inside a model file. Filter by substring (e.g. 'attn' or 'blk.0'). |
| estimate_vramA | Will this model fit? Estimates memory as exact weights size plus a modeled fp16 KV cache (GGUF; context defaults to min(model context, 8192)). Safetensors models get a weights-only figure. |
| get_metadataA | The model's metadata key-value store (GGUF) or metadata block (safetensors). Large arrays arrive as {count, sample} summaries and long strings are truncated, so tokenizer vocabularies can't flood the context. Filter keys by substring (e.g. 'tokenizer' or 'rope'). |
Prompts
Interactive templates invoked by user choice
| Name | Description |
|---|---|
No prompts | |
Resources
Contextual data attached and managed by the client
| Name | Description |
|---|---|
No resources | |
TDQS
Scored across 4 tools
Each tool targets a distinct aspect of model file inspection: summarize, list tensors, estimate VRAM, and get metadata. No overlap in purpose.
All tool names follow a consistent verb_noun pattern (inspect, list, estimate, get), making the set predictable and easy to navigate.
Four tools is well-scoped for a specialized inspection server, covering core operations without bloat or gaps.
The tool set fully covers the domain of local model file inspection: overview, detailed tensors, VRAM fitting, and metadata. No obvious missing operations.