A
licenseA
qualityC
maintenanceEnables MCP clients to scan local GGUF models, estimate VRAM and suggest GPU offload layers, manage llama-server lifecycle, and proxy OpenAI-format chats with idle auto-unload.
9
MIT
Matching MCP tools:
Matching MCP Connectors:
io.github.theluckystrike
io.github.phpranga
io.github.johnisanerd
ai.smithery