A
licenseA
qualityC
maintenanceEnables MCP clients to scan local GGUF models, estimate VRAM and suggest GPU offload layers, manage llama-server lifecycle, and proxy OpenAI-format chats with idle auto-unload.
9
MIT
No user-submitted related servers found.
This server cannot be deployed