Skip to main content
Glama
alphaparkinc

genpark-quantized-model-vram-tensor-parallel-estimator-skill

Official

Related Servers

Alternatives to genpark-quantized-model-vram-tensor-parallel-estimator-skill

No user-submitted related servers found.

    Related Servers

    • A
      license
      A
      quality
      C
      maintenance
      Provides tools to inspect local GGUF and safetensors model files, returning metadata, tensor info, and VRAM estimates without reading tensor data. Enables asking natural-language questions about model architecture, quantization, size, and compatibility.
      4
      26 npm
      MIT
    • A
      license
      A
      quality
      A
      maintenance
      Checks whether an open-weight LLM fits your GPU: VRAM for weights, KV cache and overhead at each quantisation, a tokens-per-second ceiling, the longest context that fits, and what would work instead when it doesn't. Reads any Hugging Face repo's config.json. Free, read-only, no API key.
      4
      6
      MIT
    • A
      license
      A
      quality
      C
      maintenance
      Enables MCP clients to scan local GGUF models, estimate VRAM and suggest GPU offload layers, manage llama-server lifecycle, and proxy OpenAI-format chats with idle auto-unload.
      9
      MIT
    • A
      license
      A
      quality
      A
      maintenance
      LLM deployment planner: given a model and a GPU, answers will it fit, will it hit your SLO, and what will it cost. Sizes VRAM and KV-cache from the model's real architecture, and labels every number measured, estimated, or unknown.
      5
      1,576 PyPI
      2
      MIT