Estimate VRAM needed
estimate_vramEstimates memory needed to run a GGUF or safetensors model, factoring in weights and a default KV cache for GGUF. Enter a model path to see if it fits your GPU.
Instructions
Will this model fit? Estimates memory as exact weights size plus a modeled fp16 KV cache (GGUF; context defaults to min(model context, 8192)). Safetensors models get a weights-only figure.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| path | Yes | Path to a .gguf or .safetensors file, a *.safetensors.index.json, or a model directory | |
| context_length | No | Context window to budget the KV cache for |