GPU VRAM Calculator (Model Size & GPU Fit)
gpu_vram_calculatorGPU VRAM Calculator (Model Size & GPU Fit) — Calculate the VRAM a large language model needs by parameter count and precision (fp16, int8, int4), then see which GPU it fits — from RTX 4090 to H100.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| precision | Yes | ||
| overheadPct | Yes | ||
| paramsBillion | Yes |