check_vram_fit
Estimate whether an open-weights model fits on a given GPU by entering parameter count, quantisation bit width, and context length. Get VRAM usage in GB and compatible GPU/Mac models.
Instructions
Work out whether an open-weights model fits on a given GPU. Takes parameter count in billions, quantisation bit width and context length; returns weights + KV cache + overhead in GB and which common cards (and Macs) have room.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| params_b | Yes | Parameter count in billions, e.g. 70 for a 70B model. | |
| quant_bits | No | Bits per weight: 16 (fp16), 8 (int8/fp8), 5, 4 (Q4) are typical. | |
| context_tokens | No | Context window you intend to use, in tokens. |