gpus_needed_for_model
How many GPUs it takes to self-host an open-weight LLM at a given quantization, and the cheapest rental setups for it right now. quant is one of: fp16, bf16, fp8, mxfp8, int8, q6, fp6, q5, q4km, nvfp4, awq, mxfp4, gptq, int4, q3, q2, iq2, iq1. Estimates memory only (weights + 20% runtime overhead), not throughput. limit: 1-10.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| limit | No | ||
| model | Yes | ||
| quant | No | fp8 |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||