GPU VRAM & Deployment Cost Estimator
vram-calcEstimate the GPU VRAM (GB) required to serve a large language model. Inputs: model parameter count in billions, weight quantization precision (fp16/int8/int4), context length in tokens, batch size (concurrent sequences), and KV-cache precision. Returns a memory breakdown (weights, KV cache, activations, runtime overhead), a recommended GPU configuration, and copy-paste vLLM and Ollama launch commands. Use this when a user asks how much GPU memory a model needs or which GPU to buy/rent.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| locale | No | UI language for the rendered card. Match the language of the end user. | en |
| batchSize | No | Number of concurrent sequences (batch size). | |
| precision | No | Weight quantization precision. | fp16 |
| kvPrecision | No | KV-cache precision. | fp16 |
| modelParamsB | Yes | Model size in billions of parameters (e.g. 7, 13, 70). | |
| contextLength | No | Context window length in tokens. | |
| tensorParallel | No | Number of GPUs to shard the model across (tensor parallel size). |