Estimate VRAM for an AI model
estimate_vramHow much GPU memory an AI model needs (LLMs such as Qwen, DeepSeek, Llama, Gemma, GPT-OSS; image and video models such as FLUX, SDXL, Wan) at a given precision and context length, and which GPUs on gpu.nz fit it with their current price. Call without model to list the known models.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| model | No | Model name or id, e.g. "qwen3-32b", "Llama 3.3 70B", "flux.1-dev" | |
| precision | No | Weights precision: "fp16", "fp8", "q8", "q6", "q5", "q4" (LLMs; default q4 for LLMs, fp16 for image models) | |
| context_tokens | No | LLM context length in tokens (default 8192) | |
| concurrent_requests | No | Parallel sequences sharing the GPU (default 1) |