Estimate VRAM for an AI model
estimate_vramHow much GPU memory an AI model needs (LLMs such as Qwen, DeepSeek, Llama, Gemma, GPT-OSS; image and video models such as FLUX, SDXL, Wan) at a given precision and context length, and which GPUs on gpu.nz fit it with their current price. Call without model to list the known models.
Tool call template
This tool declares no required parameters. Add optional parameters from the input schema as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {},
"name": "estimate_vram"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| model | No | Model name or id, e.g. "qwen3-32b", "Llama 3.3 70B", "flux.1-dev" | |
| precision | No | Weights precision: "fp16", "fp8", "q8", "q6", "q5", "q4" (LLMs; default q4 for LLMs, fp16 for image models) | |
| context_tokens | No | LLM context length in tokens (default 8192) | |
| concurrent_requests | No | Parallel sequences sharing the GPU (default 1) |