Does this LLM fit on this GPU?
estimate_vramGPU memory, number of GPUs, speed and rental cost to run an open LLM. Works for the models listed at https://studiotvai.com/api/models.json and any Hugging Face model id or link. Uses the real KV cache of each architecture (sliding window, hybrid linear attention, MLA).
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"model": "<model>"
},
"name": "estimate_vram"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| gpu | No | GPU id or name, e.g. "rtx-4090", "H100", "mac-m4-max-128". Default h100. List: https://studiotvai.com/api/gpus.json | |
| model | Yes | Model name or id ("Llama 3.3 70B", "qwen3.8-27b"), Hugging Face id ("Qwen/Qwen3-32B") or link. | |
| engine | No | Serving engine. Default: vllm on data-center GPUs, llamacpp elsewhere. | |
| context | No | Tokens per request (prompt + output). Default 8192. | |
| weights | No | Weight format. Default: the official checkpoint (native) or BF16. | |
| kv_cache | No | KV cache precision. Default bf16. nvfp4: vLLM only, NVIDIA GPUs, models with standard attention (otherwise bf16 is used). | |
| gpu_count | No | Number of GPUs, or "auto" (default) for the fewest that fit. | |
| concurrent_requests | No | Requests served at the same time, each with its own KV cache. Default 1. |