Estimate Vram
estimate_vramCalculates GPU VRAM needed for a local GGUF model, including weights, KV cache, and overhead, then suggests how many layers to offload to the GPU.
Instructions
估算模型显存占用(权重+KV+开销),附带建议的 GPU offload 层数 (返回中的 suggested_gpu_layers 字段)。
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| ctx_len | No | ||
| model_id | Yes |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||