check_hardware_fit
Estimate whether a Hugging Face model fits in your GPU VRAM at a given precision, or automatically find the lowest-precision option that fits. Prevents choosing models that exceed available memory.
Instructions
Estimate whether a Hugging Face model will fit in a given amount of GPU VRAM, and at which precision. Uses the model's parameter count and standard bytes-per-parameter figures for each precision, plus a runtime overhead margin for activations and KV-cache. This is an estimate, not a guarantee — actual usage varies by framework, batch size, and context length.
Args: model_id: the HF model repo id, e.g. "mistralai/Mistral-7B-v0.1" available_vram_gb: available GPU VRAM in gigabytes, e.g. 24 precision: specific precision to check, or "auto" to find the lowest-precision option that fits
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| model_id | Yes | ||
| precision | No | auto | |
| available_vram_gb | Yes |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||