fit_check
Check if a machine learning model fits on local hardware by estimating weight and KV-cache size, then comparing against available GPU VRAM or system RAM.
Instructions
Determine whether a model fits on the local hardware. Resolves the model weight size from the provider or the static catalog (or an explicit sizeBytes), estimates KV-cache overhead for a context length (default 4096), then compares weight+KV against free GPU VRAM, falling back to system RAM. Returns fits, target (gpu/cpu/none), weight/kv/required/available bytes.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| model | Yes | Model id/name to check | |
| provider | No | Optional provider id | |
| sizeBytes | No | Optional explicit model weight size in bytes (overrides lookup) | |
| contextLength | No | Context length for KV-cache estimate (default 4096) | |
| parameterSize | No | Optional parameter size like "7B" or "3.8B" for KV estimate (overrides lookup) |