vram_fit
Will this LoRA config train on a card with vram_gb GB? Returns verdict fits / tight / does_not_fit, the predicted peak in MB, the margin, how each part was derived, and any measured probe with the same settings.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| os | No | windows or linux; Windows spills instead of OOM | linux |
| dora | No | ||
| rank | Yes | ||
| model | No | unsloth/gemma-3-4b-it | |
| quant | No | Base weights: bitsandbytes nf4 or bf16 | 4bit |
| seq_len | No | Longest training example, in tokens | |
| vram_gb | Yes | Card memory as sold, in GB (8, 12, 16, 24...) | |
| lora_dropout | No | ||
| response_len | No | Tokens the loss covers (the response span) | |
| other_processes_mb | No | VRAM already held by other programs |