vram_max_rank
Largest LoRA rank (multiple of 8) that fits with margin on a card with vram_gb GB, and the largest that is tight (a real run may fit, the one-step probe would not).
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| dora | No | ||
| model | No | unsloth/gemma-3-4b-it | |
| quant | No | Base weights: bitsandbytes nf4 or bf16 | 4bit |
| seq_len | No | Longest training example, in tokens | |
| vram_gb | Yes | Card memory as sold, in GB (8, 12, 16, 24...) | |
| lora_dropout | No | ||
| response_len | No | Tokens the loss covers (the response span) | |
| other_processes_mb | No | VRAM already held by other programs |