vram_max_rank
Largest LoRA rank (multiple of 8) that fits with margin on a card with vram_gb GB, and the largest that is tight (a real run may fit, the one-step probe would not).
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"vram_gb": "<vram_gb>"
},
"name": "vram_max_rank"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| dora | No | ||
| model | No | unsloth/gemma-3-4b-it | |
| quant | No | Base weights: bitsandbytes nf4 or bf16 | 4bit |
| seq_len | No | Longest training example, in tokens | |
| vram_gb | Yes | Card memory as sold, in GB (8, 12, 16, 24...) | |
| lora_dropout | No | ||
| response_len | No | Tokens the loss covers (the response span) | |
| other_processes_mb | No | VRAM already held by other programs |