gpu_set_threshold
Set the VRAM threshold between 50-95% to automatically offload models to CPU when memory exceeds the limit, preventing out-of-memory errors.
Instructions
Set the VRAM auto-management threshold (50-95%). When VRAM exceeds this, models are automatically offloaded to CPU.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| threshold_pct | No |