gpu_auto_manage
Automatically offloads models from GPU VRAM when usage exceeds a threshold to prevent out-of-memory errors.
Instructions
Enable or disable automatic VRAM management. When enabled, the optimizer automatically offloads models when VRAM exceeds the threshold.
Tool call template
This tool declares no required parameters. Add optional parameters from the input schema as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {},
"name": "gpu_auto_manage"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| enabled | No |