lms_load_cli
Load local LLM models from the command line with granular control over GPU offload, context length, and custom instance identifiers for precise deployment.
Instructions
CLI: Advanced model loading with granular control.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| gpu | No | GPU offload (e.g., 'max', '0.5', 'off'). | |
| model_id | Yes | ||
| identifier | No | Custom identifier for the loaded model instance. | |
| context_length | No | Context length override. |