create_model_config
Creates a launchd or systemd service config for a llama-server model, enabling hot-swapping with swap_model.
Instructions
Generate a new service config for a llama-server model.
Creates a launchd plist (macOS) or systemd unit (Linux) that can be used with swap_model.
Args: name: Short alias for the model (e.g., "coder", "planner") model_path: Absolute path to the GGUF model file context_size: Context window size (default: 4096) gpu_layers: Number of GPU layers, -1 for all (default: -1) port: Port for llama-server (default: 8000)
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| name | Yes | ||
| model_path | Yes | ||
| context_size | No | ||
| gpu_layers | No | ||
| port | No |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| result | Yes |