_mcp_quantize_model
Quantize a model to GGUF, GPTQ, or AWQ format. Emits the quantization command as a dry run unless local Python is configured.
Instructions
Emit the quantization command for GGUF/GPTQ/AWQ — dry_run unless FTOS_LOCAL_PYTHON configured.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"model_path": "<model_path>"
},
"name": "_mcp_quantize_model"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| bits | No | ||
| format | No | gguf | |
| model_path | Yes | ||
| output_path | No | ||
| local_python | No |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||