Suggest model
suggest_modelRecommends catalog models for a task, ranked by fit to your machine's GPU and CPU capacity. Explains each pick and flags models already installed on a live provider.
Instructions
Recommend catalog models for a task, ranked for THIS machine: fully-on-GPU first, then partial GPU offload, then CPU-only. Within a tier the largest (most capable) model comes first unless preferSpeed is true. Flags models already installed on a live provider and explains each pick.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"task": "<task>"
},
"name": "suggest_model"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| task | Yes | The task you want a model for | |
| kvCacheType | No | KV cache precision (default f16) | |
| preferSpeed | No | Prefer smaller, faster models within each tier | |
| contextLength | No | Context length to plan for (default 4096) |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| task | Yes | ||
| suggestions | Yes |