Check whether a model fits hardware
check_hardware_fitUse this when the user asks whether one specific model runs on one specific machine, at what memory cost, and roughly how fast. Needs a hardware id and a model id from search_catalog. Returns a fit verdict, the memory arithmetic, and a decode-speed range with a confidence label. Memory is sized from all parameters, speed from active parameters. It does not recommend purchases and does not run anything.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"hardware_id": "<hardware_id>",
"model_id": "<model_id>"
},
"name": "check_hardware_fit"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| model_id | Yes | Model id from search_catalog. | |
| hardware_id | Yes | Hardware id from search_catalog. | |
| quantisation | No | Weight quantisation. One of Q2_K, Q3_K_M, Q4_K_M, Q5_K_M, Q6_K, Q8_0, F16. Default Q4_K_M. | Q4_K_M |
| context_length | No | Context window in tokens that the KV cache is sized for. 512 to 262144. Default 4096. |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | ||
| model | Yes | ||
| notes | Yes | ||
| speed | Yes | null when the model does not fit, because a speed for hardware that cannot load the weights would be invented. | |
| memory | Yes | Memory arithmetic for the requested quantisation and context length. | |
| sources | Yes | Primary sources for the model and hardware records. May be empty. | |
| summary | Yes | One or two plain-language sentences stating the answer. | |
| verdict | Yes | ||
| hardware | Yes | ||
| data_as_of | Yes | Date the bundled catalogue was last updated. Not the time of this call. | |
| quantisation | Yes | ||
| context_length | Yes |