modelread_mcp_estimate_fit
Will this Hugging Face model run on this hardware, how fast, with which quant, and with what command? Checks the repo and its quantized derivatives (GGUF / MLX / AWQ / FP8) from their real file sizes and tensor headers. Returns the best variant and alternatives, each with: verdict (fits | fits-tight | offload | no | unknown), decode and prefill tokens/sec as a calibrated range (lo/mid/hi with basis), longest context that fits, memory placement (VRAM / RAM / SSD) and an exact llama.cpp / vLLM / MLX launch command.
Tool call template
This tool declares no required parameters. Add optional parameters from the input schema as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {},
"name": "modelread_mcp_estimate_fit"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| ctx | No | context length in tokens to fit (default 32768). | |
| repo | No | Hugging Face repo id, e.g. "Qwen/Qwen3.6-27B" or "unsloth/gemma-4-26B-A4B-it-GGUF". | Qwen/Qwen3.6-27B |
| hardware | No | device preset id ("rtx4090", "m4max-128", "dgx-spark", "8x-h100-sxm", "iphone-17pro-12"), | rtx4090 |
| kv_cache_dtype | No | KV cache type: "f16", "q8_0" or "q4_0". | f16 |