Can I run it?
can_i_run_itWill a given local LLM run on given hardware? Returns fit, the best quant that fits, theoretical tok/s, and real owner-measured tok/s where available.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| model | No | Model name, e.g. 'Llama 70B', 'gpt-oss-120B', 'Qwen 32B'. Use list_models to see known names. | |
| mxfp4 | No | True if the model ships natively in MXFP4 (e.g. gpt-oss) | |
| context | No | Context window in tokens (default 8192) | |
| total_b | No | For an unlisted model: total parameters in billions | |
| unified | No | True for unified-memory machines (Macs, Strix Halo, CPU+RAM) | |
| vram_gb | No | For custom hardware: VRAM or unified memory in GB | |
| active_b | No | For an unlisted model: active params in billions (= total for dense, less for MoE) | |
| hardware | No | Hardware name/id, e.g. 'rtx-3090', 'Mac 128GB', 'Strix Halo'. Use list_hardware to see known ones. | |
| kv_precision | No | KV cache precision (default f16) | |
| bandwidth_gbps | No | For custom hardware: memory bandwidth in GB/s |