Estimate Fit
estimate_fitEstimate memory fit and bandwidth-bound decode speed for a Hugging Face MLX repo on a selected Mac hardware profile and context length.
Instructions
Estimate memory fit and bandwidth-bound decode speed. Deterministic, no LLM.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| repo_id | Yes | HF repo id | |
| profile_id | Yes | Profile id from list_hardware_profiles or 'local' | |
| context_tokens | No | Target context length |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| repo_id | Yes | ||
| verdict | Yes | ||
| confidence | Yes | ||
| profile_id | Yes | ||
| weights_gb | Yes | ||
| assumptions | No | ||
| headroom_gb | Yes | ||
| kv_cache_gb | Yes | ||
| required_gb | Yes | ||
| available_gb | Yes | ||
| context_tokens | Yes | ||
| est_decode_tps | No | Bandwidth-bound decode estimate (tokens/s); heuristic. | |
| runtime_overhead_gb | Yes |