What LLMs fit on this hardware
what_fits_on_hardwareRank which popular local LLMs fit on a given GPU or Apple Silicon Mac (at ~4-bit quantization, 8K context) — models that fit come first, biggest first, with max context each. Use when a user asks "what can I run on my <GPU/Mac/N GB>?", "best local model for my machine?", or gives hardware without naming a model.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| gpu | No | GPU name, fuzzy. Multi-GPU rigs: join with + (e.g. "RTX 5090 + RTX 3090"). Provide gpu OR mac_ram_gb. | |
| gpu_count | No | Number of identical copies of the gpu. Default 1. | |
| mac_ram_gb | No | Apple Silicon unified memory GB. Provide gpu OR mac_ram_gb. |