What can I run on this machine?
ce_pot_rulaTell it a graphics card and how much system RAM, and it answers which language models will run and roughly how fast. Unlike ordinary VRAM calculators it knows that a mixture-of-experts model can keep its experts in system RAM, so it does not say 'impossible' where it is possible. Numbers labelled REAL happened on a named machine on a named date; numbers labelled MODELAT are computed and come as a range.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| cuant | No | q2 q3 q4 q5 q6 q8. Default q4. | |
| placa | Yes | Card id, e.g. 1080ti, 3060-12, 4090, or 'fara' for none. | |
| ram_gb | Yes | System RAM in GB. | |
| tip_ram | No | ddr4-3200, ddr5-6000, ddr4-2400-4c, … |