will_it_fit
Will this model fit, and what does a fitting machine cost right now? Deterministic VRAM arithmetic — weights (params x bytes/precision) + KV cache (2 x layers x kv_heads x head_dim x context x batch) + stated overhead — checked against the live book, cheapest fitting offers first. Pass a known model slug (llama-3.1-8b/70b/405b, mistral-7b, mixtral-8x7b, qwen2.5-7b/32b/72b, gemma-2-9b/27b) OR params_b for a stated Llama-like guess. precision: fp16/int8/int4. If you pass tokens_per_s (YOUR measured throughput — we never invent one), each offer gains usd_per_m_tokens. Every approximation is in the assumptions list, not fine print.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| batch | No | ||
| limit | No | ||
| model | No | ||
| context | No | ||
| params_b | No | ||
| precision | No | fp16 | |
| offer_class | No | ||
| tokens_per_s | No |