Match a workload to the cheapest GPU
match_workloadThe routing DECISION: describe a job (a model, size, or GPU need) and get the ranked, reasoned recommendation for the cheapest place to run it across the live market, with the required VRAM, GPU count, effective $/hr, and how much cheaper it is than a hyperscaler. No key required. Results mirror the site and apply a small, disclosed partner tie-break between otherwise-equal offers (each match reports partner true/false).
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| spot | No | Set true to include interruptible spot capacity for a cheaper rate. | |
| task | No | What the job does. | |
| model | No | Open model name to size against, e.g. "Llama 3 70B", "Qwen 72B", "Mixtral". | |
| query | No | Plain-language job, e.g. "cheapest to serve Llama 3 70B" or "2x H100 for fine-tuning". Provide this OR a structured spec below. | |
| region | No | Restrict to a data-residency region. | |
| vram_gb | No | Rough VRAM the job needs, in GB, if you already know it. | |
| params_b | No | Model size in billions of parameters when no exact model is named. | |
| reserved | No | Set true to include reserved / committed-term capacity for a lower rate. | |
| gpu_count | No | Force a specific GPU count instead of letting the engine size it. | |
| precision | No | Numeric precision to size the model at. | |
| budget_usd_hr | No | Only recommend configs at or under this hourly budget. |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| hero | No | ||
| count | Yes | ||
| stale | No | ||
| matches | Yes | ||
| workload | No | ||
| updated_at | No |