Self-hosting sizing
estimate_self_hostingVRAM, GPUs needed, single-stream and batched throughput, hardware cost and the vendor's official API price/speed for self-hosting an open-weights model. Omit model to list available models.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| gpus | No | gpu ids from list_gpu_prices, e.g. h100_sxm, h20, ascend910b, rtx_pro_6000, rtx5090, rtx5090d | |
| model | No |