Deploy Serving
deploy_servingDeploy a registered model as a serverless inference endpoint; preview capped per-replica hourly costs, then confirm to launch.
Instructions
Deploy an already-registered model as a serverless serving (inference endpoint). Billing runs per replica per hour,
capped at price_cap_per_hour each, so the worst case is price_cap × max_replicas per hour.
With confirm=false (default) it only returns that cost summary; call again with confirm=true after the user agreed.
Find model_registration_id with the models tool, or register a Hugging Face model with register_model first.
Every write requires operation_id. Reuse the ID returned by the preview, or generate a UUID before the first call. Keep it for confirmation and all retries; a new ID means a new operation. After a timeout, check operation_status and resource state before retrying.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| confirm | No | ||
| autoscale | No | ||
| workspace | No | ||
| max_replicas | No | ||
| min_replicas | No | ||
| operation_id | No | ||
| max_context_tokens | No | ||
| price_cap_per_hour | Yes | ||
| share_idle_capacity | No | ||
| model_registration_id | Yes |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||