Scale Serving
scale_servingAdjust a serving's replica range, autoscaling, and per-replica price cap, previewing cost-raising changes for confirmation while applying reductions immediately.
Instructions
Change a serving's replica range, autoscaling, or per-replica price cap. Pass only the fields to change.
Any change that can raise the hourly cost — a larger replica range, turning autoscale on, or a higher per-replica
price cap — with confirm=false (default) only returns the current state and the requested change and changes
nothing; call again with confirm=true after the user agreed. Lowering the range, turning autoscale off, or
lowering the cap applies immediately. Replicas running above the new setting are removed within about 30
seconds and the requests they are handling fail: with autoscale off the serving keeps min_replicas, with
autoscale on up to max_replicas. When that happens the answer has replicas_removed; if the serving is in
use, tell the user before lowering it.
Every write requires operation_id. Reuse the ID returned by the preview, or generate a UUID before the first call. Keep it for confirmation and all retries; a new ID means a new operation. After a timeout, check operation_status and resource state before retrying.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"serving": "<serving>"
},
"name": "scale_serving"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| confirm | No | ||
| serving | Yes | ||
| autoscale | No | ||
| max_replicas | No | ||
| min_replicas | No | ||
| operation_id | No | ||
| price_cap_per_hour | No |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||