routing_policy_update
Attempt to switch a Ray Serve deployment's request-routing policy; when REST cannot set it, returns guidance to edit the source and redeploy.
Instructions
[WRITE][risk=medium] Switch a deployment's request-routing policy.
NOTE: Ray Serve's request-routing policy is a code-level option on the @serve.deployment decorator, NOT a field settable over the Dashboard REST API — there is no REST endpoint for it. This tool therefore refuses with a teaching error rather than pretend; change the policy in the deployment's source and redeploy.
Args: application: Serve application name. deployment: Deployment name. policy: Desired routing policy (prefix_aware / round_robin / session_affinity). target: Inference target name from config; omit for the default.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"application": "<application>",
"deployment": "<deployment>",
"policy": "<policy>"
},
"name": "routing_policy_update"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| policy | Yes | ||
| target | No | ||
| deployment | Yes | ||
| application | Yes |