routing_policy_update
Directs you to update a deployment's request-routing policy in its source code and redeploy, because the policy cannot be changed through the API.
Instructions
[WRITE][risk=medium] Switch a deployment's request-routing policy.
NOTE: Ray Serve's request-routing policy is a code-level option on the @serve.deployment decorator, NOT a field settable over the Dashboard REST API ā there is no REST endpoint for it. This tool therefore refuses with a teaching error rather than pretend; change the policy in the deployment's source and redeploy.
Args: application: Serve application name. deployment: Deployment name. policy: Desired routing policy (prefix_aware / round_robin / session_affinity). target: Inference target name from config; omit for the default.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| policy | Yes | ||
| target | No | ||
| deployment | Yes | ||
| application | Yes |