routing_policy_update
Switch a deployment's routing policy to control cache locality and load distribution, with automatic undo support.
Instructions
[WRITE][risk=medium] Switch a deployment's request-routing policy (reversible).
Controls prefix-cache locality across replicas: 'prefix_aware' / 'session_affinity' keep a session on one replica (warm cache), 'round_robin' spreads load evenly. Captures the prior policy for undo.
Args: application: Serve application name. deployment: Deployment name. policy: New routing policy (prefix_aware / round_robin / session_affinity). target: Inference target name from config; omit for the default.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| policy | Yes | ||
| target | No | ||
| deployment | Yes | ||
| application | Yes |