diagnose_latency_spike
Rank probable causes of inference latency spikes and suggest corrective knobs by correlating queue depth, KV-cache pressure, and prefix-cache locality.
Instructions
[READ][RCA] Rank the probable cause of a TTFT/latency spike + the knob to turn.
Correlates queue depth, KV-cache pressure/preemption, and prefix-cache locality into a ranked cause list — call this first on "why is inference slow".
Args: target: Inference target name from config; omit for the default.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| target | No |