diagnose_engine_latency
Rank probable causes of a latency spike in any inference serving engine by correlating queue backpressure, cache pressure, and locality signals.
Instructions
[READ][RCA] Rank the probable cause of a latency spike for any serving engine.
Correlates whichever signals the engine exposes (queue backpressure, KV/token-cache pressure, cache locality) into a ranked cause + the knob to turn — the engine-agnostic counterpart to diagnose_latency_spike (vLLM).
Args: target: Inference target name from config; omit for the default.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| target | No |