queue_depth
Reads running vs waiting requests to signal backpressure in inference clusters.
Instructions
[READ] Running vs waiting requests — the leading backpressure signal.
Args: target: Inference target name from config; omit for the default.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| target | No |