engine_queue_depth
Monitor inference engine backpressure by reading the queue depth, comparing running vs waiting requests to identify congestion.
Instructions
[READ] Running vs waiting requests — the leading backpressure signal (any engine).
Args: target: Inference target name from config; omit for the default.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| target | No |