kv_cache_stats
Monitor KV-cache utilization, prefix-cache hit rate, and preemption count to assess inference target performance.
Instructions
[READ] KV-cache utilisation, prefix-cache hit rate, and preemption count.
Args: target: Inference target name from config; omit for the default.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| target | No |