get_cascade_metrics
Retrieve live metrics on locally saved tokens, offload percentage, and biasing state for local GPU models.
Instructions
Get live metrics on tokens saved locally on the RTX 5090, local offload percentage, and biasing state.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||