queue_status
Monitor the status of AI model queues to track loaded models, pending requests, and GPU memory usage for performance analysis and debugging.
Instructions
Get current status of the model queue system.
Shows loaded models, queued requests, and GPU memory usage. Useful for monitoring queue performance and debugging loading issues.
Returns: JSON with queue status, loaded models, and pending requests
Input Schema
TableJSON Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||