engine_inventory
Identify running models and engine server details across vLLM, SGLang, and TGI. Provides engine-agnostic access to model IDs and server information from /v1/models or /info.
Instructions
[READ] Running-model identity + engine server info (engine-agnostic).
vLLM / SGLang report served ids from /v1/models; TGI's single model id comes from /info.
Args: target: Inference target name from config; omit for the default.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| target | No |