plan_inference_profile
Build a diagnostic-only profile plan for a managed vLLM server. Specify the server name and choose torch_profiler or nsight_systems to identify performance issues.
Instructions
Build a diagnostic-only profile plan for one managed vLLM server.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| profiler | Yes | ||
| server_name | Yes |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||