get_inferencemax_benchmark
Retrieves InferenceMAX benchmark data for a model to compare performance across hardware and framework options. Helps identify optimal configurations for peak inference performance.
Instructions
Get InferenceMAX benchmark data for a specific model to compare performance
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| model | Yes | Model name (e.g., gpt-4o, claude-3-5-sonnet, llama-3.1-70b) | |
| hardware | No | Hardware: api, h100, a100 (default: api) | api |
| framework | No | Framework: api, vllm, tgi, sglang (default: api) | api |