start_aitune_profiling
Start a profiling run for a model on the AITune sidecar: pass model, and optionally batch_sizes, measurement_steps, saturation_cutoff and include_warmup to override the defaults. It uses GPU time on the sidecar; read the finished report with get_aitune_profiling. Needs a claimed Last Price credential. Needs a claimed workspace: a sandbox key from self-registration is refused (403) until a person claims the workspace.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| model | Yes | The model to profile. | |
| batch_sizes | No | The batch sizes to measure. | |
| include_warmup | No | Include the warm-up run in the report. | |
| measurement_steps | No | How many steps to measure at each batch size. | |
| saturation_cutoff | No | Stop growing the batch once throughput gains fall below this. |