configure_inference_scenario
Create or replace a typed inference replay scenario configuration without executing it. Define server, provider, and workload parameters for subsequent benchmark runs.
Instructions
Create or replace one typed inference replay scenario without executing it.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| name | Yes | ||
| seed | No | ||
| provider | Yes | ||
| operation | Yes | ||
| streaming | No | ||
| burstiness | No | Requires request_rate when supplied. | |
| concurrency | No | ||
| num_prompts | No | ||
| server_name | Yes | ||
| request_rate | No | ||
| endpoint_type | No | chat | |
| speedup_ratio | No | ||
| random_input_len | No | ||
| random_output_len | No | ||
| trace_artifact_id | No | Mooncake JSONL artifact; supported only by the AIPerf provider. | |
| random_range_ratio | No | ||
| warmup_request_count | No | ||
| semantic_oracle_workload | No | Declared workload with an oracle contract, not an ordinary workload. | |
| expected_configuration_id | No |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||