compare-perf-to-baseline
Compare a run (runId) or filtered target (testchimpId plus optional dimensions) to its promoted baseline. envClass is required. Optional thresholds override max p95 regression percent and maximum fail-rate increase.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| runId | No | ||
| dataset | No | ||
| llmMode | No | ||
| profile | No | ||
| envClass | Yes | ||
| environment | No | ||
| testchimpId | No | ||
| maxFailRateIncrease | No | ||
| maxP95RegressionPercent | No |