perf_baseline
Save and list performance baselines from repeated runs, returning metric ranges and spread percentages so perf_check can judge changes beyond normal run-to-run noise.
Instructions
Names a reference for perf_check, or lists them. With name and runs (names from perf_runs, several runs of the
same program recorded with no change between them), it saves copies of their summaries as the reference name,
replacing a previous one, and returns the range each number spans across them: that range, not one run, is what
perf_check judges against, since repeated runs differ by a few percent, and spread_pct, each range's width in %
of its midpoint: the noise of this program on this machine, which a change must exceed. With name alone it shows that reference;
with nothing it lists them. With skip_s the reference keeps each run without its first skip_s seconds (the
start-up, as perf_compare's skip_s) and perf_check applies the same cut to the run it judges, so both are
steady-state; the runs need their per-frame files for that.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| name | No | reference name: letters, digits, '.', '_', '-'; alone, shows that reference | |
| runs | No | run names from perf_runs to save as this reference, ideally 3 or more equal runs; replaces a previous one | |
| skip_s | No | seconds to leave out at the start of each recording, where shaders compile and resources load; 0 (default) keeps all. The GPU numbers, hitches and Metal memory are recomputed without them; perf_check applies the same cut to the run it judges |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||