Compare two configurations over the same seeds
compare_configsCompare two configuration variants across a range of seeds to reveal which performs better, outputting aggregate statistics, paired deltas, flipped outcomes, and a plain-language analysis.
Instructions
Run two CONFIG variants over the SAME consecutive seed range (a paired experimental design: terrain and emplacement luck cancel out, so a few hundred seeds resolve real effect differences) and return each variant's aggregate statistics, the paired outcome deltas, the seeds whose outcome flipped, and a plain-language summary generated from those numbers. Use it to test doctrine questions, e.g. what happens to win rates when OPFOR adopts EMCON discipline. Max count 500.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| count | Yes | Number of consecutive seeds run under BOTH variants. | |
| label_a | No | Human-readable name for variant A. | |
| label_b | No | Human-readable name for variant B. | |
| config_a | Yes | Variant A overrides (may be {} for the stock configuration). | |
| config_b | Yes | Variant B overrides (may be {} for the stock configuration). | |
| start_seed | Yes | Deterministic engagement seed. The same seed always replays the identical engagement. Featured seeds: 20260719 (standard BLUFOR win), 66 (fast BLUFOR win), 57 (deliberate BLUFOR win), 41 (OPFOR win), 59 (close race, OPFOR). |