analyze
Generate a historical agreement report that scans kept consensus panels to calculate how often two distinct model lineages reach the same verdict when they co-vote.
Instructions
Analyze the kept run corpus (read-only). report="historical_agreement" is the default and only report.
historical_agreement scans the consensus panels you kept (persist=true / default_persistence=job) and
reports how often two DISTINCT model lineages reached the same verdict when they co-voted -- an
OBSERVATIONAL signal for your roster choice (e.g. a lineage that never adds a dissent), NOT a vote discount:
agreement is not correctness, so down-weighting agreeing lineages would punish them for being right
together. An empty corpus returns an empty report whose notes explain how to build one.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| report | No | historical_agreement |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| result | Yes |