Compare two runs
compare_runsRead-onlyIdempotent
Use this to compare the named rate of two runs on the questions and engines both measured. It reports Moved up or Moved down only where the intervals separate, and refuses to compare different method versions.
Input Schema
TableJSON Schema
| Name | Required | Description | Default |
|---|---|---|---|
| run_id | Yes | A run_id from list_runs. | |
| other_run_id | Yes | A run_id from list_runs. |
Output Schema
TableJSON Schema
| Name | Required | Description | Default |
|---|---|---|---|
| left | No | ||
| right | No | ||
| change | Yes | ||
| sample | No | True on every answer about the fictional sample. | |
| comparable | Yes |