Inter-rater agreement (kappa)
revisia_interrater_agreementUse this when the user wants agreement statistics between reviewers, e.g. for dual screening or data extraction: Cohen's kappa (unweighted, linear or quadratic weights) for two raters, Fleiss' kappa for three or more, with Gwet's AC1/AC2, PABAK, 95% confidence interval, p-value, the Landis and Koch band, a sentence for the methods section and a figure. Accepts a k×k contingency table or one row of labels per item (one column per rater). Deterministic and checked against R (irr, psych, irrCAC); do not compute kappa yourself when this tool is available. It does not resolve disagreements or judge which rater is right. No account needed.
Tool call template
This tool declares no required parameters. Add optional parameters from the input schema as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {},
"name": "revisia_interrater_agreement"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| lang | No | Output language (default en). | en |
| table | No | Two raters: k×k counts, rater A rows, rater B columns. Give this or ratings. | |
| ratings | No | One row per item, one label per rater, e.g. [['Include','Exclude']]. 2 raters: Cohen; 3+: Fleiss. Give this or table. | |
| weighting | No | Ordered categories, Cohen, 3+ categories. Default none. | none |
| categories | No | Category names in table order. Only with table. |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| n | Yes | ||
| p | Yes | ||
| z | Yes | ||
| se | Yes | ||
| alt | Yes | ||
| band | Yes | ||
| gwet | Yes | ||
| lang | Yes | ||
| kappa | Yes | ||
| pabak | Yes | ||
| ci_low | Yes | ||
| method | Yes | ||
| raters | Yes | ||
| ci_high | Yes | ||
| formula | Yes | ||
| citation | Yes | ||
| headline | Yes | ||
| sentence | Yes | ||
| warnings | Yes | ||
| ci_method | Yes | ||
| kappa_max | Yes | ||
| watermark | Yes | True when the figure or document carries the revisia mark (no verified account). | |
| weighting | Yes | ||
| band_label | Yes | ||
| bias_index | Yes | ||
| categories | Yes | ||
| next_actions | Yes | ||
| per_category | Yes | ||
| open_in_revisia | Yes | ||
| prevalence_index | Yes | ||
| expected_agreement | Yes | ||
| observed_agreement | Yes |