score_humanity
Evaluate how AI-like a text reads by scoring it against open AI detectors. Receive an aggregate probability and verdict to assess human-likeness.
Instructions
Score how AI-like the text reads to one or more open detectors.
Wraps the local detector adapters in benchmark/. The default
detector list is ["roberta-base"] (the canonical academic
baseline; see research/01_detector_landscape.md). Other adapters
such as "fast_detect_gpt" and "binoculars" are added as the
benchmark package matures.
Aggregate probability is the arithmetic mean of detector scores that
returned successfully. If every detector failed, aggregate is
-1.0 and the verdict is "unknown".
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| text | Yes | The input prose to score. | |
| detectors | No | Names of detector adapters to run. Defaults to ``["roberta-base"]`` if not given or empty. |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| verdict | Yes | One of "human", "uncertain", "ai", or "unknown". | |
| text_length | Yes | ||
| detector_scores | Yes | ||
| aggregate_probability_ai | Yes | Mean of successful detector probability_ai scores. Equals -1.0 if no detector returned a score. |