Test a reply against checks
modelfinder_check_outputCheck a single model response against deterministic rules to design eval checks and routing guards before spending on a full run.
Instructions
Run deterministic checks on one model reply. Use it to design eval checks and routing guards before spending money on a run.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| text | Yes | The model reply to test. | |
| checks | Yes | Deterministic checks; all must pass. Types: contains, not_contains, exact (value, ignore_case?), regex (pattern), json_keys (keys), max_chars (value). Example: [{"type": "json_keys", "keys": ["category"]}, {"type": "contains", "value": "refund"}] | |
| response_format | No | markdown (default) for a readable summary, json for the full machine-readable result. | markdown |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| passed | Yes | ||
| failures | Yes | ||
| checks_run | Yes |