verify_corpus
Run an abuse-case corpus against an ASC policy to measure critical false-ALLOW counts, benign false-BLOCK rates, and per-scenario outcomes.
Instructions
Verify/run the abuse-case corpus against an ASC policy.
Runs all scenario JSON files in the corpus directory and returns metrics including critical false-ALLOW count, benign false-BLOCK rate, and per-scenario results.
Args: policy_path: Path to the ASC policy YAML file corpus_dir: Directory containing scenario JSON files output_results: If True, return full per-scenario results (may be large)
Returns: Mapping with passed (bool), metrics, and optionally scenarios list
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"policy_path": "<policy_path>",
"corpus_dir": "<corpus_dir>"
},
"name": "verify_corpus"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| corpus_dir | Yes | ||
| policy_path | Yes | ||
| output_results | No |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||