Run Hallucination Detection Benchmark
prove_zero_hallucinationRuns a fixed 60-scenario benchmark to measure code hallucination detection and false-positive rates before or after changes, using local repository ground truth and offline execution.
Instructions
Runs a fixed 60-scenario hallucination detection benchmark, distinguishing from 'heal_hallucinated_code' for a single candidate snippet and 'audit_code_quality' for repository findings. Results apply only to the tested cases and do not prove absence of other hallucinations.
Parameters:
workspace_dir(str, optional, default='.'): Target repository root directory containing ground-truth AST symbol definitions.export_docs(bool, optional, default=True): When True, updates docs/ZERO_HALLUCINATION_PROOF.md and docs/zero_hallucination_proof.json.
Behavior:
Mutability: export_docs=True writes benchmark artifacts in docs/ relative to the server working directory; False avoids those writes.
Idempotency: Report timestamps and measured latencies may differ between runs.
100% Offline: Operates entirely locally with zero external network access.
Auth & Rate Limits: Zero authentication or cloud credentials required; completes in <100ms.
Error Handling: Emits clean verification status and confusion matrix.
Usage Guidelines:
When to use: Measure detection and false-positive rates on the bundled scenarios before or after changes.
When NOT to use: Do not use for inspecting a single candidate snippet (use 'heal_hallucinated_code' instead); do not use for secret scans (use 'verify_security_guard' instead).
Returns: Markdown benchmark results with case counts, detection and false-positive rates, and latency.
Tool call template
This tool declares no required parameters. Add optional parameters from the input schema as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {},
"name": "prove_zero_hallucination"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| export_docs | No | Whether to write ZERO_HALLUCINATION_PROOF.md to docs/. | |
| workspace_dir | No | Target repository root directory (default: current directory). | . |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| result | Yes |