benchmark_gate
Prevent quality regressions by running benchmark suite against defined thresholds; returns pass/fail with F1, precision, recall, and detection rate details.
Instructions
Run the benchmark suite and check results against quality thresholds. Returns pass/fail with metric details including F1, precision, recall, and detection rate. Use in CI pipelines to prevent quality regressions.
Tool call template
This tool declares no required parameters. Add optional parameters from the input schema as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {},
"name": "benchmark_gate"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| minF1 | No | Minimum F1 score (0-1, default: 0.6) | |
| minRecall | No | Minimum recall (0-1, default: 0.5) | |
| minPrecision | No | Minimum precision (0-1, default: 0.5) | |
| minDetectionRate | No | Minimum detection rate (0-1, default: 0.5) |