benchmark_project
Quantify token savings by comparing raw file reads to trace-mcp compact responses across symbol lookup, file exploration, search, and impact analysis scenarios. Returns JSON with scenarios and summary.
Instructions
Synthetic token efficiency benchmark: compare raw file reads vs trace-mcp compact responses across symbol lookup, file exploration, search, and impact analysis scenarios. Read-only, no side effects. Use to quantify token savings. Returns JSON: { scenarios: [{ name, raw_tokens, compact_tokens, savings_pct }], summary }.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| seed | No | Random seed for reproducibility (default 42) | |
| format | No | Output format (default: json) | |
| queries | No | Queries per scenario (default 10) |