benchmark_project
Compare token efficiency between raw file reads and compact responses for symbol lookup, file exploration, search, and impact analysis. Quantify token savings with a JSON report of scenarios and summary.
Instructions
Synthetic token efficiency benchmark: compare raw file reads vs trace-mcp compact responses across symbol lookup, file exploration, search, and impact analysis scenarios. Read-only, no side effects. Use to quantify token savings. Returns JSON: { scenarios: [{ name, raw_tokens, compact_tokens, savings_pct }], summary }.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| queries | No | Queries per scenario (default 10) | |
| seed | No | Random seed for reproducibility (default 42) | |
| format | No | Output format (default: json) |