benchmark_project
Quantify token savings by comparing raw file reads to trace-mcp compact responses across symbol lookup, file exploration, search, and impact analysis scenarios. Returns scenario breakdown with savings percentages.
Instructions
Synthetic token efficiency benchmark: compare raw file reads vs trace-mcp compact responses across symbol lookup, file exploration, search, and impact analysis scenarios. Read-only, no side effects. Use to quantify token savings. Returns JSON: { scenarios: [{ name, raw_tokens, compact_tokens, savings_pct }], summary }.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| queries | No | Queries per scenario (default 10) | |
| seed | No | Random seed for reproducibility (default 42) | |
| format | No | Output format (default: json) |