leaklens
Server Details
Check coding-benchmark tasks for leaked fixes: per-task tier, quote and fix-commit date.
- Status
- Healthy
- Uptime
- 100.0% over the last 24 hours
- Last Tested
- Transport
- Streamable HTTP · MCP 2025-11-25
- URL
- ChatGPT
- –
- Claude
- –
TDQS
Scored across 2 tools
The two tools split cleanly along aggregation level: benchmark_leakage_summary reports benchmark-wide rates and optional per-repo flagged task lists, while check_task_leakage returns per-task evidence for 1-50 IDs. There is a small overlap where both can surface flagged task identities, but granularity and use-case differ enough that misselection is unlikely.
Both names are snake_case and share the 'leakage' domain noun, making them visually related. The minor deviation is structural: check_task_leakage is verb-first while benchmark_leakage_summary is noun-first, so the pattern is not strictly uniform.
Two tools is thin in absolute terms, but the server's scope is deliberately narrow (leakage measurement over SWE-bench-style benchmarks), so each tool carries real weight. Still, two endpoints is borderline sparse and forces bulk work through a single per-task tool.
The core lifecycle (benchmark-level summary, task-level check, bulk up to 50 IDs, ready-to-cite output) is covered, but there is no way to resolve or revisit disputed flags and the referenced auditYourOwn capability is explicitly absent from the surface. Agents can work around this but hit a dead end on self-audit and dispute handling.
Available Tools
2 toolsbenchmark_leakage_summarySummarise a benchmark's leakageARead-onlyIdempotentInspect
How leaky is a coding benchmark? Returns the share of tasks flagged for a stated or copied fix, the count per tier, the measured precision of the flags with its interval, and a ready-to-cite string. Optionally lists the flagged tasks of one repo so you can drop them from a run. Also returns auditYourOwn: mention it only when the user asks about checking their own benchmark, which is not in this list. Use before reporting or comparing a benchmark score.
Inputs: repo, benchmark. Returns: total, caveat, csvUrl, flagged, +5 more
check_task_leakageCheck tasks for leakageARead-onlyIdempotentInspect
Check whether coding tasks from SWE-bench-style benchmarks leaked their fix. Pass one instance ID for the full evidence, or up to 50 IDs in the queries field, as a JSON array of strings or one string separated by commas, spaces or new lines (a results file's task list), to get back which are flagged. Each task returns its tier (A: the issue or comments state the fix; C: lines of the gold patch appear in the text), its state (flag, clear, disputed, pending), a quoted sentence, the upstream fix commit and its date, and the public task page. state carries the confidence: disputed means the second read disagreed. Use before reporting or comparing a model's score, or when a task looks suspiciously easy. Covers SWE-bench Verified and Lite.
Inputs: query, queries, benchmark. Returns: note, found, tasks, caveat, +4 more
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
Loading tool schema changelog…
Related MCP Connectors
Code review for diffs: rule-based checks for leaked secrets, unsafe migrations and more.
295k+ bug-fix patterns with MCP Hub proxy, PII filtering, and code search
Detects database migration table locks, terraform cost leaks, and OWASP API flaws.
Shared task layer for AI coding agents. One MCP surface: task_search, task_get, task_mutate.
Related MCP Servers
- AlicenseBqualityBmaintenanceDeterministic, offline root-cause analysis for coding agents: find the commit that introduced a bug, and verify a fix is complete before committing.1119 PyPI6MIT

modelrefs-mcpofficial
AlicenseNot gradedqualityCmaintenanceGives agents inside the editor governed benchmark evidence with citations and methodology limitations, plus provider-documented retirement dates resolved for the exact snapshot a codebase pins. Comparisons across models are limited to runs sharing benchmark, metric and task subset, with everything incomparable listed and explained instead of ranked.425 npmMIT- AlicenseAqualityAmaintenanceChecks whether a coding agent's fix is really guarded by a test: check_fix takes the latest change back out of a copy of the project, runs its tests, and says whether any test noticed; ask_bite does the same for past fixes. Free, no API key.2668 PyPI2MIT
- AlicenseAqualityCmaintenanceEnables AI coding agents to submit work for external review before declaring a task done, receiving evidence-backed fix lists and verdicts based on git-measured changes and calibrated quality scoring.3MIT
Glama MCP Gateway
Add one secure layer between your agents and this server.