Leeroopedia MCP Server
OfficialProvides OpenAI Codex with expert-level ML and AI knowledge from Leeroopedia, enhancing its ability to handle ML/AI coding tasks.
Click on "Deploy Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@Leeroopedia MCP Serverbest practices for fine-tuning LLMs"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
Leeroopedia MCP Server
$20 free credit on sign-up : that's plenty of searches, plans, and diagnoses. Skip the guesswork on your next fine-tuning run or inference deployment. No credit card required. Get your API key →
What is Leeroopedia?
Your ML & AI Knowledge Wiki. Learnt by AI, built by AI, for AI.
Expert-level knowledge across the full ML & AI stack, from fine-tuning and distributed training, to inference serving and GPU kernel optimization, to building agents and RAG pipelines. 1000+ frameworks and libraries, all in one place.
This MCP server turns your AI coding agent (Claude Code, Cursor, OpenAI Codex, ...) into an ML/AI expert engineer.
Browse the full knowledge base at leeroopedia.com.
Want to go end-to-end?
Leeroopedia gives your agent the knowledge. Kapso gives it the ability to act on it : research, experiment, and deploy. Together: a complete ML/AI engineer agent.
Related MCP server: Aindreyway MCP Codex Keeper
Benchmarks
We measured the effect of Leeroopedia MCP on real ML tasks built by Claude Code.
ML Inference Optimization: Write CUDA/Triton kernels for 10 KernelBench problems. 2.11x geomean speedup vs 1.80x (+17%), with/without Leeroopedia MCP. → results
LLM Post-Training: End-to-end SFT + DPO + LoRA merge + vLLM serving + IFEval on 8×A100. 21.3 vs 18.5 IFEval strict-prompt accuracy, 34.6 vs 30.9 strict-instruction accuracy, 272.7 vs 231.6 throughput. → results
Self-Evolving RAG: Build a RAG service that automatically improves itself over multiple rounds. 45.16 vs 40.51 Precision@5, 40.32 vs 35.29 Recall@5, in 52 vs 62 min wall time. → results
Customer Support Agent: Multi-agent triage system classifying 200 tickets into 27 intents. 98 vs 83 benchmark performance, 11s vs 61s per query. → results
Quick Start
1. Get Your API Key
Go to app.leeroopedia.com
Create an account or log in
Navigate to Dashboard > API Keys
Copy your API key (format:
kpsk_...)
2. Use the hosted server (no installation needed)
Just paste this URL into any MCP client that supports remote servers:
https://mcp.leeroopedia.com/mcp?token=kpsk_your_key_hereSee the connect guides for all IDEs, running locally, and troubleshooting.
3. Configure Claude Code
Remote (no install):
claude mcp add --transport http leeroopedia "https://mcp.leeroopedia.com/mcp?token=kpsk_your_key_here"Local (via uvx):
Add to your ~/.claude.json or project .mcp.json:
{
"mcpServers": {
"leeroopedia": {
"command": "uvx",
"args": ["leeroopedia-mcp"],
"env": {
"LEEROOPEDIA_API_KEY": "kpsk_your_key_here"
}
}
}
}Getting
spawn uvx ENOENT? Your IDE can't finduvxin its PATH. Runwhich uvx(orwhere uvxon Windows) in your terminal to get the full path, then use it in your config:"command": "/home/username/.local/bin/uvx"Common locations:
~/.local/bin/uvx(Linux),~/.local/bin/uvx(macOS curl install),/opt/homebrew/bin/uvx(macOS Homebrew).
4. Configure Cursor
Remote (no install):
Add to your Cursor settings (.cursor/mcp.json):
{
"mcpServers": {
"leeroopedia": {
"url": "https://mcp.leeroopedia.com/mcp?token=kpsk_your_key_here"
}
}
}Local (via uvx):
{
"mcpServers": {
"leeroopedia": {
"command": "uvx",
"args": ["leeroopedia-mcp"],
"env": {
"LEEROOPEDIA_API_KEY": "kpsk_your_key_here"
}
}
}
}Getting
spawn uvx ENOENT? See the tip in Configure Claude Code above.
5. Configure OpenAI Codex
Run the CLI command:
codex mcp add leeroopedia --env LEEROOPEDIA_API_KEY=kpsk_your_key_here -- uvx leeroopedia-mcpOr add to your ~/.codex/config.toml:
[mcp_servers.leeroopedia]
command = "uvx"
args = ["leeroopedia-mcp"]
[mcp_servers.leeroopedia.env]
LEEROOPEDIA_API_KEY = "kpsk_your_key_here"Getting
spawn uvx ENOENT? See the tip in Configure Claude Code above.
6. Optional: Add the Agent Skill File
For coding agents that support project-level instruction files (Claude Code, Cursor, Codex), you can add an optional skill file that teaches the agent when and how to pick the right Leeroopedia tool for each situation. This improves tool selection, encourages parallel searches, and provides canonical workflows for common tasks like "How do I implement X?" or "My run crashed".
Download SKILL.md and place it in the appropriate location for your agent:
Agent | Where to place the file | Format |
Claude Code | Project root or | Markdown |
Cursor |
| Markdown |
Codex | Project root | Markdown |
This step is optional. The MCP tools work without the skill file. The skill file just helps the agent make better tool choices automatically.
Documentation
docs.leeroopedia.com — full setup guides, environment variables, troubleshooting, connect guides for every IDE, and detailed tool usage.
Contributing
We welcome contributions! Please see our Contributing Guide for details on how to get started.
This project follows our Code of Conduct.
License
This project is licensed under the MIT License.
Available Tools
8 toolsbuild_planA
Get a structured implementation plan based on knowledge base documentation.
Covers a wide range of ML/AI frameworks, libraries, and tools with architecture docs, implementation patterns, configuration references, and troubleshooting guides.
Returns an actionable plan with numbered steps, specs, and validation criteria — all based on how the framework actually works.
Use this tool when you:
Are about to implement something and want the correct sequence of steps
Need a plan informed by real framework documentation, not just general knowledge
Want validation criteria to verify your implementation against
Returns: overview, key specs, numbered steps, and validation criteria.
| Name | Required | Description | Default |
|---|---|---|---|
| goal | Yes | What you want to accomplish (e.g., 'Implement YAML config parser for distributed RL experiment planning') | |
| constraints | No | Optional constraints or requirements (e.g., 'Must validate GPU memory, support multi-node configs') |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations exist, so the description must carry the behavioral load. It usefully discloses the return content (overview, key specs, numbered steps, validation criteria) and that output is grounded in real framework docs. However, it omits any caveats on plan generation (e.g., does it require a knowledge base to be populated, latency, or that plans may be generic for undocumented frameworks).
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Front-loaded purpose sentence followed by scope and a bulleted use-case list; the trailing 'Returns:' line is slightly redundant with the earlier 'Returns an actionable plan' sentence but is cheap and skimmable. Overall tight and well-structured.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
With no output schema, the description correctly compensates by enumerating return fields (overview, specs, steps, validation criteria). For a simple 2-parameter generation tool this is close to complete, though the relationship to review_plan in a plan workflow is left implicit.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, so both 'goal' and 'constraints' are already documented with inline examples. The description adds no syntax, format, or interaction detail beyond what the schema supplies. Baseline 3 applies.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
States a specific verb and resource: 'Get a structured implementation plan based on knowledge base documentation.' It clarifies the grounding source (KB docs across ML/AI frameworks) and the output shape. It does not explicitly distinguish itself from the sibling review_plan, which an agent might confuse with plan generation.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
Three explicit 'Use this tool when' bullets give clear triggering conditions (about to implement, want doc-informed sequence, want validation criteria). No when-not conditions or named alternatives (e.g., review_plan for critiquing an existing plan) are provided, so it stops short of full routing guidance.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
diagnose_failureA
Diagnose errors, failures, or unexpected behavior using knowledge base documentation.
Checks your symptoms and logs against known failure patterns, common misconfigurations, and documented environment issues — finding root causes faster.
Use this tool when you need:
Root cause analysis of errors, crashes, or unexpected behavior
Debugging configuration issues or dependency problems
Understanding why a framework behaves differently than expected
Returns: diagnosis, fix steps, and prevention advice.
| Name | Required | Description | Default |
|---|---|---|---|
| logs | Yes | Relevant log output, error messages, or stack traces | |
| symptoms | Yes | Description of the failure symptoms or unexpected behavior |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description carries the full behavioral burden. It does disclose the operating model (knowledge-base pattern matching) and the shape of the result (diagnosis, fix steps, prevention advice), which implies a non-destructive read. However, it never explicitly states read-only/non-mutating behavior, whether logs are persisted, or any auth or rate-limit constraints.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Front-loaded with the core action, then a short bullet list of use cases and a returns line. Mostly tight, though the three usage bullets overlap substantially (root cause analysis vs debugging vs understanding behavior), so it is efficient but not maximally compressed.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a two-parameter, no-output-schema tool, the description usefully explains what is returned (diagnosis, fix steps, prevention advice), compensating for the absent output schema. The remaining gap is the unaddressed safety/read-only profile in the absence of annotations.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, with both required parameters ('symptoms', 'logs') clearly documented in the schema itself. The description only loosely restates them ('checks your symptoms and logs') without adding format, size, or content guidance, so the baseline of 3 applies.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description opens with a specific verb+resource ('Diagnose errors, failures, or unexpected behavior using knowledge base documentation') and clarifies the mechanism (matching symptoms/logs against known failure patterns). It does not, however, differentiate itself from the sibling 'search_knowledge', which also operates over a knowledge base — an agent could reasonably confuse the two.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
It gives explicit 'Use this tool when you need' contexts: root cause analysis, debugging config/dependency problems, explaining unexpected framework behavior. That is clear when-to-use guidance, but it names no exclusions and does not route the agent away from 'search_knowledge' or toward 'verify_code_math' for adjacent tasks.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get_pageA
Retrieve the full content of a specific knowledge base page by its exact ID.
Other tools return [PageID] citations in their responses. If you need more detail from a cited page, call this tool with that page ID to get the full content.
Use this tool when you:
See a [PageID] citation in a response and want the full page content
Need deeper detail than what was included in a synthesized answer
Want to read a specific page directly without searching
Returns the page formatted as markdown, or an error if the page ID is not found.
| Name | Required | Description | Default |
|---|---|---|---|
| page_id | Yes | Exact page ID to retrieve (e.g., 'Workflow/QLoRA_Finetuning', 'Principle/LoRA_Rank_Selection') |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description carries the full behavioral burden, and it does disclose the return format (markdown) and the failure mode (error if the page ID is not found). It does not mention permission requirements, size limits, or what to do if the ID is unknown (e.g., fall back to search), so it is strong but not exhaustive.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Front-loaded with the core purpose in the first sentence, followed by workflow context and a bullet list. The bullets restate some of the prose above them, which is mildly redundant but still scannable and short overall.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a single-parameter lookup tool with no output schema, the description covers purpose, how to source the ID, the trigger conditions, the return format, and the error case. Nothing an agent needs to call it correctly is missing.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100% and the schema already gives example IDs, so baseline is 3. The description adds meaning beyond the schema by stressing the ID must be 'exact' and by explaining the primary way to obtain it — from [PageID] citations in other tools' responses.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
States a specific verb (retrieve) and resource (knowledge base page) with its key constraint: lookup by exact ID. It is clearly distinguishable from sibling search_knowledge because it explicitly says it reads a specific page 'without searching'.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
Provides an explicit when-to-use list with three concrete triggers, including the citation-follow-up workflow ([PageID] seen in another tool's output). This tells the agent both when to reach for this tool and what upstream signal selects it.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
propose_hypothesisA
Propose ranked approaches or solutions based on knowledge base documentation.
When you're unsure how to proceed, this tool suggests alternative approaches ranked by fit — all backed by documented framework patterns and best practices.
Use this tool when you need:
Ideas for how to implement or architect something
Alternative approaches ranked by fit for your use case
Suggestions backed by documented framework patterns and best practices
Returns: ranked hypotheses with rationale and suggested next steps.
| Name | Required | Description | Default |
|---|---|---|---|
| current_status | Yes | Where the project stands now and what you're trying to decide | |
| recent_experiments | No | Optional description of what you've tried so far and what happened |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description carries the full burden. It discloses the output shape ('ranked hypotheses with rationale and suggested next steps') and that results are grounded in documentation, but says nothing about side-effect profile (read-only/advisory), determinism, latency, or prerequisites for the knowledge base. Adequate but leaves real gaps for a no-annotation tool.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Purpose is front-loaded, but the phrase 'backed by documented framework patterns and best practices' appears twice and the bullet list largely restates the opening paragraph. The redundant content costs space without adding new selection signal.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
With no output schema, the description appropriately describes return values (ranked hypotheses, rationale, next steps), and both simple string parameters are covered. For a two-parameter advisory tool this is nearly complete, missing only explicit read-only/advisory confirmation.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, so both parameters are fully documented in the schema, giving a baseline of 3. The description adds only loose framing ('ranked by fit for your use case') and no format or syntax guidance for current_status or recent_experiments beyond what the schema states.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
States a specific verb+resource: 'Propose ranked approaches or solutions based on knowledge base documentation,' which distinguishes it from retrieval siblings like search_knowledge or get_page. However, it never names or contrasts a specific sibling (e.g., build_plan, diagnose_failure), so the differentiation is inferable rather than explicit.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
Provides clear context with a 'Use this tool when you need' block covering ideation and ranked alternatives. It stops short of exclusions or alternatives (no 'use build_plan instead when...'), so the agent must infer boundaries against the planning/diagnosis siblings.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
query_hyperparameter_priorsA
Query documented configuration values, recommended ranges, and tuning heuristics.
Look up recommended parameter values, default settings, and tuning strategies for frameworks and libraries — based on documented best practices.
Use this tool when you need:
Default or recommended values for framework configuration parameters
Recommended ranges and tuning strategies for any setting
Context-specific suggestions (hardware, model size, task type, scale)
Returns: suggestion table with ranges and KB-grounded justification.
| Name | Required | Description | Default |
|---|---|---|---|
| query | Yes | Configuration or parameter question (e.g., 'recommended GPU memory settings for vLLM serving', 'default batch size for DeepSpeed ZeRO-3') |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description carries the full disclosure burden. It does describe the return shape ('suggestion table with ranges and KB-grounded justification'), which is valuable given there is no output schema. However, it says nothing about grounding limits, freshness, permissions, or whether results are cached — behavioral traits beyond a bare lookup are undisclosed.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Front-loaded with the core purpose, then a scannable 'Use this tool when' list and a 'Returns:' line. Slightly redundant between the opening sentence and the 'Look up recommended parameter values...' sentence, but every part is short and earned.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a single-parameter read tool with no output schema and no annotations, the description covers purpose, usage triggers, and return format, which is close to sufficient. The main residual gap is not distinguishing itself from 'search_knowledge', leaving an ambiguous choice between two documentation-lookup siblings.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100% and the schema already supplies free-form query examples, so 3 is the baseline. The description adds meaning above baseline by enumerating what dimensions a good query should encode (hardware, model size, task type, scale), which helps the agent formulate inputs the tool can actually serve.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
Specific verb ('Query'/'Look up') plus a concrete resource (documented configuration values, recommended ranges, tuning heuristics for frameworks and libraries). An agent can tell it is a knowledge lookup, not an action tool. It does not, however, differentiate itself from the sibling 'search_knowledge', which appears to overlap in scope.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The explicit 'Use this tool when you need:' block gives three clear triggering conditions (defaults, ranges/tuning strategies, context-specific suggestions), which is strong positive guidance. It lacks any when-not condition or named alternative, so it falls short of a 5 that would route the agent away from 'search_knowledge' when appropriate.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
review_planA
Review your implementation plan against knowledge base documentation before coding.
Pass your proposed approach and the KB will check it against documented best practices, known pitfalls, and real framework behavior — catching mistakes before you write code.
Use this tool when you:
Have a plan and want to validate it before executing
Want to catch incorrect assumptions about how a framework works
Need to know what pitfalls or edge cases to watch out for
Returns: approvals (what looks good), risks, and improvement suggestions.
| Name | Required | Description | Default |
|---|---|---|---|
| goal | Yes | The intended goal of the plan | |
| proposal | Yes | The plan or approach to review |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description carries the full burden. It does disclose the return shape ('approvals, risks, and improvement suggestions') and that evaluation is against KB documentation, but says nothing about whether the tool is read-only, what happens when the KB lacks coverage, cost/latency, or failure modes.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Front-loaded one-line purpose, then scannable bullets, then a 'Returns:' line. Every element supports selection or invocation; only mild redundancy between the opening sentence and the bullet list.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
With no output schema and no annotations, the description covers purpose, usage triggers, and the shape of the response, which is enough for an agent to call it correctly. Missing only edge-case behavior (KB misses, read-only guarantee, latency).
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, so baseline is 3. The description reinforces 'proposal' ('Pass your proposed approach') but never mentions the required 'goal' parameter, so it adds essentially nothing beyond the schema.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
States a specific verb and resource ('Review your implementation plan against knowledge base documentation') plus scope ('before coding'). The framing of validating an existing plan versus producing one implicitly separates it from build_plan, verify_code_math, and search_knowledge.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
Explicit 'Use this tool when you:' block with three concrete conditions (validate a plan before executing, catch wrong framework assumptions, learn pitfalls). Clear positive guidance, but it never names a sibling alternative or an exclusion case (e.g., 'use build_plan if you have no plan yet').
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
search_knowledgeA
Search the knowledge base for framework documentation, API references, config formats, and best practices.
Covers a wide range of ML/AI frameworks, libraries, and tools with architecture docs, implementation patterns, configuration references, and troubleshooting guides.
Use this tool when you need to:
Understand how a framework, library, or API works before implementing
Look up config formats, data structures, or expected behavior
Learn about architecture, design patterns, or conventions of a project
Get verified information instead of guessing about framework internals
IMPORTANT: Use this tool BEFORE you start coding whenever the task involves a framework or library. It is much faster and more accurate than guessing. Call this tool multiple times in parallel with different queries to search from multiple angles at once.
Returns a synthesized answer with [PageID] citations.
| Name | Required | Description | Default |
|---|---|---|---|
| query | Yes | What you want to find out (e.g., 'How does device_mapping work in ROLL?', 'What is the MNN backend selection config format?') | |
| context | No | Optional context about what you're building (e.g., 'I am implementing a CLI tool that parses YAML configs') |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description carries the full burden and does disclose real behavior: it returns a synthesized answer with [PageID] citations, and it explicitly supports parallel multi-query invocation. It omits rate limits, auth expectations, and any indication of result size or paging, so not fully transparent.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Front-loaded purpose sentence followed by scoped coverage and a clean bulleted usage list. Some promotional filler ('much faster and more accurate than guessing') could be trimmed, but the structure is easy to scan.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a two-parameter search tool with no output schema and no annotations, the description supplies the return format (synthesized answer with citations) and usage timing, which is what an agent needs. Gaps are minor: no pagination or result-scope expectations.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100% and the schema already gives examples for both query and context, so the baseline is 3. The description reinforces the multi-angle query idea but adds no syntax, format, or constraint detail beyond the schema.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
States a specific verb+resource ('Search the knowledge base') and enumerates the covered content domains (framework docs, API references, config formats, best practices). It is clearly distinct from siblings like query_hyperparameter_priors or get_page by domain, though it never names an alternative explicitly.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
Provides a concrete when-to-use list ('Understand how a framework works', 'Look up config formats', 'Get verified information instead of guessing') plus timing guidance ('BEFORE you start coding') and a parallelism tip. No explicit when-not or named alternatives, so it stops short of a 5.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
verify_code_mathA
Verify code correctness against knowledge base documentation and reference implementations.
Checks your code against documented behavior, reference implementations, and API contracts — catching errors before they become bugs.
Use this tool when you need:
Verification that code correctly implements a concept, algorithm, or API contract
Detection of logic errors, off-by-one mistakes, or wrong assumptions
Comparison against reference implementations or documented behavior
Returns: verdict (Pass/Fail), analysis of discrepancies.
| Name | Required | Description | Default |
|---|---|---|---|
| code_snippet | Yes | The code to verify | |
| concept_name | Yes | The concept, algorithm, or API being implemented (e.g., 'GPU memory allocation for vLLM', 'YAML config validation for ROLL') |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description carries the full behavioral burden. It does disclose the return shape (verdict Pass/Fail plus discrepancy analysis), which is useful. However it says nothing about permissions, whether the check is read-only, latency/cost, or how the knowledge base lookup behaves — gaps for a tool with zero annotation coverage.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Purpose is front-loaded in the first sentence, followed by a scannable bullet list of use cases and a short Returns line. The only filler is the mildly promotional clause 'catching errors before they become bugs.' Structure is otherwise tight and well ordered.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
With no output schema, the description correctly compensates by stating the return value (Pass/Fail verdict plus discrepancy analysis). For a two-parameter verification tool this covers what an agent needs to invoke it and interpret results. The absence of any behavioral/permission context keeps it from being fully complete.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, so the schema already documents both parameters, including concrete examples for concept_name. The description adds no further syntax, format, or sizing guidance for code_snippet or concept_name. Baseline 3 applies when the schema does the heavy lifting.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description opens with a specific verb+resource: verifying code correctness against knowledge base documentation and reference implementations. That is clearly distinct from sibling tools like search_knowledge or diagnose_failure. It stops short of explicitly naming or excluding any sibling, so it does not reach the top tier.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The 'Use this tool when you need:' block gives three concrete triggering scenarios (verifying concept/algorithm/API implementation, detecting logic errors, comparing to reference implementations). This is clear context for selection. It offers no explicit when-not-to-use guidance and names no alternative tool (e.g. diagnose_failure) for overlapping cases.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
8 tool updates
v0.1.9- First observed
build_plan - First observed
diagnose_failure - First observed
get_page - First observed
propose_hypothesis - First observed
query_hyperparameter_priors - First observed
review_plan - First observed
search_knowledge - First observed
verify_code_math
TDQS
Scored across 8 tools
Most tools have clearly distinct purposes: get_page vs search_knowledge vs query_hyperparameter_priors separate retrieval modes, and build_plan/review_plan/verify_code_math/diagnose_failure cover distinct lifecycle stages. However, propose_hypothesis overlaps noticeably with build_plan (both suggest approaches/implementation steps), and query_hyperparameter_priors can be confused with search_knowledge for config lookups.
All eight tools use consistent snake_case verb_noun patterns (query_hyperparameter_priors, search_knowledge, build_plan, review_plan, verify_code_math, diagnose_failure, propose_hypothesis). get_page is the only noun-first name but is a common idiom and still clearly readable.
Eight tools is well within the ideal 3-15 range and each maps to a distinct KB-backed capability (search, retrieve, plan, review, verify, diagnose, propose, config lookup). No tool feels redundant or padded.
The surface covers the full dev lifecycle from retrieval through planning, review, verification, and diagnosis, which matches the stated KB-assistant purpose well. A minor gap is the absence of any discovery/index tool to browse or enumerate available page IDs, leaving get_page dependent on citations from other tools.
Maintenance
Related MCP Connectors
MCP server for building and testing AI agents with multi-model experimentation and insights.
MCP server for AI agent profiles and smart notes. 60+ coding prompt packs with expert personas.
MCP server for AI agents to plan, verify, and deploy Cloudflare-native apps.
Official MCP server for Agentwork — delegate tasks to AI agents with human-in-the-loop
Related MCP Servers
AlicenseAqualityAmaintenanceMCP server that gives AI coding agents direct access to evaluation tools.23Apache 2.0- AlicenseAqualityDmaintenanceAn intelligent MCP server that serves as a guardian of development knowledge, providing AI assistants with curated access to latest documentation and best practices.485 npm1MIT
- AlicenseAqualityCmaintenanceLocal-first MCP server that gives any AI coding agent per-project memory, workflow intelligence, and always-on, lossless token & context optimization.3763 npm6MIT
- AlicenseBqualityCmaintenanceMCP server that gives AI coding assistants persistent memory, structural code graph analysis, and safe multi-agent coordination, enabling them to answer architectural questions, track decisions across sessions, and coordinate safely in multi-agent workflows.394MIT