generate_robots_txt
Generate a robots.txt file with allow/disallow rules and an optional sitemap.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| allow | No | ||
| sitemap | No | ||
| disallow | No |
Generate a robots.txt file with allow/disallow rules and an optional sitemap.
| Name | Required | Description | Default |
|---|---|---|---|
| allow | No | ||
| sitemap | No | ||
| disallow | No |
Changes observed during successful MCP inspections.
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description carries full behavioral burden. It does not say whether the file is written to disk or returned as text, whether it overwrites an existing robots.txt, whether permission or a target domain is required, or what the output looks like.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
A single tight sentence with the core action front-loaded. Nothing is wasted, though its brevity is partly the cause of the gaps elsewhere rather than a virtue earned.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
With no annotations, no output schema, and 0% schema description coverage, this tool needs the description to explain behavior and parameter formats. It names the fields but omits output form, side effects, and required context, leaving an agent under-informed for a file-generating tool.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 0%, so the description must compensate. It does marginally by naming the three concepts (allow, disallow, sitemap), but adds no format detail — e.g., that allow/disallow are arrays of path strings or that sitemap is a URL — leaving semantics largely to the bare schema types.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description states a specific verb (Generate) and resource (robots.txt file) plus its contents (allow/disallow rules, optional sitemap). The resource is distinct enough from siblings like generate_sitemap and generate_hreflang, though no explicit sibling differentiation is offered.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
There is no guidance on when to use this tool, when not to, or how it relates to the sibling generate_sitemap tool (which is directly relevant given the sitemap parameter). Only the phrase 'optional sitemap' hints at configuration, not usage context.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
Add one secure layer between your agents and this server.