Skip to main content
Glama

Robots.txt generator

hopi_robots_txt_generator
Read-onlyIdempotent

Build a robots.txt file from allow and disallow rules grouped by user agent, with an optional sitemap line. You can pass a preset ('allow' all, 'block' all, 'wordpress') or your own rules array. Source: https://hopi.co.uk/robots-txt-generator/

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
rulesNoCustom rules, each an object with agent, directive and path
presetNoUse a ready-made rule set instead of custom rules
sitemapNoOptional sitemap URL for the Sitemap line

Output Schema

TableJSON Schema
NameRequiredDescriptionDefault
summaryYes
robotsTxtYes
source_urlYesThe tool's page on hopi.co.uk (cite or open to check the figure)

Schema Changelog

Changes observed during successful MCP inspections.

  1. Changed1 schema field changed
    • addedOutput schema / required
      Added value: +[
      +  "robotsTxt",
      +  "source_url",
      +  "summary"
      +]
  2. First observed

TDQS

A4.2/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true, idempotentHint=true, and destructiveHint=false, covering the side-effect profile. The description adds useful behavioral detail beyond the schema: rules are grouped by user agent, presets map to ready-made rule sets, and an optional sitemap line can be included.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two tight sentences front-load the core behavior, then cover presets, custom rules, and sitemap. The source link is a minor addition and does not bloat the description. No wasted words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple, side-effect-free generator with full schema coverage and an output schema, the description is largely complete. The only small gap is that it does not state what happens when neither a preset nor rules are provided, but this is a minor edge case for this tool.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the baseline is 3. The description adds mild value by clarifying preset meanings ('allow' all, 'block' all) and mentioning the custom rules array, but it does not substantially expand on parameter details already present in the schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool builds a robots.txt file from allow/disallow rules grouped by user agent, with an optional sitemap line. It also distinguishes two input modes (preset or custom rules), making the tool's purpose unmistakable among many unrelated sibling generators.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

It gives clear usage context by explaining that you can pass a preset ('allow', 'block', 'wordpress') or a custom rules array, and that sitemap is optional. It does not explicitly discuss when not to use the tool or compare it to alternatives, but no similar sibling exists, so the context is adequate.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.

Resources