security_robots_txt_generator
Generate RFC 9309 compliant robots.txt files with custom user-agent rules, crawl-delay, sitemaps, and presets for WordPress, Drupal, and other CMS platforms.
Instructions
Menu ID: robots_txt_generator. robots.txt Generator. Generate an RFC 9309 compliant robots.txt with user-agent groups, allow/disallow rules, crawl-delay, sitemap references, and curated presets for WordPress, Drupal, Joomla, Magento, Shopify, Ghost, and Next.js. Use describe_tool with tool_id "robots_txt_generator" for full page guidance.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| operation | Yes | ||
| input | Yes |