seo_generate_robots
Generate an AI-friendly robots.txt for any site from its base URL. Allows major AI crawlers (GPTBot, ClaudeBot, PerplexityBot, Google-Extended) to improve AI search visibility.
Instructions
Generate an AI-friendly robots.txt that allows all major AI crawlers (GPTBot, ClaudeBot, PerplexityBot, Google-Extended, etc.)
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| siteUrl | Yes | Base URL of the site (e.g., https://example.com) |