Robots.txt Generator
robots_txt_generatorGenerate a robots.txt file from per-user-agent allow/disallow rules and sitemap URLs to control search engine crawling.
Instructions
Generate a robots.txt from per-user-agent allow/disallow rules and sitemap URLs.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| rules | Yes | ||
| sitemaps | No |