robots.txt generator
robots_txt_generatorBuild a robots.txt: allow or block all, custom disallow paths, AI-crawler blocking, crawl-delay and sitemap. Runs on smart-tools.xyz.
Tool call template
This tool declares no required parameters. Add optional parameters from the input schema as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {},
"name": "robots_txt_generator"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| access | No | allow all, block all, or custom (default allow) | |
| locale | No | Language for the source_url link (default en) | |
| sitemap | No | Sitemap URL (optional) | |
| block_ai | No | Also block common AI crawlers (default false) | |
| disallow | No | Paths to disallow (used when access=custom) | |
| crawl_delay | No | Crawl-delay in seconds (optional) |