Check a pasted robots.txt for AI bot access
doorman_check_robots_txtUse when the user pastes the text of a robots.txt (or you have drafted one) and asks which AI bots it lets in or blocks, or whether a change does what they want. Parses it the way crawlers do (groups, wildcards, longest-match) and reports each of 22 named AI bots as let in, kept out or partly blocked, with notes and a suggested choice. Pure parsing, no network. Example: {"robots_txt": "User-agent: GPTBot\nDisallow: /"}.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| robots_txt | Yes | The full robots.txt text (up to 512 KB). Empty means no robots.txt. |