Check a pasted robots.txt
check_robotsMatch a robots.txt file the caller pastes against Botcard's AI crawler tokens, using RFC 9309. Each row is allow or disallow plus that token's vendor stance. This tool does not fetch any website. Do not send url, host, target, website, robots_url, or fetch.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| ids | No | Card ids to check, such as gptbot. Omit to check every card. | |
| path | No | Path to test, starting with /. Defaults to /. | |
| robots_txt | Yes | The robots.txt file contents. Not a URL. |