Diff two robots.txt by effect
diff_robots_txtCompare two versions of a robots.txt and report only the crawlers whose verdict actually changes at a given path — not the text difference. Answers 'did my edit do what I meant, and did it do anything else', including sitemap additions and whether the parse errors went up or down.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| path | No | Path to compare verdicts at. Defaults to "/". | |
| after | Yes | The new robots.txt. | |
| before | Yes | The old robots.txt. |