AI crawler robots.txt audit
ai_crawler_auditRead-only
Check a public site robots.txt for AI crawler allow/deny verdicts.
Input Schema
TableJSON Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | ||
| path | No |
ai_crawler_auditCheck a public site robots.txt for AI crawler allow/deny verdicts.
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | ||
| path | No |
Changes observed during successful MCP inspections.
Score is being calculated.
Add one secure layer between your agents and this server.