seo_robots_test
Check whether a URL is allowed or blocked by robots.txt rules for a specific user agent. Specify the URL and user agent to get access status.
Instructions
Test if a specific URL is allowed or blocked by robots.txt rules for a given user agent.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | URL to test | |
| userAgent | No | * |