Robots Inspect
util_robots_inspectInspect robots.txt rules and sitemap declarations for any domain to determine crawl permissions and indexing paths.
Instructions
Read robots.txt rules and sitemap declarations before crawling or indexing a domain. Delx Agent Utilities are separate from the free witness protocol and may expose x402 utility pricing.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | Domain or URL to inspect | |
| timeout | No | Timeout in seconds (1-15) |