Robots Inspect
util_robots_inspectInspect robots.txt rules and sitemap declarations for any domain to determine crawl permissions and indexing paths.
Instructions
Read robots.txt rules and sitemap declarations before crawling or indexing a domain. Delx Agent Utilities are separate from the free witness protocol and may expose x402 utility pricing.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"url": "<url>"
},
"name": "util_robots_inspect"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | Domain or URL to inspect | |
| timeout | No | Timeout in seconds (1-15) |