Check whether a site's robots.txt allows PriceMovedBot
robots_checkFetch the robots.txt of the given public http(s) URL's site (at most 500 KiB, 5 s timeout, redirects followed) and report whether PriceMovedBot is allowed to fetch that URL under RFC 9309 rules: verdict allowed, disallowed, or skipped (robots.txt unreachable, 5xx/429, or too complex: PriceMoved would not fetch). Does not fetch the page itself. Domain names only (no IP addresses or ports). About 10 checks per minute and 30 per hour per network; results cached 10 minutes. Same engine as GET /api/robots-check.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"url": "<url>"
},
"name": "robots_check"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | Public http(s) URL of the page, e.g. https://example.com/pricing |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | ||
| note | Yes | ||
| cached | Yes | ||
| allowed | Yes | ||
| verdict | Yes | ||
| version | Yes | ||
| checked_at | Yes | ||
| robots_url | Yes | ||
| user_agent | No |