domain_robots
Fetch the robots.txt policy text for a hostname. Provide a bare domain; the response includes HTTP status, final URL, content up to 256 KiB, and a truncation flag. The HTTPS request is pinned to a validated public IP.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"domain": "<domain>"
},
"name": "domain_robots"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| domain | Yes | Bare public DNS hostname such as github.com; do not include a scheme, path, port, or IP address. |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| data | Yes | The tool result payload (shape varies per tool; see each tool's docs resource). |