site_policies
Fetch robots.txt, llms.txt, llms-full.txt, ai.txt and /.well-known/security.txt for up to 5 sites. Parses AI-crawler rules (GPTBot, ClaudeBot, Google-Extended, CCBot, PerplexityBot, …) and whether a given path is allowed, lists sitemap URLs, and parses security.txt contact/expiry. Price: 0.005 USDC per call (x402, Base).
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"urls": "<urls>"
},
"name": "site_policies"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| path | No | Default path to test against robots.txt | |
| urls | Yes |