ai_crawler_stats
Aggregate AI-crawler blocking statistics across the top 10,000 websites: percentage of sites with a reachable robots.txt that fully block, partly restrict or explicitly allow each AI bot. Give a bot name for one bot, or omit for the overall table.
Tool call template
This tool declares no required parameters. Add optional parameters from the input schema as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {},
"name": "ai_crawler_stats"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| bot | No | Optional bot name, e.g. 'GPTBot', 'ClaudeBot', 'Google-Extended' (case-insensitive). |