AI Crawler, robots.txt & llms.txt Audit ($0.01)
ai_crawler_auditLive-fetches a domain's /robots.txt, /llms.txt, /llms-full.txt, /sitemap.xml, and /.well-known/{x402,mcp,agent-card.json} files, returning a per-bot permission matrix (GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, PerplexityBot, Google-Extended, Bingbot, Applebot-Extended, CCBot), AI-crawler readiness score (0-100), and ICE fixes. Use geo_page_audit for HTML/TTFB signals or schema_citation_check for JSON-LD validation.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"url": "<url>"
},
"name": "ai_crawler_audit"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | Public HTTPS/HTTP URL to audit live (e.g. https://example.com). |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| origin | Yes | ||
| llmsTxt | Yes | ||
| summary | Yes | ||
| robotsTxt | Yes | ||
| wellKnown | No | ||
| sitemapXml | No | ||
| iceActionPlan | Yes |