Check a page, AI-crawler access, llms.txt and backlinks of a site. Free, read-only.
Scored across 4 tools
backlinks targets the domain-level link graph; check_ai_crawler_access targets robots.txt and live crawler access; check_llms_txt targets the llms.txt file; check_page targets on-page SEO/AI-readiness. The purposes are clearly separated, and the descriptions make the boundaries explicit.
Three tools use the check_<object> pattern (check_ai_crawler_access, check_llms_txt, check_page), while backlinks is a bare noun. This is a minor inconsistency but still readable and predictable.
Four tools is a tight, well-scoped surface for a specialized site-audit server. Each tool covers a distinct audit dimension: links, crawler access, llms.txt, and page quality.
The surface covers key AI/search readiness checks: backlink data, crawler access, llms.txt, and page-level audit. Minor gaps remain, such as site-wide crawling or sitemap checks, but core workflows are covered.
How many other domains link to a domain, and the strongest referrers, from the Common Crawl domain web graph. Covers domains with 100 or more referring domains under .eu, EU and UK country domains, plus the 5,000 most-linked sites; says plainly when a domain is not in the data.
Inputs: domain (required).
Read a site's robots.txt and test the server for GPTBot, OAI-SearchBot, ChatGPT-User, PerplexityBot, ClaudeBot, Google-Extended, Bingbot and Googlebot. Returns, per crawler, whether robots.txt allows it and whether the server answers it, so you can see who is blocked and by what.
Inputs: site (required).
Fetch /llms.txt of a site and report whether it exists, whether its links work, and whether /llms-full.txt exists. When there is none, the full report holds a draft built from the site's own pages.
Inputs: site (required).
Fetch one public web page as CitedBot (robots.txt respected) and return what is wrong with it for AI answers and search: title, description, headings, structured data, canonical, language, links and more. Each finding has why it matters and the exact fix. Deterministic checks only; says so when the page cannot be fetched.
Inputs: url (required).
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
Loading tool schema changelog…
Free AI crawler, schema, llms.txt and answer-readiness checks for public web pages. No API key.
Check which AI crawlers a site allows and see pages the way AI crawlers do. Free, read-only.
Free check whether a website is technically open to AI assistants (AI crawlers, llms.txt, JSON-LD).
Free SEO, AI visibility (AI crawlers, llms.txt, JSON-LD) and security-header checks for any URL.
Add one secure layer between your agents and this server.