A
licenseNot graded
qualityC
maintenanceEnables users to check whether GPTBot, ClaudeBot, PerplexityBot, Googlebot and other AI/search crawlers can reach a specified page, distinguishing robots.txt blocks from server or firewall refusals.
MIT
Siteiz
by com.siteiz
Server Details
Check which AI crawlers a site allows and see pages the way AI crawlers do. Free, read-only.
Ownership verified
- Status
- Healthy
- Uptime
- 100.0% over the last 24 hours
- Last Tested
- Transport
- Streamable HTTP · MCP 2025-06-18
- URL
- ChatGPT
- –
- Claude
- –
TDQS
A4/5.0
Scored across 8 tools
Disambiguation4/5
Each tool targets a clearly distinct resource or operation: robots.txt access, crawler explanation, page rendering, published reports, account sites, GSC metrics, URL inspection, and ranked fixes. The three crawler-related tools could be momentarily confused, but their descriptions make the boundaries clear (access rules vs. explanation vs. actual rendered content).
Naming Consistency5/5
All eight tools use a consistent snake_case verb_noun pattern (check_, explain_, get_, inspect_, list_, view_). The longer names like view_page_as_ai_crawler still follow the verb-led convention without deviating from the pattern.
Tool Count5/5
Eight tools is well-scoped for an AI visibility and search diagnostics server. Each tool covers a distinct part of the workflow, with no redundant or filler tools.
Completeness4/5
The surface covers crawler access checks, page rendering, GSC performance, ranked fixes, URL index inspection, site listing, and published visibility reports. Minor gaps exist—no tool to trigger a fresh scan or generate llms.txt—but typical audit workflows are covered end to end.
Available Tools
8 toolscheck_ai_crawlersCheck AI crawler accessARead-onlyIdempotentInspect
Reads a website's robots.txt and reports, for 11 AI crawlers (GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-SearchBot, PerplexityBot, Google-Extended, Applebot-Extended, Meta-ExternalAgent, CCBot, Bytespider), whether each may reach the given page. Separates AI search crawlers (decide if the site appears in ChatGPT, Claude and Perplexity answers) from training crawlers. Also reports llms.txt and declared sitemaps.
Inputs: url (required). Returns: url, agents, llmsTxt, sitemaps, +3 more
explain_ai_crawlerExplain an AI crawlerARead-onlyIdempotentInspect
Explains what an AI crawler user agent does (operator, purpose, and what blocking it in robots.txt changes). Pass a name such as GPTBot or OAI-SearchBot, or omit it to list all crawlers Siteiz tracks.
Inputs: name. Returns: crawlers
get_ai_visibility_reportGet a published AI visibility reportARead-onlyIdempotentInspect
Returns a published, dated Siteiz AI visibility report for a well-known company's homepage (score, grade, pillar scores, top issues). Omit the company to list all published reports.
Inputs: company. Returns: Either `reports` (a list, when no company matched) or the single report fields.
get_search_performanceGet Google Search Console performanceARead-onlyIdempotentInspect
Clicks, impressions, CTR and average position from your connected Google Search Console, by query, page, device or country, for the last N days (data trails by about 3 days). Needs a Siteiz Pro API key (Authorization: Bearer header).
Inputs: days, site, limit, dimension. Returns: object
get_traffic_ranked_fixesGet fixes ranked by Google trafficARead-onlyIdempotentInspect
Joins your Search Console impressions with your latest Siteiz scan: scanned pages ranked by real Google impressions, each with its AI readability score and open fixes, plus pages with no impressions (possibly not indexed) and high-traffic pages the scan missed. Use it to decide what to fix first. Needs a Siteiz Pro API key (Authorization: Bearer header).
Inputs: site. Returns: object
inspect_url_indexInspect a URL's Google index statusARead-onlyIdempotentInspect
Runs Google Search Console URL inspection on one page of your site: index verdict, coverage, robots.txt, last crawl, user and Google canonical, plus the page's Siteiz AI readability score. Needs a Siteiz Pro API key (Authorization: Bearer header).
Inputs: url (required). Returns: object
list_my_sitesList my Siteiz sitesARead-onlyIdempotentInspect
Lists the sites in your Siteiz account with their latest AI readability score, open fixes and linked Search Console property. Needs a Siteiz Pro API key (Authorization: Bearer header).
Inputs: no named parameters. Returns: object
view_page_as_ai_crawlerView a page as an AI crawlerARead-onlyIdempotentInspect
Fetches one page the way most AI crawlers do (plain HTTP, no JavaScript) and reports what they actually receive: title, meta description, canonical, H1, heading count, structured data types, visible word count, token reading cost, and a text preview. Use it to check whether content is visible to AI without JavaScript.
Inputs: url (required). Returns: h1, bytes, title, words, +9 more
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
Loading tool schema changelog…
Related MCP Connectors
See what GPTBot, ClaudeBot and other crawlers get from a site: robots.txt checks and AI scans.
Check a page, AI-crawler access, llms.txt and backlinks of a site. Free, read-only.
Free check whether a website is technically open to AI assistants (AI crawlers, llms.txt, JSON-LD).
Checks if GPTBot, ClaudeBot, PerplexityBot, Googlebot and 9 more AI crawlers can reach a page.
Related MCP Servers
- AlicenseNot gradedqualityCmaintenanceEnables checking whether a page or domain can be found and cited by AI assistants and search engines, covering page-level fixes, AI-crawler access via robots.txt, llms.txt validity, and backlink strength. It is free, read-only, and requires no account.MIT
QueryRev AI Readinessofficial
AlicenseAqualityCmaintenanceChecks a site for AI crawlers: which of 11 AI crawlers its robots.txt lets in, whether its llms.txt follows llmstxt.org, and what its home page says without scripts. Findings with evidence; no scores, no model calls, no telemetry.552 npmMIT- AlicenseAqualityDmaintenanceAnalyze and generate robots.txt files with AI crawler awareness. Fetch any site's robots.txt, detect which AI bots (GPTBot, ClaudeBot, PerplexityBot, Google-Extended) are blocked or allowed, and generate optimized robots.txt with toggle controls for 20+ AI crawlers.51MIT
Try in Browser
One endpoint for every MCP toolRayrun runs every MCP server behind one URL and holds the credentials. Each call is decided per client, tool, and argument, then recorded.ray.runAd
Glama MCP Gateway
Add one secure layer between your agents and this server.