Skip to main content
Glama

Clawhard Dev Tools

See which AI bots a website lets in

doorman_check_ai_bot_access
Read-onlyIdempotent

Use when the user asks whether their site (or any public site), or a robots.txt they pasted, blocks ChatGPT, Claude, Google AI, Perplexity or other AI crawlers, whether AI can read or train on their content, or why AI search does not mention their site. Fetches the live robots.txt and reports, for 22 named AI bots in four groups (AI training, AI search, assistants, search engines), which are let in, kept out or partly blocked, plus the site's content-signal preference and fixes. Example: {"url": "example.com"} or {"robots_txt": "User-agent: GPTBot\nDisallow: /"}. Pass robots_txt instead of url to check a draft or pasted file without fetching anything. Read-only.

Input Schema

NameRequiredDescriptionDefault
urlNoWebsite address or domain, e.g. nytimes.com. Send this or robots_txt.
robots_txtNorobots.txt text to check instead of fetching a site (a draft or a pasted file, up to 512 KB). Empty means no robots.txt.

Schema Changelog

Changes observed during successful MCP inspections.

  1. First observed

TDQS

Score is being calculated.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.

Resources