Skip to main content
Glama

CueScout

by io.github.telman03
OverviewDiscussionsAdmin

Check whether AI crawlers are blocked in robots.txt

check_ai_crawler_access
Read-only

Use this when someone asks why their site never shows up in AI answers, or whether GPTBot, ClaudeBot, PerplexityBot or Google-Extended can crawl it. Reads the site's robots.txt and reports which of those crawlers are blocked, including by a blanket rule the owner may not have meant. One fetch, no AI.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
urlYesThe site or page URL to check. A bare domain like example.com is fine.

Schema Changelog

Changes observed during successful MCP inspections.

  1. First observed

TDQS

Score is being calculated.

All CueScout toolsInspect
Try in Browser
One endpoint for every MCP toolRayrun runs every MCP server behind one URL and holds the credentials. Each call is decided per client, tool, and argument, then recorded.ray.runAd

Glama MCP Gateway

Add one secure layer between your agents and this server.

Resources