Skip to main content
Glama

Web & domain tools

by si.fourzerotwo
OverviewDiscussionsAdmin

SEO Tools: robots.txt check

seo__robots-check
Read-onlyIdempotent

Whether a crawler (Googlebot, GPTBot, ClaudeBot…) may fetch a URL, the rule that decided it, and declared sitemaps. A few free samples a day, then $0.002 USDC per call via x402.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
urlYesURL
user_agentNoCrawler user agent

Output Schema

TableJSON Schema
NameRequiredDescriptionDefault

No arguments

Schema Changelog

Changes observed during successful MCP inspections.

  1. First observed

TDQS

Score is being calculated.

All Web & domain tools toolsInspect
Try in Browser
One endpoint for every MCP toolRayrun runs every MCP server behind one URL and holds the credentials. Each call is decided per client, tool, and argument, then recorded.ray.runAd

Glama MCP Gateway

Add one secure layer between your agents and this server.

Resources