robots-txt-checker
Server Details
Checks if a URL path is allowed by robots.txt. x402 payment required (Base mainnet USDC).
- Status
- Healthy
- Uptime
- 100.0% over the last 24 hours
- Last Tested
- Transport
- Streamable HTTP · MCP 2025-11-25
- URL
- ChatGPT
- –
- Claude
- –
TDQS
Scored across 1 tool
With only one tool exposed, there is no possibility of confusing it with another operation. The purpose is singular and clearly stated.
There is only one tool name, so there is no mixed convention or irregular verb pattern to flag. The name is descriptive and matches the server's purpose.
A single tool is minimal but appropriate for a narrowly scoped robots.txt checker. It is slightly below the typical 3-15 range, but the server is not over-scoped.
The server's entire purpose is to check a URL path against robots.txt, and the single tool fully covers that action. No additional operations are needed for this domain.
Available Tools
1 toolrobots_txt_checkerrobots_txt_checkerAInspect
Checks if a URL path is allowed by robots.txt. x402 payment required (Base mainnet USDC).
Inputs: checks (required), payment.
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
Loading tool schema changelog…
Related MCP Connectors
Whether an AI agent may fetch a URL, on what terms, and at what price. Free, no key, no signup.
robots.txt tester (RFC 9309), AI crawler access (GPTBot, ClaudeBot...) and sitemap check.
HTTP, TLS and DNS audit of one public URL, paid per call in USDC over x402 on Base.
Check which AI crawlers a site allows and see pages the way AI crawlers do. Free, read-only.
Related MCP Servers
- AlicenseNot gradedqualityBmaintenanceEnables per-request paid AI analysis of public URLs, condition verification, and AI consultation via x402 micropayments on Base, with no account or subscription.ISC
- AlicenseNot gradedqualityCmaintenanceEnables MCP clients to perform paid claim checks, scouting, and deep dives against public URLs via x402 payments in USDC on Base, with a configurable per-call spend cap.MIT
- AlicenseNot gradedqualityCmaintenanceEnables AI agents to autonomously pay for metered web APIs on a per-call basis, settling x402 v2 USDC micropayments via EIP-3009 authorization on Base Sepolia without human involvement. Spending is bounded by configurable per-call caps and host restrictions, and exposes tools to fetch paywalled URLs and inspect the agent wallet's address and balance.MIT
- AlicenseAqualityCmaintenanceEnables AI assistants to call pay-per-call x402 endpoints on Base mainnet using the caller's own USDC wallet, covering single and batch token risk checks, the latest BTC radar signal, project info, and a free health probe. Payments are EIP-3009 signed with a configurable per-call spending cap, and any quote with an unexpected payee, network, or asset is refused before payment.5MIT
Glama MCP Gateway
Add one secure layer between your agents and this server.