Enables AI assistants to check a single web page for broken links, trace redirect chains hop by hop, and detect mixed content through a remote Streamable HTTP tool.
Enables AI assistants to list known AI crawlers such as GPTBot and ClaudeBot, generate and validate robots.txt rules, and check a live site's existing crawler directives. It runs as a remote Streamable HTTP MCP server exposing tools for crawler listing, rule generation, validation, and site checking.