Analyze a domain's robots.txt to determine which AI crawlers (like GPTBot, CCBot) are allowed or blocked. Provides per-crawler status.
MIT
Structured iGaming reference: slot specs & RTP variants, providers, regulators, news and jobs.
Honeydew AI Documentation MCP — semantic search and ripgrep-grade filesystem queries over Honeydew AI docs and OpenAPI specs, for AI coding agents.