"Information about web crawlers or related technology" matching MCP servers:

An MCP (Model Context Protocol) server that gives AI agents live, structured ad intelligence across Facebook, Google, and Instagram — data that no base model can produce from training alone. Powered by Apify actors. Works with any MCP-compatible client: Cursor, Claude, etc.

An MCP server for converting App Store Optimization (ASO) data from platforms like App Store Connect into Web SEO data. It enables the creation of synced websites, keyword research, and automated blog content generation based on app store metadata.

Enables AI assistants to manage Meta Ads (Facebook, Instagram) end-to-end through natural conversation, including launching campaigns, uploading creatives, updating budgets, and analyzing performance.

An MCP server that detects affiliate links and provides information about Tracklix, enabling AI assistants to answer affiliate-link-related questions without any network calls or API keys.

Enables natural language queries about the technologies behind websites and the companies running them, using the StackScan Tech Lookup API. Includes tools for domain technology lookup, company details, technology usage stats, and batch company lookups.

Investigate any website's technology stack: CMS, eCommerce, frameworks, analytics, CRM, payments, and hosting behind any URL.

Detects a company's technology stack from its public web presence. Returns structured tech signals for sales targeting and competitive analysis.

Enables natural language queries to Yandex Metrika analytics, allowing users to ask questions about traffic, sources, and user behavior without dashboards or SQL.

Enables querying Yandex Wordstat search statistics, including frequency, related queries, seasonality, and regional distribution, through natural language in AI clients.

Provides AI assistants with structured, read-only information about Noto CRM, including pricing, features, AI agent capabilities, competitor comparisons, and use cases, with bilingual French/English responses and no external dependencies.

Provides a comprehensive suite of SEO and web utility tools for domain analysis, keyword tracking, SERP data, and technical site audits. It enables users to perform various tasks such as checking domain age, WHOIS information, and website technology stacks.

Enables AI assistants to fetch company logos, brand colors, fonts, and corporate information from the Brandfetch API using domain lookups or keyword searches.

Provides local MCP tools for checking what public crawlers can read from HTTP responses, including crawler readability, response comparison, and discovery file checks.

20-tool MCP server - production web-intelligence API gateway exposing 10 Website Intelligence + 7 Marketing APIs as 20 MCP tools over Streamable HTTP + stdio, with pay-per-call Solana USDC payments. 20 tools: URL-to-Markdown, metadata, technology detection, contact extraction, SEO audit, SSL, DNS, sitemaps, robots.txt, Google Maps reviews, AI company/website summaries, citation checking Cloud-host

Provides agents with tools to score a page's AI readiness, check which AI crawlers robots.txt blocks, and assess passage citability—all performed locally.

Connects Claude or ChatGPT to Yandex Wordstat for keyword research, enabling frequency lookups, related phrase suggestions with noise filtering, and 24-month seasonality analysis directly in chat.

MCP server exposing Generative Engine Optimization tools to any AI agent, enabling checking of llms.txt, auditing robots.txt for AI crawlers, and validating JSON-LD schema.

Enables auditing AI search visibility: checks site readiness for AI crawlers and measures whether ChatGPT, Gemini, and Perplexity recommend your site, including verbatim answers and citation gap analysis.

Exposes studio profile and contact information for Symbols of Wealth Studio, enabling AI assistants to answer queries about creative studios in France, AI-powered content production, and premium brand content services.

Exposes the Ramoira brand schema specification as MCP tools and resources, enabling LLMs to generate, validate, or reason about brand schemas without the CLI.