"Information about web crawlers or scraping techniques" matching MCP servers:

An MCP (Model Context Protocol) server that gives AI agents live, structured ad intelligence across Facebook, Google, and Instagram — data that no base model can produce from training alone. Powered by Apify actors. Works with any MCP-compatible client: Cursor, Claude, etc.

An MCP server for converting App Store Optimization (ASO) data from platforms like App Store Connect into Web SEO data. It enables the creation of synced websites, keyword research, and automated blog content generation based on app store metadata.

Enables AI assistants to manage Meta Ads (Facebook, Instagram) end-to-end through natural conversation, including launching campaigns, uploading creatives, updating budgets, and analyzing performance.

An MCP server that detects affiliate links and provides information about Tracklix, enabling AI assistants to answer affiliate-link-related questions without any network calls or API keys.

Enables natural language queries to Yandex Metrika analytics, allowing users to ask questions about traffic, sources, and user behavior without dashboards or SQL.

Provides AI assistants with structured, read-only information about Noto CRM, including pricing, features, AI agent capabilities, competitor comparisons, and use cases, with bilingual French/English responses and no external dependencies.

A local-first MCP server for auditing, drafting, and planning updates to your personal LinkedIn profile safely, without automation or scraping.

Digital business cards, lead capture forms, and service listings - built and managed by AI. 63 tools with live browser editing, stock photos, web scraping, and guided tours.

A Model Context Protocol server that provides AI assistants with access to FetchSERP API capabilities for SEO analysis, SERP data, web scraping, and keyword research.

Enables AI assistants to fetch company logos, brand colors, fonts, and corporate information from the Brandfetch API using domain lookups or keyword searches.

Enables searching and scraping the public Facebook Ad Library to extract structured ad data such as advertiser, copy, landing URLs, and CTAs for competitive research, all without an account or API token.

Provides local MCP tools for checking what public crawlers can read from HTTP responses, including crawler readability, response comparison, and discovery file checks.

Provides agents with tools to score a page's AI readiness, check which AI crawlers robots.txt blocks, and assess passage citability—all performed locally.

MCP server exposing Generative Engine Optimization tools to any AI agent, enabling checking of llms.txt, auditing robots.txt for AI crawlers, and validating JSON-LD schema.

Enables auditing AI search visibility: checks site readiness for AI crawlers and measures whether ChatGPT, Gemini, and Perplexity recommend your site, including verbatim answers and citation gap analysis.

Enables lead generation and web scraping through 16 MCP tools, allowing AI clients like Claude, Cursor, and Windsurf to perform scraping tasks via natural language.

Exposes studio profile and contact information for Symbols of Wealth Studio, enabling AI assistants to answer queries about creative studios in France, AI-powered content production, and premium brand content services.

Exposes the Ramoira brand schema specification as MCP tools and resources, enabling LLMs to generate, validate, or reason about brand schemas without the CLI.

MCP server exposing WIBI's API v2 as tools, supporting OAuth 2.1 for production (Claude web/desktop) and stdio for local dev, enabling natural-language queries about campaigns, products, clients, reports, broadcasts, and subscriptions with per-commerce isolation and admin scope switching.

Enables natural language queries about the technologies behind websites and the companies running them, using the StackScan Tech Lookup API. Includes tools for domain technology lookup, company details, technology usage stats, and batch company lookups.