"Web scraping and crawling tools" matching MCP servers:

Local, read-only MCP tools for B2B outreach: French telemarketing consent validity (décret 2026-662), GDPR gap report for customer service outsourced outside the EU, cost per kept meeting by lead source, and least-cost capable model selection.

Enables chatting with your site's SEO using real data, including crawling, on-page auditing, Google Search Console performance, Core Web Vitals, and competitor comparison from MCP clients like Claude or Cursor.

Enables SEO auditing and site analysis by crawling websites, identifying issues, and generating reports like sitemaps and markdown exports.

Five general-purpose stdio MCP servers for SEO: access to SERP, Wordstat, Google Search Console, Yandex.Webmaster and Yandex.Metrica straight from Claude Code (or any MCP client). All tools are read-only, output is strict JSON. Not tied to a specific site: defaults (GSC property, Webmaster host, Metrica counter) are configured on the fly.

Provides comprehensive technical SEO auditing tools including page analysis, site crawling, Lighthouse performance testing, and sitemap analysis, with specialized features for job board websites like JobPosting schema validation.

An MCP server for converting App Store Optimization (ASO) data from platforms like App Store Connect into Web SEO data. It enables the creation of synced websites, keyword research, and automated blog content generation based on app store metadata.

Enables comprehensive website SEO analysis including crawling, on-page audits, site structure visualization, and content topic classification with taxonomy mapping.

An MCP server that lets agents run free, keyless lead-leak audits on UK local service businesses — detecting form platforms and their outreach implications, checking whether phone numbers are tappable tel: links, comparing phone numbers across a site and free directories, screening website hygiene, and locating a business's own site. It also bundles these into a single full audit that returns a prioritised list of fixable issues alongside top local competitors.

Read-only static SEO audits and bounded crawling; runs locally with no API keys or telemetry.

Digital business cards, lead capture forms, and service listings - built and managed by AI. 63 tools with live browser editing, stock photos, web scraping, and guided tours.

Pay-per-call web page extraction, on-page SEO audits and text analysis for AI agents. Paid in USDC on Base via x402; no API keys, failed calls are not charged.

Enables scraping of emails, phone numbers, and social profile links from website domains. Supports batch processing of up to 20 domains and can find company websites by keyword/company name.

Enables Claude to query Bing Webmaster Tools performance, crawl, sitemap, backlink, and keyword data in plain language through the official Bing Webmaster API. It is read-only and runs locally using your own API key.

Provides 13 offline SEO and marketing tools to any MCP client, covering ad metric calculators, text and heading analysis, keyword density, and generators for meta tags, Open Graph, hreflang, schema markup, XML sitemaps, and robots.txt. Everything runs locally with no account, API key, or network calls.

A streamlined MCP server for XMP metadata embedding with beautiful formatting and smart filename indicators, enabling metadata embedding, reading, validation, and report generation for lifestyle, product, and orbit schemas.

B2B lead generation MCP server with 20+ lead generation tools - Apollo scraping, Google Maps, email finder, email validator, mobile finder, skip trace, ecommerce store data, and more.

Get access to real-time SEO data, including: keyword insights, backlink data, traffic estimates and more. Allow AI tools and Large Language Models (LLMs) to tap into the real-time SEO Review Tools API with natural language commands.

A TypeScript implementation of a Model Context Protocol server that provides marketing tools based on Open Strategy Partners' methodologies, enabling content creation, optimization, and product positioning through tools like value map generation, meta information creation, and content editing.

Provides comprehensive SEO analysis by crawling websites and generating AI-powered keyword insights, search volume data, and competitor strategies. It delivers detailed reports on keyword clusters and commercial intent to help optimize digital marketing workflows.

Enables domain investors, webmasters, and autonomous agents to perform comprehensive domain audits including brand scoring, TLD tier analysis, and DNS connectivity checks, and to generate strategic brand suffixes and industry compound variations for portfolio expansion.

MCP server for the Wildberries Seller API: 202 tools for prices, promotions, ads, orders, supplies, reviews, finance and analytics. Multi-store, encrypted tokens, web dashboard and self-diagnostics; Docker with SSE or stdio.

A Model Context Protocol server that provides AI assistants with access to FetchSERP API capabilities for SEO analysis, SERP data, web scraping, and keyword research.

Enables access to Semrush Keyword Magic Tool API for SEO keyword research, including keyword overview analysis, finding millions of keyword suggestions, and discovering question-based keywords across different countries and languages.

Provides a comprehensive suite of SEO and web utility tools for domain analysis, keyword tracking, SERP data, and technical site audits. It enables users to perform various tasks such as checking domain age, WHOIS information, and website technology stacks.

Enables AI agents to access fourteen web-data tools for scraping, SEO and site auditing, extraction, validation, enrichment, and screenshots through Apify actors. It runs those tools on the user's own Apify account via an API token.

An MCP server for crawling websites and extracting comprehensive data including images, SEO metadata, security headers, and business intelligence. It features twelve distinct extraction modes to perform detailed audits for e-commerce sites and general web analysis.

Enables searching and scraping the public Facebook Ad Library to extract structured ad data such as advertiser, copy, landing URLs, and CTAs for competitive research, all without an account or API token.

Provides honest A/B test verdicts using interactive cards, with statistical calculations for conversion rates, sample sizes, and Bayesian probability-to-beat.

Enables Claude to operate a local SEO tool through 50 MCP tools for crawling websites, listing and prioritizing issues, checking on-page optimization, measuring Core Web Vitals, researching keywords, viewing ranking data, and generating PDF reports.

Enables crawling a specified site, building an on-page checklist, approving or rejecting it, exporting a markdown bundle, and drafting llms.txt/FAQ content with local SQLite storage and no publishing.