"How to scrape web content" matching MCP servers:

MCP server exposing content contract validators (SEO.md, PRODUCTHUNT.md, LINKEDIN.md) as tools so AI agents can verify generated content against concrete rules without maintaining linters. It provides linting and JSON-LD export tools with config and content passed as parameters, not file paths.

Provides AI agents with structured short-form content mechanics including hooks, script structures, retention strategies, and CTAs, along with auditing tools to avoid common posting failures.

Detects a company's technology stack from its public web presence. Returns structured tech signals for sales targeting and competitive analysis.

An MCP server for converting App Store Optimization (ASO) data from platforms like App Store Connect into Web SEO data. It enables the creation of synced websites, keyword research, and automated blog content generation based on app store metadata.

SERP-based content scoring and optimization with 7 SEO categories.

Enables editorial content QA over the Model Context Protocol with four local tools that analyze readability, AI-sounding language, SEO on-page factors, and produce full reports where every finding includes an actionable fix.

Competitive intelligence platform with 24 tools. Monitor competitor pricing, content, positioning, tech stacks, and AI visibility — track how ChatGPT, Claude, and Gemini rank your brand.

Provides content agents with structured search over editorial guidelines, visual templates, and past post outcomes, enabling auditable proposals that cite rule IDs.

An MCP server providing 8 content creation tools for case studies, newsletters, webinars, and more, based on the CRAFT Framework.

An MCP server that lets agents run free, keyless lead-leak audits on UK local service businesses — detecting form platforms and their outreach implications, checking whether phone numbers are tappable tel: links, comparing phone numbers across a site and free directories, screening website hygiene, and locating a business's own site. It also bundles these into a single full audit that returns a prioritised list of fixable issues alongside top local competitors.

MCP server for the OpenGraph.io API -- extract OG metadata, capture screenshots, scrape pages, query sites with AI, and generate branded images with iterative refinement.

Maps any source asset (e.g., long video, podcast, blog) to all platform formats (TikTok, Reels, Shorts, etc.) with per-platform adaptation rules, enabling a 'film-once-cut-many' content workflow.

Multi-platform content distribution — draft posts, repurpose content, generate carousels, schedule, analyze performance, create threads. 7 MCP tools.

Enables competitor content analysis by scraping pages, extracting keywords, identifying content gaps, comparing headings, scoring readability and quality, checking SERP features, and clustering competitors.

Find out how AI assistants and search engines talk about your brand. Ask how often ChatGPT, Perplexity and Google's AI answers mention you, where you rank, how positive those mentions are, which sites they cite, and how you compare with competitors. Your assistant can also set up and adjust the monitoring for you, showing a preview and asking before anything that deletes data or uses up your plan.

Pay-per-call web page extraction, on-page SEO audits and text analysis for AI agents. Paid in USDC on Base via x402; no API keys, failed calls are not charged.

Enables local discovery of research topics, interviews users to uncover their unique perspective, and turns insights into content ideas and short-form Reel scripts.

MCP server for publishing posts and retrieving metrics on social platforms like Telegram, with planned support for YouTube and Instagram.

Full-stack AI marketing toolkit with 41 MCP tools: SEO article generation in 55 languages, trend scouting (X/Reddit), competitor analysis, content gap detection, social media adaptations for 9 platforms, AI avatar video shorts, content ingestion (YouTube/PDF/web), lead magnets, and automated content autopilot.

Advanced content gap analysis using Query Decomposition and Keyword Fan-Out (Google's patented methodology). Tells you exactly what user queries your content covers - and what it misses. Built on academic research because I needed to understand how AI search engines actually evaluate content.