"How to scrape web content" matching MCP servers:

Provides an MCP server with tools for managing a social media content calendar, including adding, listing, and updating content items, plus webhook notifications to team channels.

Enables AI assistants to scrape public LinkedIn, Facebook, and Instagram profile data and perform Google web searches through integrated scraping APIs.

Enables Grok native web search, X (Twitter) search, and Jina Reader web page fetching as read-only MCP tools.

AutomateLab Content Distribution publishes content across DEV.to, Hashnode, GitHub Discussions, Reddit and Bluesky, with browser workflows for LinkedIn, Medium and X. Tracks publishing state and adapts content per platform. Product and documentation: https://automatelab.tech/products/mcp/content-distribution-mcp/

SocialCrawl provides the "best" quality public web data on the internet. Access 65+ real-time social media, e-commerce and public web data from a single API with a single schema.

Enables users to search Reddit by keyword or subreddit, read thread URLs with comments, filter and sort results, and receive flat post and comment rows without needing a Reddit login or API key.

16 Instagram creator tools as an MCP server — Reels/Story/carousel downloaders, engagement audit, hashtag search, Reels hook generator, best-time-to-post and content calendar. Wraps instapdown.com public API — no auth required.

Analyzes public Instagram post URLs, returning captions and photos as image content for multimodal models like Claude, without requiring paid vision APIs.

Enables AI assistants to access HackerNews content through structured search, front page retrieval, latest posts monitoring, detailed item fetching with comment trees, and user profile viewing via the Algolia API.

Provides AI agents with structured short-form content mechanics including hooks, script structures, retention strategies, and CTAs, along with auditing tools to avoid common posting failures.

Official MCP server for twitterapi.io — Twitter/X data access (search tweets, users, followers, replies, trends) via Claude Desktop, Cursor, VS Code Copilot, or any MCP-compatible client. 12 read-only tools, stdio transport.

Enables AI agents and developers to search, retrieve, and analyze HackerNews content including advanced post search, front page access, full comment trees, and user profile lookups through the Model Context Protocol.

Scrape and analyze replies from any public Threads post right from your AI coding agent.

An MCP server for WriteFreely that enables AI agents to publish and manage content on WriteFreely instances (including self-hosted instances and Write.as).

An MCP server that enables AI assistants to access and interact with Reddit content through features like user analysis, post retrieval, subreddit statistics, and authenticated posting capabilities.

Gives Claude access to your Skool community, enabling reading and writing posts, comments, members, classroom content, and DMs using your own login.

Enables agents to publish videos and image notes to Douyin behind a two-step confirmation gate, and to read through search, video details, user profiles, own profile, and share-link parsing using the same login session. Publish actions are executed by the social-auto-upload CLI while reads go directly to Douyin's web API.

Enables AI models to search, fetch, and read Reddit content with resilient rate-limit handling and smart comment filtering, including zero-config fallback to alternative sources.

Provides AI agents with unified access to 21 social media platforms and 105 endpoints for retrieving profiles, posts, comments, search results, trending content, and analytics without per-platform authentication.

A local MCP server that enables managing WeChat Official Account content through the logged-in web session, including reading published articles and analytics, uploading images, and creating drafts after explicit confirmation.