"How to scrape websites and retrieve information" matching MCP servers:

Enables AI agents to extract clean, structured content from any web page via a pay-per-call API or with a Forge key.

MCP server that lets AI agents scrape web pages as clean markdown for a micro-payment in USDC, using the x402 protocol on Base network. No API keys or signup required.

Enables AI models to fetch real web pages while automatically bypassing anti-bot protections, login walls, and JS rendering, then returns clean, token-efficient article content.

Enables agents to run Google searches across web, images, videos, news, books, shopping, scholar, patents, and AI Mode without an API key, using a cookie-bootstrapped HTTP fast path with a headless browser fallback, proxy rotation, and adaptive cooldowns. Every response reports an explicit status (ok, blocked, rate_limited, empty, error) so results are never fabricated.

A comprehensive web scraping server that transforms web content into clean, agent-ready Markdown with automatic citations and efficient caching. It features a robust suite of tools for metadata extraction, sentiment analysis, SEO auditing, and security scanning while strictly adhering to robots.txt policies.

Enables converting any URL or website into clean, LLM-ready Markdown, supporting single-page scraping and full-site crawling for AI agents.

An MCP server for scraping and retrieving CNBC news content.

Enables web search via Serper API with advanced search operators and webpage scraping capabilities to extract content in plain text or markdown format.

MCP server that fetches remote or local HTML resources and converts them to Markdown, enabling AI clients to summarize or process web content.

An MCP server that automates converting diverse content sources like WeChat articles, YouTube videos, and various document formats into AI-generated outputs such as podcasts and slide decks via Google NotebookLM. It integrates specialized tools for web scraping, OCR, and file transformation to facilitate seamless content generation through natural language.

An authless Cloudflare Workers server that provides tools to scrape, analyze, and answer questions about websites using Cloudflare's Browser Rendering and AI capabilities.

Enables converting webpages into structured JSON using CSS-selector schemas, with anti-bot handling and support for protected pages.

Enables converting any webpage to clean LLM-ready markdown, with extraction, article, and news modes, using a real browser with anti-bot handling.

Fetches a URL and returns the main content as clean Markdown, using plain HTTP when possible and headless Chromium for JavaScript-rendered or bot-protected pages.

MCP server that converts web page URLs to Markdown via the Zyla API.

Enables crawling websites, including JavaScript-rendered pages, and returns extracted page content as JSON with structured error reporting.

Enables converting a public release-note URL into ordered upgrade tasks with source excerpts, anchors, confidence, and uncertainty, without executing release text or project code.

Enables users to retrieve and structure shipment tracking information from DB Schenker's website using natural language queries.

Enables AI agents to fetch one or many web pages concurrently and receive clean, LLM-ready Markdown with navigation, ads and boilerplate stripped away, plus extracted metadata such as title, description, author, Open Graph tags and canonical URL. It runs locally over stdio with no API key or account, requiring only a single command.

Lets an MCP client read allowlisted pages from the LiveSwapFace website, retrieve its official links, and estimate credits for a planned browser session using rates fetched at call time. It is read-only and never performs face swaps, signs in, uploads media, or touches a private API.

Fetches website content and converts it to Markdown format with AI-powered content cleanup, ad removal, and full OpenAPI/Swagger specification support for easy processing by AI assistants.

Exposes a dynamically registered tool for each public social data endpoint, letting MCP clients like Claude, Cursor, and VS Code pull profiles, posts, comments, transcripts, and search results as clean typed JSON from nine platforms. Tool descriptions surface credit costs and returned fields upfront, with failed calls refunded, bounded results, and readable errors that never auto-retry.

Converts X (Twitter) posts into JSON, PDF, PNG, Markdown, or Slack/Discord messages using public endpoints, no API key or login required.

Enables AI coding agents to audit websites for PHP runtime vulnerabilities, compile a live Zero-PHP Next.js App Router replacement preview from a WordPress/PHP site, and retrieve remediation guidance.

Enables agents to crawl URLs and retrieve page content as fixed-shape structured JSON, including title, markdown, links, word count, and error status.

An MCP server for AI-agent web scraping that enforces robots.txt compliance and requires user confirmation of scrape plans, packaging scraped data with provenance evidence.

Self-hosted MCP toolkit providing web search, Wikipedia, and arXiv access without mandatory API keys, delivered as a Docker Compose bundle.

Enables resolving the likely employer behind Gmail, Outlook, iCloud, Yahoo, and other free-mail signups by checking public Gravatar profiles, signed GitHub commits, and LinkedIn results. It returns the person’s name, employer, employer domain, confidence score, and evidence URLs.

Give it a product and a country and it searches Google for manufacturers, wholesalers, and distributors, reads each candidate company's own website, and returns only the ones whose pages back up the claim, with quoted evidence, the domain, and a confidence score. Directories, marketplaces, and social networks are filtered out, and a free summary row reports how many sites were found and checked when nothing qualifies.

Complete Vinted MCP and CLI Server