"How to scrape websites and retrieve information" matching MCP servers:

Enables AI models to fetch real web pages while automatically bypassing anti-bot protections, login walls, and JS rendering, then returns clean, token-efficient article content.

Enables AI agents to extract clean, structured content from any web page via a pay-per-call API or with a Forge key.

Enables agents to run Google searches across web, images, videos, news, books, shopping, scholar, patents, and AI Mode without an API key, using a cookie-bootstrapped HTTP fast path with a headless browser fallback, proxy rotation, and adaptive cooldowns. Every response reports an explicit status (ok, blocked, rate_limited, empty, error) so results are never fabricated.

A comprehensive web scraping server that transforms web content into clean, agent-ready Markdown with automatic citations and efficient caching. It features a robust suite of tools for metadata extraction, sentiment analysis, SEO auditing, and security scanning while strictly adhering to robots.txt policies.

Enables converting any URL or website into clean, LLM-ready Markdown, supporting single-page scraping and full-site crawling for AI agents.

Enables web search via Serper API with advanced search operators and webpage scraping capabilities to extract content in plain text or markdown format.

Enables users to discover jobs by target titles and countries, rank job descriptions by skill coverage across all imported resumes, generate tailored ATS-ready resumes and cover letters, and fill and submit requested application batches through a signed-in AI host with browser access.

Enables users to record, review, verify, and expose permitted browser workflows as callable MCP tools with typed inputs, isolated Chromium verification, and approval-gated writes.

Enables converting webpages into structured JSON using CSS-selector schemas, with anti-bot handling and support for protected pages.

Enables converting any webpage to clean LLM-ready markdown, with extraction, article, and news modes, using a real browser with anti-bot handling.

Fetches a URL and returns the main content as clean Markdown, using plain HTTP when possible and headless Chromium for JavaScript-rendered or bot-protected pages.

MCP server that converts web page URLs to Markdown via the Zyla API.

Enables crawling websites, including JavaScript-rendered pages, and returns extracted page content as JSON with structured error reporting.

Enables AI agents to fetch one or many web pages concurrently and receive clean, LLM-ready Markdown with navigation, ads and boilerplate stripped away, plus extracted metadata such as title, description, author, Open Graph tags and canonical URL. It runs locally over stdio with no API key or account, requiring only a single command.

Fetches website content and converts it to Markdown format with AI-powered content cleanup, ad removal, and full OpenAPI/Swagger specification support for easy processing by AI assistants.

Converts X (Twitter) posts into JSON, PDF, PNG, Markdown, or Slack/Discord messages using public endpoints, no API key or login required.

It enables AI agents to call a small set of reliable, permission-aware tools generated from an existing website through the Model Context Protocol, without rebuilding the site.

MCP server that fetches remote or local HTML resources and converts them to Markdown, enabling AI clients to summarize or process web content.

Enables agents to crawl URLs and retrieve page content as fixed-shape structured JSON, including title, markdown, links, word count, and error status.

Enables AI agents to convert HTML content into clean Markdown, stripping scripts and styles while preserving headings, links, lists, and images, with pay-per-call x402 micropayments and no API keys.

Give it a product and a country and it searches Google for manufacturers, wholesalers, and distributors, reads each candidate company's own website, and returns only the ones whose pages back up the claim, with quoted evidence, the domain, and a confidence score. Directories, marketplaces, and social networks are filtered out, and a free summary row reports how many sites were found and checked when nothing qualifies.

MCP server that exposes Abrasio as an agentic browser for AI models, allowing Claude, Cursor, and other MCP-compatible AIs to control a real web browser with anti-detection fingerprinting.

Pay-per-call web scraping for AI agents — no signup, no API keys, just USDC micropayments via the x402 protocol on Base

Lets an MCP client read allowlisted pages from the LiveSwapFace website, retrieve its official links, and estimate credits for a planned browser session using rates fetched at call time. It is read-only and never performs face swaps, signs in, uploads media, or touches a private API.

This Serper MCP Server supports search and webpage scraping, and all the most recent parameters introduced by the Serper API, like location.

Enables LLMs to perform web browsing tasks, take screenshots, and execute JavaScript using Puppeteer for browser automation.

Enables agents to transform tabular Markdown content into structured, type-inferred records with normalized formatting through an MCP-compatible interface.

Enables converting Markdown and HTML tables into structured JSON records with automatic column type inference and format normalization. It also offers supporting web-agent primitives such as DOM semantic pruning, form field auto-mapping, and execution trajectory evaluation, all via a zero-dependency MCP server.

Converts any webpage URL to clean, well-formed Markdown with title and H1 preservation, URL validation, and graceful fallbacks. One of 16 single-purpose servers in an open-source monorepo with full CI/CD to PyPI.

Enables reading Reddit posts by URL, bypassing Reddit's JavaScript proof-of-work challenge and CAPTCHA gate to return parsed post metadata, body text, and optionally comments. It exposes a single read_reddit_post tool over stdio for agent integration.