"Information about web scraping or crawling" matching MCP servers:

Provides an LLM client with self-hosted web scraping capabilities including scraping, crawling, mapping, searching, structured data extraction, browser interaction, and deep research, without reliance on paid proxy or CAPTCHA services.

Enables web searches through DuckDuckGo without an API key and extracts readable main content from web pages.

Enables private web search and webpage content extraction using a local SearxNG instance, prioritizing user privacy and autonomy.

Enables AI-assisted user feedback collection and management via a web interface, with MCP integration for automated replies and tool execution.

An MCP server that enables AI assistants to perform web searches on Perplexity.ai using browser automation instead of an official API. It supports persistent authenticated sessions and returns search results along with cited sources directly to the client.

Provides a web search tool with citations by running Claude Code CLI in an isolated Docker container, enabling search even in environments without direct Anthropic web search support.

Fetches a URL and returns the main content as clean Markdown, using plain HTTP when possible and headless Chromium for JavaScript-rendered or bot-protected pages.

Bridges the editing capabilities of an already-open DingTalk document in the browser to any MCP host via standard stdio, forwarding tools to the page's internal MCP server over a local WebSocket. Supports read/write operations through suggested edits, pairing-based security, and zero runtime dependencies.

A lean FastMCP server that wraps xAI's web_search and x_search tools for MCP hosts, enabling live web and X search with citations.

MCP server for AI-powered web research — search (Google, Brave, Serper, SearXNG), scrape any page, extract PDFs/DOCX/YouTube transcripts, academic & patent search. Single Go binary. Works with Claude, Cursor, Copilot, and any MCP client.

Enables AI assistants to search Perplexity.ai through browser automation without an API key, returning answers with cited sources.

MCP server for querying Google Gemini Web from Claude Code and other MCP clients, using cookie-based authentication. Enables creating, continuing, listing, viewing, and deleting Gemini chat conversations with model and thinking mode control.

A reconnaissance MCP server that discovers web data sources by monitoring network requests and extracting API structures, enabling AI to understand data location and format without full crawling.

Provides browser automation and web scraping as MCP tools, enabling autonomous URL ingestion, crawling, extraction, and anti-bot handling with interactive browser control.

Enables capturing browser API traffic via CDP and turning any website into a ready-to-run FastMCP server, with no official API required.

Enables users to search and fetch documentation from supported libraries (langchain, llama-index, openai, uv) as clean, readable text, which can be used as context for answering questions.

MCP server that searches the web, reads pages, and returns concise summaries with cited sources via the research_web and read_url tools.

Enables web search, page fetching, and search statistics for Claude Code and any MCP client without requiring an API key, using automatic provider fallback and caching.

Enables AI assistants to access real-time web data through search, markdown scraping, and browser automation while bypassing anti-bot protections. It provides tools for web research, e-commerce monitoring, and data extraction from across the globe.

A FastMCP-based service that extracts no-watermark links from 20+ video platforms (including TikTok, Kuaishou, etc.) and can convert video speech to text.