"A search for information about deep crawl web crawling and site auditing tools" matching MCP servers:

MCP server for web crawling, searching, and AI-powered content extraction, supporting single-page, batch, and full-site crawling along with text, news, image, book, and video search.

Enables web searches through DuckDuckGo without an API key and extracts readable main content from web pages.

Provides a web search tool with citations by running Claude Code CLI in an isolated Docker container, enabling search even in environments without direct Anthropic web search support.

A lean FastMCP server that wraps xAI's web_search and x_search tools for MCP hosts, enabling live web and X search with citations.

An MCP server that provides Google Analytics and Search Console data as tools for AI assistants, enabling natural language queries for web analytics, SEO performance, and site insights.

An open-source deep research MCP server that provides multi-source web search and synthesis with citations, enabling agents to perform citation-backed research using Qwen3-30B-A3B-Thinking and other models.

Provides an LLM client with self-hosted web scraping capabilities including scraping, crawling, mapping, searching, structured data extraction, browser interaction, and deep research, without reliance on paid proxy or CAPTCHA services.

A reconnaissance MCP server that discovers web data sources by monitoring network requests and extracting API structures, enabling AI to understand data location and format without full crawling.

MCP server that searches the web, reads pages, and returns concise summaries with cited sources via the research_web and read_url tools.

Enables private web search and webpage content extraction using a local SearxNG instance, prioritizing user privacy and autonomy.

Enables web search via a real browser for any LLM, bypassing anti-bot measures without API keys.

Enables AI-assisted user feedback collection and management via a web interface, with MCP integration for automated replies and tool execution.

MCP server for AI-powered web research — search (Google, Brave, Serper, SearXNG), scrape any page, extract PDFs/DOCX/YouTube transcripts, academic & patent search. Single Go binary. Works with Claude, Cursor, Copilot, and any MCP client.

An MCP server that enables AI assistants to perform web searches on Perplexity.ai using browser automation instead of an official API. It supports persistent authenticated sessions and returns search results along with cited sources directly to the client.

CLI-first web and code search for agents, with MCP support for integration with IDEs like Cursor, VS Code, and Claude Code.

Search and resolve MCP server packages on the mpak registry, enabling agents to discover servers, inspect tools, and check credential requirements before installation.

MCP server for querying Google Gemini Web from Claude Code and other MCP clients, using cookie-based authentication. Enables creating, continuing, listing, viewing, and deleting Gemini chat conversations with model and thinking mode control.

A local web search MCP server supporting parallel, API, and model-based search modes, integrating Zhipu Web Search API and online models for real-time information retrieval.

Provides AI-driven web search, page fetching, and site mapping with real xAI citations, enabling LLM clients to access up-to-date external information.

Provides advanced web search, content extraction, site crawling, mapping, and AI-powered research capabilities through the Tavily API with automatic multi-key fallback for rate limiting.