"A search for information about deep crawl web crawling and site auditing tools" matching MCP servers:

MCP server that gives AI agents access to current web information through web_search and fetch_url tools, using Tavily, Brave, and DuckDuckGo providers with automatic fallback.

Enables deep web search across multiple providers including Google, Bing, Brave, DuckDuckGo, and Perplexity, with support for comprehensive AI-powered research using intelligent multi-engine queries.

Performs comprehensive web searches by combining Google search with advanced content extraction using Mozilla's Readability algorithm.

An MCP server that provides information about Utkarsh, including bio, skills, work experience, and portfolio projects, accessible via local stdio or remote HTTP with OAuth.

Provides web search and content extraction tools for AI assistants, with zero configuration and swappable backends.

Enables AI agents to extract structured content from URLs, search the web via DuckDuckGo, monitor site availability, and convert HTML to markdown without requiring API keys.

Web search API for AI agents. Returns structured results with title, URL, and snippet; pay-per-call via x402 micropayments.

Enables web search for the pi coding agent using z.ai GLM native search with a DuckDuckGo fallback.

Provides eight tools for web search, content extraction, screenshots, PDFs, JavaScript execution, crawling, and Wayback Machine snapshots and archiving.

Enables web search via DuckDuckGo and web content fetching through the Model Context Protocol, allowing AI assistants to search and retrieve web page content.

MCP server to crawl WeChat articles, download images, and convert to Markdown, designed for Cursor IDE and AI tools.

Enables MCP clients to search the web and fetch public web pages via DeepSeek's Search and Fetch APIs, returning ranked results and Markdown page content for agent use.

Enables MCP clients that lack built-in search — such as Claude Code through Bedrock or local LLM clients — to run web queries against Amazon's operated search index via a Gateway deployed in your own AWS account, with queries never leaving AWS and citation URLs preserved. Supports IAM/SigV4, Cognito, and API key authentication, per-gateway rate limits, IP and domain restrictions, and result filtering by domain and publication date.

Provides comprehensive search capabilities including web search, content extraction, news search, academic search, and AI-powered multi-source research. Enables natural language access to web content and research through a production-ready MCP server.

Enables web searches through DuckDuckGo without an API key and extracts readable main content from web pages.

Wraps Xiaomi MiMo's web_search API into an MCP tool for Claude Code, enabling real-time web searches with location awareness, automatic retry, and timeout control.

Provides local LLMs with web search and page fetching capabilities via MCP, with a focus on OWASP security best practices.

Enables crawling sites from start URLs and retrieving internal and external links, file download links, HTML tables as rows, and lists, with controls for crawl depth, page limits, sitemaps, robots.txt, and proxy mode.

A local stdio MCP server that exposes DeepSeek's Web Search and Fetch APIs, letting AI clients run structured web queries, fetch page contents, and receive DeepSeek's raw JSON responses unfiltered and untruncated. It supports filtering by site, language, and date range, with configurable timeouts and retries.

One place for every AI agent's pages and docs. Publish HTML, build folders, ZIPs, PDFs and Office documents as sandboxed, versioned share links, then search, read and update them later from any MCP client. Sign in with Google or GitHub via OAuth. Open source and self-hostable: https://github.com/lexmount/artifact-site

A focused MCP server that provides a single web_search tool for web searches, integrating Tavily and Brave with automatic fallback and key rotation.

Screenshot, visual-diff, and AI page-analysis API for AI agents. Capture any URL as PNG, JPEG, WebP, PDF, or HTML, diff two versions of a page to catch visual regressions, and get an AI summary of what a page contains.

A Model Context Protocol server that provides real-time web search capabilities to AI assistants through pluggable search providers, currently integrated with the Brave Search API.

An MCP server that enables Claude Code to perform web searches via Bing, read webpage content, and get current time, with a smart search skill for structured multi-source verification.

Enables fetching, crawling, and analyzing web pages with 29 tools for SEO audits, content extraction, and more.

A production-ready MCP server for free web search, news search, and webpage content extraction using DuckDuckGo and Bing.

MCP server for web search with LLM-optimized results and anti-detection mechanisms.

Enables unified web search across multiple providers (AnySearch, SearXNG, Tavily) and deep research via DeepSeek's web_search_20250305 tool, with optional OpenRouter reranking for improved result ordering.

Provides multi-provider web search capabilities with fallback chains, semantic reranking, and content extraction for grounded agent retrieval.

Enables MCP clients and a terminal CLI to run web searches through a user's own SearXNG instance, saving every query as a reusable session and optionally generating AI-synthesized answers.