Conduct deep web research on any query using crawling, search, and AI analysis to gather comprehensive information from multiple sources.
MIT
260,402 tools. Last updated 2026-07-05 06:35
"A search for information about deep crawl web crawling and site auditing tools" matching MCP tools:
- Start multi-page web crawling to extract structured data with AI or convert content to markdown from a starting URL.MIT
- Retrieve results from an asynchronous web crawling operation by polling with a request ID until completion, providing structured data or markdown content from processed webpages.MIT
- Trigger a browser-agent crawl of a web app to populate its knowledge graph, providing context for evaluations and tests. Supports localhost with automatic tunnel.Apache 2.0
- Set up a new testing project by defining a target website's base URL and crawl limits. This project is saved to disk and reused for crawling, testing, and authentication.AGPL 3.0
- Search the web and extract content from results to find specific information across multiple websites when you don't know which site has the data you need.MIT
Matching MCP Servers
- Flicense-qualityFmaintenanceA deep web search MCP server using LinkUp API that provides a deep_search tool for performing deep web searches with optional max results.Last updated3
- AlicenseBqualityBmaintenanceEnables deep web search across multiple providers including Google, Bing, Brave, DuckDuckGo, and Perplexity, with support for comprehensive AI-powered research using intelligent multi-engine queries.Last updated23789MIT
Matching MCP Connectors
Web search for AI agents — one tool across 6 engines, routed to the cheapest + cached.
Docs: https://docs.keenable.ai/mcp-server Keenable is a free, remote MCP server that gives agents access to the web index. Search the web with ranked results and date/site filters, then fetch any indexed page as clean markdown. Works out of the box with no account or API key.
- Search the web with natural language queries and date/site filters to retrieve current information and recent data, returning relevant results with snippets.MIT
- Search the live web for current, ranked results with snippets and age. Supports country, freshness filters, and safe search for fact verification and research.MIT
- Retrieve enhanced measurement settings for a GA4 web data stream, covering scrolls, outbound clicks, site search, video engagement, file downloads, and form interactions. Read-only.MIT
- Search the web for current information, news, articles, and websites to find up-to-date content, research topics, or answer questions about recent events.Apache 2.0
- Search the web using Google to find current information, news, websites, and general knowledge. Returns structured results with titles, URLs, and snippets.MIT
- Run a full-site audit by crawling pages, executing selected checks (visual, accessibility, SEO, etc.), and generating a timestamped JSON report with per-page issues and site-wide findings.AGPL 3.0
- Search the live web and get ranked JSON results. Use deep mode for multi-step search with progress updates.MIT
- Trigger a fresh site crawl and SEO analysis after deploying changes. Checks all URLs, detects issues, and updates the database with current SEO status.MIT
- Search Jina AI's official blog for articles about AI, machine learning, neural search, embeddings, and Jina products to find documentation, tutorials, announcements, and technical deep-dives.Apache 2.0
- Search a catalog of 420 client-side fintech tools. Returns deep links; prefill-enabled tools accept parameters for one-click invocation.MIT
- Execute deep web research on any topic. An AI agent searches and synthesizes information from across the web, returning a task ID for polling.Apache 2.0
- Retrieve detailed WordPress site information including status, versions, URLs, and configuration by providing the domain name.MIT
- Crawl websites from a starting URL to extract structured content, controlling depth, breadth, and focus areas for targeted data collection.MIT
- Crawl a website to gather content from multiple pages. Returns a job ID for async polling. Best for whole-site extraction; for single pages use scrape, for URL discovery use map.MIT