A
licenseA
qualityD
maintenanceProvides web access capabilities for LLMs including search, fetching, content extraction, PDF reading, image viewing, and screenshots.
3
46
MIT
72,746 servers. Updated
Search Relevance ↓
Recent Usage ↓
Date Added ↓
Date Updated ↓
Weekly Downloads ↓
GitHub Stars ↓
Recent GitHub Stars ↓
Matching MCP tools:
Matching MCP Connectors:
com.borisinc
app.apick
com.create-web-page
com.agishub
"Web crawling techniques and tools" matching MCP servers:
- FlicenseDqualityDmaintenanceProvides web connectivity tools for searching the web via DuckDuckGo or SerpAPI, fetching URL content, and extracting readable text from web pages.32
- Flicense-qualityCmaintenanceMulti-engine web search and content extraction MCP server with 10 sources, 4-way parallel queries, and content extraction via Jina Reader, no API keys required.
- AlicenseBqualityCmaintenanceMCP server exposing web_search, web_fetch, and cluesift_domain_fetch tools with configurable Ollama API keys and HTTP or stdio transport.3MIT
- AlicenseAqualityCmaintenanceMCP server providing free, IP-direct tools for web search, crawling, anti-detect browsing, and structured data from Wikipedia, Wikidata, GitHub, and YouTube.261MIT
- AlicenseAqualityCmaintenanceEnables AI agents to extract clean, structured web content (articles, tables, links, visual layouts) optimized for LLM token efficiency, with fast response times and optional JavaScript support.581MIT
- AlicenseAqualityAmaintenanceComprehensive web research toolkit with 13 tools for searching (via SearXNG), crawling, package discovery, GitHub metrics, error translation, API documentation lookup, data extraction, technology comparison, and service status checking.149MIT
- AlicenseBqualityBmaintenanceA reconnaissance MCP server that discovers web data sources by monitoring network requests and extracting API structures, enabling AI to understand data location and format without full crawling.212MIT
- AlicenseBqualityBmaintenanceA local MCP server providing web search, page extraction, and safe browser automation tools for Hermes, Claude Code, and other MCP clients.10MIT
- Alicense-qualityBmaintenanceMCP server for multi-engine web search and web page fetching, supporting parallel search, content extraction, and optional LLM-powered search summarization and deep search.2MIT
- Alicense-qualityDmaintenanceProvides eight tools for web search, content extraction, screenshots, PDFs, JavaScript execution, crawling, and Wayback Machine snapshots and archiving.201MIT
- Alicense-qualityFmaintenanceEnables AI agents to search DuckDuckGo and fetch web content with human-assisted CAPTCHA handling, designed for local use where humans can intervene when bot detection occurs.7MIT
- Alicense-qualityBmaintenanceA self-hosted MCP server that reads web pages and converts them to Markdown, with built-in web search and anti-crawl fallback using Playwright.1MIT
- Alicense-qualityBmaintenanceConverts web pages to Markdown for MCP clients like Claude, with support for single and batch reads, caching, fallback rendering, and SSRF protection.18MIT
- Flicense-qualityCmaintenanceAn MCP server enabling AI agents to access the internet via web scraping, crawling, searching, and structured data extraction using Firecrawl.
- Flicense-qualityBmaintenanceAn MCP server for safe web crawling and scraping of public and authenticated sites using Playwright and Crawlee. It provides tools for scraping single pages, crawling entire sites, validating sessions, and listing supported sites, with built-in security protections and adapter-based extensibility.
- Flicense-qualityDmaintenanceAn MCP-native pipeline for collecting structured intelligence on higher education institutions using the WHED schema, enabling scraping, extraction, validation, and saving of profiles.
- FlicenseAqualityBmaintenanceA local MCP server that gives Claude Code web search capabilities using DuckDuckGo, enabling discovery of URLs from natural language queries.11
- AlicenseAqualityAmaintenanceA web-fetch MCP server for LLM agents that fetches pages with an escalation ladder through different engines, raising FetchBlocked instead of returning blocked content.21Apache 2.0
- FlicenseAqualityDmaintenanceDrop-in replacement for Claude's native web_search and web_fetch tools, resolving IP blocks and user-agent detection by using your own API keys and proxy.3