A
licenseA
qualityC
maintenanceEnables AI agents to scrape, crawl, clean, chunk, and index website content into Azure AI Search for full-text retrieval.
5
MIT
72,476 servers. Updated
Search Relevance ↓
Recent Usage ↓
Date Added ↓
Date Updated ↓
Weekly Downloads ↓
GitHub Stars ↓
Recent GitHub Stars ↓
Matching MCP tools:
Matching MCP Connectors:
actor.apify.godberry--content-to-social-mcp
io.github.varvararatta
com.agishub
io.github.foomworks
"How to scrape web content" matching MCP servers:
- AlicenseBqualityDmaintenanceA server that leverages Cloudflare Browser Rendering to extract and process web content for use as context in LLMs, offering tools for fetching pages, searching documentation, extracting structured content, and summarizing content.411MIT
- Flicense-qualityCmaintenanceProvides free web search, content fetching, image search, and deep research via SearXNG, no API keys required.
- AlicenseAqualityCmaintenanceProvides clean, bounded web content to AI by filtering HTML noise and optionally summarizing, preventing context window overflow.33MIT
- AlicenseAqualityAmaintenanceA fast, dependency-light MCP server that converts web pages into clean Markdown, structured metadata, and classified links for language models.339MIT
- AlicenseAqualityCmaintenanceConverts AI Skills (following Claude Skills format) into MCP server resources, enabling LLM applications to discover, access, and utilize self-contained skill directories through the Model Context Protocol. Provides tools to list available skills, retrieve skill details and content, and read supporting files with security protections.327Apache 2.0
- AlicenseAqualityCmaintenanceEnables AI agents to capture clean web screenshots and extract main article content from any web page, with automatic removal of cookie banners, ads, and boilerplate.2MIT
- AlicenseAqualityBmaintenanceAn MCP server that runs Apify scraping actors with quality-gated validation, scoring, and retries, returning embedding-ready chunks for AI agents.7MIT
- AlicenseAqualityBmaintenanceEnables Claude to scrape, crawl, extract data, and sync to vector databases using scrapedatshi's RAG pipeline, with support for multiple embedding and vector DB providers.12MIT
- AlicenseAqualityAmaintenanceWeb scraping, crawling, and structured data extraction for AI agents. 5 tools: scrape (clean markdown from any URL), crawl (entire sites), map (discover URLs), extract (structured JSON), and search. 833ms avg latency, single binary, self-hostable.8571AGPL 3.0
- FlicenseAqualityDmaintenanceA basic MCP server setup guide demonstrating how to configure and run Python-based MCP servers with integration examples for Bright Data web scraping and Apify Actors for product data collection.4
Keenable MCP Serverofficial
AlicenseAqualityBmaintenanceAn MCP server that enables web search and page content retrieval via the Keenable API, supporting search with filters and fetching clean markdown content from indexed URLs.2374MIT- AlicenseAqualityAmaintenanceA Model Context Protocol server that gives AI assistants access to 7 search providers with intelligent auto-routing. Analyzes query intent and picks the best provider automatically — no manual switching needed. Install, configure your keys, and go.23MIT
- AlicenseAqualityCmaintenanceAn enterprise-grade Model Context Protocol server for high-performance web analysis that discovers subpages, provides AI-based page summaries, and extracts structured content for RAG using FastMCP and FastAPI.24MIT
- FlicenseAqualityCmaintenanceA focused MCP server that provides a single web_search tool for web searches, integrating Tavily and Brave with automatic fallback and key rotation.1
- FlicenseAqualityDmaintenanceProvides web search capabilities to Claude AI using the Anthropic API, allowing LLMs to access up-to-date information from the web with customizable domain filtering.148
Oxylabs MCP Serverofficial
AlicenseAqualityAmaintenanceA scraper tool that leverages the Oxylabs Web Scraper API to fetch and process web content with flexible options for parsing and rendering pages, enabling efficient content extraction from complex websites.4101MIT- AlicenseAqualityBmaintenanceFetches web pages, converts HTML to markdown, and uses Claude to answer questions about the content.1MIT
- AlicenseAqualityDmaintenanceEnables AI assistants to search the web, conduct deep research, extract web content, and get AI-powered answers in real-time via the KEIRO API.6MIT
- AlicenseAqualityCmaintenanceProvides access to Jina AI's suite of web tools including URL reading, web/image/academic search, content extraction, embeddings, and reranking capabilities. Enables AI assistants to search the web, extract content from URLs, and process information with semantic understanding.19Apache 2.0