A
license-
qualityC
maintenanceEnables web crawling and content extraction from web pages, supporting multiple output formats like text, markdown, XML, and JSON, with robots.txt compliance and rate limiting.
14
1
MIT
73,464 servers. Updated
Search Relevance ↓
Recent Usage ↓
Date Added ↓
Date Updated ↓
Weekly Downloads ↓
GitHub Stars ↓
Recent GitHub Stars ↓
Matching MCP tools:
Matching MCP Connectors:
io.github.pipeworx-io
io.github.lazymac2x
io.github.eltociear
io.github.varvararatta
"Web crawler for sequential URL content retrieval" matching MCP servers:
Core Content Services MCPofficial
AlicenseAqualityBmaintenanceEnables AI models to interact with IBM FileNet Content Manager for document management, folder operations, metadata handling, search, and content extraction through a standardized interface.2615Apache 2.0
Watsonx.data Document Libraryofficial
Alicense-qualityCmaintenanceBridges AI agents with watsonx.data document libraries, enabling natural language queries and intelligent retrieval from document libraries.4Apache 2.0- Alicense-qualityAmaintenanceUltra-lightweight headless browser for AI agents. Provides MCP tools for navigating URLs, extracting structured content, and building autonomous agent workflows.2Apache 2.0
- Alicense-qualityAmaintenanceAn open-source, local-first MCP server for automated Schema.org JSON-LD generation, GA4 metric validation, /llm.txt auditing, and content stickiness analytics.MIT
- Flicense-qualityBmaintenanceEnables managing a social media calendar workflow with AI-generated images/videos, including generating media, uploading to Google Drive, and downloading the latest calendar draft.
redup.mcp-web-parserofficial
AlicenseAqualityBmaintenanceMCP server that parses web pages into clean markdown via Crawl4AI's HTTP API, exposing parse_page and health-check tools with configurable proxy and timeout.2MIT
mcp-server-rag-web-browserofficial
Alicense-qualityFmaintenanceImplementation of an MCP server for the RAG Web Browser Actor. This Actor serves as a web browser for large language models (LLMs) and RAG pipelines, similar to a web search in ChatGPT.75208Apache 2.0- Alicense-qualityAmaintenanceA client-side MCP proxy that injects OAuth 2.0 bearer tokens or API keys into MCP requests, enabling MCP clients to connect to OAuth/API-key-protected MCP servers like Amazon Bedrock AgentCore Gateway. It automatically fetches and refreshes credentials using AgentCore Identity or static values.MIT No Attribution
302AI Web Search MCPofficial
Alicense-qualityDmaintenanceEnables web search functionality via the 302AI API.17MIT- Alicense-qualityDmaintenanceEnables Directus users to interact with their data in LLMs, allowing content editors and data analysts to manage content, query collections, and perform data operations using natural language.10783MIT
- AlicenseAqualityDmaintenanceProvides web access tools (fetch, search, sitemap crawl) through String AI's API, automatically handling anti-bot bypass, CAPTCHA, and JavaScript rendering.386MIT
- AlicenseAqualityFmaintenanceUnleashes LLM-powered agents to autonomously execute and debug web apps directly in your code editor, with features like webapp navigation, network traffic capture, and console error collection.21,240Apache 2.0
PDF Export for AI Agentsofficial
AlicenseBqualityDmaintenanceWell-designed PDFs from a single prompt. Describe what you need, get a professional document.2651MIT- AlicenseBqualityBmaintenanceStarTree MCP Server for Apache Pinot1416Apache 2.0
- Apache 2.0
Snyk API & Web MCP Serverofficial
AlicenseCqualityAmaintenanceConnects AI coding assistants to Snyk API & Web for onboarding scan targets, configuring authentication, running DAST scans, and triaging findings through natural language.517Apache 2.0- Alicense-qualityBmaintenanceThunderbit MCP lets AI agents search, scrape, and extract structured data from any website.13MIT
- Alicense-qualityAmaintenancePerplexity for social: ask what competitors are running across social and get answers grounded in real ad and creative data, not guesses.2Apache 2.0
- Alicense-qualityCmaintenanceEnables Cursor IDE to interact with Tealfabric platform, allowing management of webapps, processes, and documents through natural language.2Apache 2.0
