"Web crawler for sequential URL content retrieval" matching MCP servers:

Enables MCP-capable agents to perform reliable web search and content fetching through a single server that automatically fails over across multiple providers. It handles keyed or keyless authentication automatically and returns clean Markdown or text results.

Enables autonomous web browsing and extraction by canonicalizing URLs, detecting anti-crawler traps such as circular paths and infinite pagination, pruning DOM content, mapping forms, converting tables to JSON, and evaluating agent trajectories.

An MCP server providing web search, image search, and page scraping tools to LLMs without requiring API keys.

Enables AI agents to analyze a piece of content across 11 dimensions and receive ranked, scored recommendations among six cross-media output formats (PPT, infographic, comic, short video script, newsletter, reusable skill), then generate dispatch prompts for the chosen format. It also exposes the format catalog and profile schema as read-only tools, supporting batch routing of an entire content library.

AutomateLab Content Distribution publishes content across DEV.to, Hashnode, GitHub Discussions, Reddit and Bluesky, with browser workflows for LinkedIn, Medium and X. Tracks publishing state and adapts content per platform. Product and documentation: https://automatelab.tech/products/mcp/content-distribution-mcp/

Content Registry - MCP server providing AI-powered tools and automation by MEOK AI Labs

Provides URL parsing and analysis tools, including component parsing, deterministic hash generation, heuristic safety checks, and metadata extraction, all without external HTTP requests.

Resolves a company domain to its LinkedIn company page URL. Lightweight enrichment tool for sales and prospecting workflows.

Connects AI assistants to authentic Islamic content including Qur'an, Hadith, and resources in multiple languages via over 80 tools.

Enables reading web pages and PDFs as clean Markdown, extracting main content and letting agents query for relevant passages, outline sections, search in-page, and list links while respecting robots.txt and blocking private addresses.

Odysseus Web MCP is a standalone Model Context Protocol (MCP) server for safe public-web search and URL fetching.

Provides a unified web search tool for AI agents by running multiple search providers concurrently and returning normalized results. It integrates with Claude Code, Codex CLI, OpenCode, and Hermes.

An MCP server providing 8 content creation tools for case studies, newsletters, webinars, and more, based on the CRAFT Framework.

Enables privacy-focused web searches using DuckDuckGo and extraction of clean, readable content from web pages with support for parallel processing of multiple URLs.

A powerful tool for fetching and extracting text content from web pages and APIs, supporting web scraping, REST API requests, and Google Custom Search integration.

Enables EU AI Act Article 50(2) compliant watermarking of AI-generated content using C2PA manifest envelopes.

Content Calendar AI - MCP server providing AI-powered tools and automation by MEOK AI Labs

Whatsapp-Web MCP

Connect AI assistants to your Gramps Web family tree. Search and edit genealogy records, explore ancestors, descendants, relationships and timelines, and read document scans with vision-capable models. Includes guided research workflows, source citations, read-only mode, and privacy-aware media previews. Install with Docker or a Claude Desktop bundle.

MCP server for AI-powered web research — search (Google, Brave, Serper, SearXNG), scrape any page, extract PDFs/DOCX/YouTube transcripts, academic & patent search. Single Go binary. Works with Claude, Cursor, Copilot, and any MCP client.