"Web crawler for sequential URL content retrieval" matching MCP servers:

MCP server that fetches raw HTML content from a given URL to provide web context to LLMs.

Enables AI agents to fetch, crawl, extract, and search web content through a unified set of tools, with automatic routing to specialized backends.

A minimal MCP server that crawls web pages using crawl4ai and returns content as markdown, deployable to Cloud Run.

Enables AI agents to extract clean, structured web content (articles, tables, links, visual layouts) optimized for LLM token efficiency, with fast response times and optional JavaScript support.

Web-crawler MCP server that fetches web pages with static parsing or headless browser fallback, enabling Claude to fetch, extract links, crawl sites, and select content via CSS selectors.

An MCP server providing web search, image search, and page scraping tools to LLMs without requiring API keys.

Scores AI outputs for faithfulness, relevancy, and hallucination inside any MCP client, with custom metrics, golden sets, and run history with dashboards.

Enables agents to fetch URL content as plain text or pretty-printed JSON, with optional pay-per-use monetization through Vybe Collect.

Enables AI agents to parse PDFs and search local document context through multimodal extraction and vector-based retrieval, all exposed as MCP tools.

Extract content from URLs, documents, videos, and audio files using intelligent auto-engine selection. Supports web pages, PDFs, Word docs, YouTube transcripts, and more with structured JSON responses.

A Model Context Protocol server that enables LLMs to fetch and process web content in multiple formats (HTML, JSON, Markdown, text) with automatic format detection.

Exposes Futurepedia AI tool crawling and universal web page parsing as MCP tools for assistants.

Lets AI assistants manage a self-hosted content hub: create, edit, publish, and update articles across nine platforms, refresh account article lists, and sync changes through natural language.

MCP server for intelligent web crawling using a ReAct agent. Adaptively explores websites and returns structured analysis.

Enables AI agents to analyze a piece of content across 11 dimensions and receive ranked, scored recommendations among six cross-media output formats (PPT, infographic, comic, short video script, newsletter, reusable skill), then generate dispatch prompts for the chosen format. It also exposes the format catalog and profile schema as read-only tools, supporting batch routing of an entire content library.

Enables URL shortening and management through MCP, allowing creation of short links with optional tags and expiry, search, and stats.

Facilitates structured creative thinking through sequential thought processing, helping users shift from reactive problem-solving to proactive outcome creation using structural tension analysis and stage-based thinking workflows.

Enables AI assistants to search and collect data from Xiaohongshu/REDnote, including notes, comments, and user info, with dual-layer anti-detection and persistent login.

Enables AI agents to check URL safety before fetching content, using Google Web Risk, URLhaus, PhishTank, and AI analysis to return SAFE/SUSPICIOUS/DANGEROUS verdicts.

Provides a sequentialthinking tool for dynamic, reflective problem-solving via chain-of-thought reasoning. Supports local Stdio and remote SSE deployment on Google Cloud Run.