F
licenseB
qualityD
maintenanceA Model Context Protocol server that analyzes webpage design structures, providing detailed layout, navigation, content, form, image, and link information from a given URL.
1
6
73,463 servers. Updated
Search Relevance ↓
Recent Usage ↓
Date Added ↓
Date Updated ↓
Weekly Downloads ↓
GitHub Stars ↓
Recent GitHub Stars ↓
Matching MCP tools:
Matching MCP Connectors:
io.github.pipeworx-io
io.github.lazymac2x
io.github.eltociear
io.github.varvararatta
"Web crawler for sequential URL content retrieval" matching MCP servers:
- Alicense-qualityCmaintenanceProvides lightweight web crawling and scraping capabilities, enabling users to fetch pages as clean Markdown, recursively crawl domains, extract metadata, and perform search-and-crawl operations.6MIT
- Flicense-qualityDmaintenanceAn intelligent web crawling server that uses Cloudflare's headless browser to render dynamic pages and Workers AI to extract relevant links based on natural language queries. It enables AI assistants to search and filter website content while providing secure access through GitHub OAuth authentication.3
- FlicenseAqualityCmaintenanceWeb-crawler MCP server that fetches web pages with static parsing or headless browser fallback, enabling Claude to fetch, extract links, crawl sites, and select content via CSS selectors.4
- AlicenseAqualityBmaintenanceA black-box flight recorder for RAG retrieval inside MCP agents. Logs what chunks the model saw, scores, sources, and rankings - so you can audit, replay, and diff retrieval runs after the fact.4152MIT
- Flicense-qualityBmaintenanceMCP server that gives AI agents access to current web information through web_search and fetch_url tools, using Tavily, Brave, and DuckDuckGo providers with automatic fallback.
- AlicenseAqualityFmaintenanceA comprehensive website crawler and SEO analyzer that stores site data in a local SQLite database for AI-driven auditing. It enables users to detect technical SEO issues, broken links, and security vulnerabilities through natural language queries or terminal commands.45416Apache 2.0
- Alicense-qualityBmaintenanceMCP server for content-studio, enabling AI agents to manage content ideas, channels, personas, and drafts with approval-based edits.1AGPL 3.0
- Alicense-qualityCmaintenanceEnables URL parsing and building from components, plus query string parsing, all without keys or online dependencies.12MIT
- Flicense-qualityDmaintenanceA specialized web crawler and scraper for the US Patent and Trademark Office (USPTO) website, built with Crawl4AI and MCP integration, enabling patent and trademark search, extraction, and status checking.4
- AlicenseAqualityCmaintenanceSERP-based content scoring and optimization with 7 SEO categories.6MIT
- AlicenseAqualityDmaintenanceProvides Baidu hot search and Bilibili trending video data for Claude and Cherry Studio, supporting retrieval, search, and cache management.6291MIT
- AlicenseBqualityDmaintenanceFetches and tracks content from YouTube channels, RSS feeds, and GitHub releases with persistence to identify new items across sessions.6151MIT
- AlicenseBqualityDmaintenanceA server that leverages Cloudflare Browser Rendering to extract and process web content for use as context in LLMs, offering tools for fetching pages, searching documentation, extracting structured content, and summarizing content.411MIT
- FlicenseBqualityDmaintenanceA Model Context Protocol server that enables LLMs to fetch and process web content in multiple formats (HTML, JSON, Markdown, text) with automatic format detection.56
- Alicense-qualityCmaintenanceEnables web crawling and content extraction from web pages, supporting multiple output formats like text, markdown, XML, and JSON, with robots.txt compliance and rate limiting.141MIT
- Alicense-qualityDmaintenanceEnables AI assistants to interact directly with Strapi v5 CMS content through full CRUD operations, media uploads, and content type exploration using Strapi's Document Service API.1201MIT
- Alicense-qualityBmaintenanceMCP server for managing LinkedIn content workflows. It generates images via OpenAI, stores assets in Cloudinary, and queues drafts through Buffer with mandatory human approval.MIT
- Alicense-qualityBmaintenanceWeb search API for AI agents. Returns structured results with title, URL, and snippet; pay-per-call via x402 micropayments.MIT
- Alicense-qualityDmaintenanceAn MCP server that enhances sequential thinking with Ultra Think methodology, enabling structured, step-by-step reasoning with quality metrics, bias detection, and resource management.7MIT
