Skip to main content
Glama
123,497 servers. Updated
20 Best Web Scraping MCP Servers: compared and ranked, November 2026Ranked from 2,147 matching servers on stars, growth, downloads and maintenance. Updated .

Matching MCP tools:

Matching MCP Connectors:

"A web crawler for collecting and indexing website content" matching MCP servers:

GET /v1/servers – MCP directory API reference
  • A
    license
    Not graded
    quality
    C
    maintenance
    Enables AI agents to read any web page as clean Markdown and inspect its metadata, structure and technology stack, plus check redirects, TLS certificates, security headers, robots.txt, sitemaps, feeds, domains, SEO, broken links, email authentication (SPF/DMARC/DKIM) and SSO (SAML/OIDC). It also provides developer utilities such as cron, regex, color, Unicode and time-zone tools along with Hyperliquid perpetuals market data, all hosted remotely on Apify with pay-per-call pricing.
    MIT
  • A
    license
    Not graded
    quality
    B
    maintenance
    Enables LLM clients to index Java, Python, TypeScript, and JavaScript projects into a persistent property graph and query callers, callees, execution paths, virtual dispatch, aspect advice, framework wiring, annotations, and external dependencies through MCP tools.
    1,428 npm
    MIT
  • A
    license
    Not graded
    quality
    B
    maintenance
    Enables users to mint website tasks into tested, deterministic MCP tools and replay them without a model, using Playwright browser tools for public sites and page tools that run in the user’s own Chrome tab for signed-in sites.
    356 npm
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    Fast, token-efficient web content extraction tool that converts websites to clean Markdown for AI agents, featuring smart caching, content extraction with Mozilla Readability, and polite crawling capabilities.
    1
    1,450 npm
    163
    MIT
  • F
    license
    A
    quality
    D
    maintenance
    Enables interaction with Prismic through tools for reading documents, managing media assets, and performing content migrations or updates. Supports the Prismic Content, Asset, Migration, and Custom Types APIs with secure write operations and multi-transport support.
    18
    -
  • A
    license
    A
    quality
    B
    maintenance
    This server performs a comprehensive analysis of a website by fetching its HTML and scoring it across five categories: performance, SEO, design, functionality, and technology. It enables users to identify technical strengths and weaknesses in a webpage's structure and health.
    2
    MIT
  • A
    license
    B
    quality
    D
    maintenance
    An MCP server for automated website generation that transforms Excel spreadsheets and structured data into responsive portfolios, catalogs, and directories. It enables users to create complete websites, add pages, and generate components through natural language and template-based integration.
    5
    MIT
  • A
    license
    B
    quality
    C
    maintenance
    Enables AI agents to read and edit a Django site's content over its API, creating tools at startup from whatever resources the site registers so no code changes are needed. Works with any site running django-agent-content, with HTTPS-only API key authentication and no delete operations.
    1
    100 PyPI
    3
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    MCP server that lets AI editors execute JavaScript, read console output, and simulate clicks/input on static web pages. Supports multiple browser pages and can be deployed remotely via HTTP transport.
    13
    6 npm
    1
    Apache 2.0
  • A
    license
    A
    quality
    B
    maintenance
    Enables AI coding agents to set up the kit and build pages with it by serving each release's own docs data: searching and describing components, producing install code for a given setup, returning class and content conventions, and checking pages for unknown classes, hooks and missing files. It reads only public docs, with no sign-in or stored data.
    5
    BSD 3-Clause
  • A
    license
    A
    quality
    D
    maintenance
    An MCP server that uses AI to generate structured Asana project plans from diverse sources like text, PDFs, and meeting transcripts. It enables users to preview, generate, and directly sync detailed task lists, subtasks, and dependencies into Asana.
    1
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Provides Codex and other MCP clients a local web debugging server that coordinates a browser session, JavaScript debugger, bounded runtime evidence, and reproducible flow verification for vanilla HTML/JS projects.
    13
    41 npm
    6
    GPL 3.0
  • A
    license
    B
    quality
    B
    maintenance
    Enables agents to inspect localhost web applications through Chrome DevTools Protocol by listing Chrome targets, attaching to a page, capturing and querying network, console, navigation, and WebSocket events, and managing ephemeral sessions.
    8
    1
    MIT
  • A
    license
    B
    quality
    B
    maintenance
    A local Python WebSocket bridge and browser extension that securely connects web AI chats to local Model Context Protocol (MCP) servers. It enables web-based AIs to execute local tools with granular permission controls, providing the same powerful tool and system access typically exclusive to desktop agent harnesses like DeepSeek Harness, Claude Code, Codex and more.
    4
    16
    Apache 2.0
  • A
    license
    B
    quality
    D
    maintenance
    An MCP server that provides access to project files and their contents, allowing users to retrieve file data from specified project directories with error handling and configuration options.
    1
    5
    MIT
  • A
    license
    Not graded
    quality
    C
    maintenance
    Provides over 1,000 creative ways to decline requests across four categories (polite, humorous, professional, and creative). The MCP server wraps a REST API to help users craft professional rejections through natural language interactions.
    37 npm
    MIT
  • A
    license
    Not graded
    quality
    B
    maintenance
    Enables ChatGPT to work with a local Windows development environment through MCP, including file and code operations, terminal commands, Git, browser and desktop automation, and task-specific skills. Also supports long-running task management and isolated account workspaces.
    3
    MIT
  • A
    license
    Not graded
    quality
    D
    maintenance
    Enables users to select UI elements on localhost pages and send fix requests to MCP-compatible coding agents, which retrieve the captures and edit the code, with masking of sensitive values.
    MIT
  • A
    license
    Not graded
    quality
    C
    maintenance
    Enables AI coding assistants to use Web Gemini as an on-demand subagent for multi-turn text and multimodal Q&A, persistent named sessions, model selection, and health checks, with process-safe session storage and secure authentication.
    AGPL 3.0
  • A
    license
    Not graded
    quality
    B
    maintenance
    Enables coding agents to publish HTML artifacts that users can review and comment on in a sandboxed browser viewer, with feedback loop support for iterative versions.
    12 npm
    MIT
  • F
    license
    Not graded
    quality
    D
    maintenance
    A lightweight web scraping server that allows Claude Desktop users to extract various types of data from websites, including text, links, images, tables, headlines, and metadata using CSS selectors.
    4
    -
  • A
    license
    A
    quality
    B
    maintenance
    Enables Codex to consult Claude Code for a second opinion through a local stdio MCP server, exposing the ask_claude tool for text-only reviews and recommendations using existing Claude Code authentication. Codex can request findings and tradeoff analysis without allowing Claude to edit files or run commands.
    1
    1
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Enables MCP clients like Codex to delegate coding tasks to DeepSeek Harness, reusing the same Web-visible session for feedback and keeping the conversation in the Harness Web UI.
    10
    1
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Odds are, most of what you want to build is already open source. Tell your AI agent what you're making, and it finds it: which repos to use as they are, which to adapt, and what's left for you to write. Every repo it names is real, licensed for your use or flagged, and checked live.
    3
    346 npm
    1
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Provides deterministic, read-only design knowledge for AI coding agents to help them choose visual directions, plan UI states, and compose design tokens, all without network access.
    6
    250 npm
    29
    MIT
  • A
    license
    A
    quality
    D
    maintenance
    A TypeScript-based MCP server that enables AI assistants to execute HTTP requests with full control over methods, headers, and body content. It facilitates seamless interaction with web APIs and endpoints through a versatile tool that handles automatic JSON formatting and response truncation.
    1
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    Enables any MCP client to browse, triage, search, read, and drive pi coding agent sessions through Pi Web's HTTP API via 25 tools. Supports listing and filtering sessions, reading transcripts, flagging conversations awaiting input, sending messages and waiting for replies, inspecting project diffs, and forking, renaming, or deleting sessions over either stdio or Streamable HTTP.
    25
    MIT
  • A
    license
    B
    quality
    D
    maintenance
    A Node.js-based frontend security audit tool that performs comprehensive dependency security audits for both local projects and remote repositories. Generates detailed Markdown reports with vulnerability detection, risk assessment, and fix recommendations.
    1
    7
    ISC
  • A
    license
    B
    quality
    B
    maintenance
    A CDP-native MCP server that lets AI agents drive a real Chrome browser with deep network/console inspection, robust page interaction, and the ability to reverse-engineer a site's API flow into runnable code with dependency chaining and replay verification.
    52
    20 npm
    3
    MIT
  • A
    license
    B
    quality
    D
    maintenance
    Enables web performance analysis using Google PageSpeed Insights and Chrome UX Report APIs, providing compact metrics and diagnostics without local browser automation.
    5
    6 npm
    MIT
  • A
    license
    B
    quality
    C
    maintenance
    A live MCP server that connects AI assistants to a running Obsidian instance, enabling full app automation including reading notes, clicking UI elements, managing plugins, and executing JavaScript.
    43
    13 npm
    3
    MIT
  • A
    license
    B
    quality
    F
    maintenance
    Automatically crawls documentation websites, converts them to organized markdown files, and generates condensed cheat sheets. Intelligently categorizes content into tools/APIs and provides local-first access to downloaded documentation.
    3
    GPL 3.0
  • A
    license
    C
    quality
    D
    maintenance
    A Model Context Protocol server that helps programmers understand code by providing explanations, tech stack analysis, and best practice suggestions through prompt templates.
    3
    21 npm
    1
    ISC
  • F
    license
    C
    quality
    D
    maintenance
    An AI-centric MCP server that enables automated Xilinx Vivado workflows, including project management, synthesis, implementation, and timing analysis. It allows AI agents to drive hardware design processes while integrating directly with the official Vivado GUI for visual context.
    15
    4
    -