Skip to main content
Glama
124,452 servers. Updated
Browse by product
20 Best Web Scraping MCP Servers: compared and ranked, November 2026Ranked from 2,147 matching servers on stars, growth, downloads and maintenance. Updated .

Matching MCP tools:

Matching MCP Connectors:

"Crawling News from Official Journals" matching MCP servers:

GET /v1/servers – MCP directory API reference
  • A
    license
    A
    quality
    C
    maintenance
    Enables MCP clients to instantly pull pre-cached, AI-curated news from 12 sources, including HackerNews, Reddit, GitHub Trending and HuggingFace Spaces, without any auth or installation. Provides tools for top picks, keyword search across today's items, fetching news since a timestamp, and quick briefs on GitHub repos and ArXiv papers.
    8
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    Provides MCP tools to fetch and search AI, Malaysian, and Germany SWE job-market news briefings, retrieve article content and Hacker News discussions, and perform web search and deep research.
    8
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    Enables querying and aggregating Chinese and international news along with multi-platform trending topics, featuring deduplication, event clustering, and article extraction for AI clients.
    7
    MIT
  • A
    license
    Not graded
    quality
    C
    maintenance
    Search, trending, topics, and local news all in one MCP server. Article previews, deduplication, source filtering, and 40+ languages built in.
    39 npm
    2
    MIT
  • F
    license
    Not graded
    quality
    Not graded
    maintenance
    A Model Control Protocol server that provides news scraping capabilities for Khaleej Times, allowing users to fetch headlines and full article content programmatically.
    -
  • F
    license
    Not graded
    quality
    D
    maintenance
    An MCP server for safe web crawling and scraping of public and authenticated sites using Playwright and Crawlee. It provides tools for scraping single pages, crawling entire sites, validating sessions, and listing supported sites, with built-in security protections and adapter-based extensibility.
    -
  • F
    license
    Not graded
    quality
    D
    maintenance
    Enables global news retrieval across multiple countries and categories (world, country, technology, science) via RSS feeds, exposing reusable MCP tools for fetching and searching news articles with no API keys required.
    -
  • A
    license
    Not graded
    quality
    C
    maintenance
    Enables searching mining news and fetching article content via RSS aggregation, date filtering, deduplication, and full-text excerpts.
    MIT
  • F
    license
    Not graded
    quality
    B
    maintenance
    Enables searching and fetching news articles with configurable date ranges, returning structured, sourced evidence for daily mineral-rights briefings.
    -
  • A
    license
    Not graded
    quality
    C
    maintenance
    Enables MCP clients and AI agents to send prompts to Grok through the user's own logged-in x.com browser session, start fresh chats, and check channel status without an API key.
    MIT
  • F
    license
    Not graded
    quality
    C
    maintenance
    civyk-winwright is a Playwright-style MCP server for Windows desktop and browser automation. It provides 59 tools for controlling WPF, WinForms, Win32 apps, and Chrome/Edge via the Model Context Protocol. A unified automation layer connecting Claude and MCP-compatible agents to native Windows UI and web interfaces.
    21
    -
  • A
    license
    A
    quality
    B
    maintenance
    PageSift is an open-source Rust MCP server that crawls websites and extracts clean Markdown and structured content from web pages, PDFs, and Office documents. It supports adaptive rendering, query-focused crawling, and batch extraction for AI agents and RAG pipelines.
    8
    285
    Apache 2.0
  • A
    license
    A
    quality
    D
    maintenance
    Provides privacy-focused web search capabilities through SearXNG metasearch engine, enabling web, image, video, and news searches without tracking. Includes comprehensive research tools that aggregate and analyze results from multiple search engines.
    3
    4
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    It enables agents to invoke six hosted Apify actors for job listings, federal contract notices, sitemap monitoring, page-to-Markdown conversion, site crawling, and bulk screenshots using a user-supplied Apify token.
    6
    MIT
  • A
    license
    A
    quality
    D
    maintenance
    An APAC-native web scraping API for AI agents that provides tools for scraping, crawling, searching, and extracting structured data from websites, directly usable from MCP-compatible clients like Claude Desktop, Cursor, and Windsurf.
    7
    7 npm
    MIT
  • F
    license
    A
    quality
    D
    maintenance
    A local stdio MCP server that exposes compact semantic observations from UI elements annotated with data-agent-* hints, designed to work alongside the official Playwright MCP for browser automation.
    2
    -
  • A
    license
    A
    quality
    D
    maintenance
    Integrates Firecrawl for web scraping, crawling, search, and content extraction capabilities. Supports single/batch scraping, URL discovery, structured data extraction, deep research, and AI-powered web analysis with automatic retries and rate limiting.
    8
    MIT
  • A
    license
    A
    quality
    D
    maintenance
    MCP server for Kagi Search that uses your session token for web and news search without a separate API subscription.
    3
    19 npm
    MIT
  • A
    license
    A
    quality
    D
    maintenance
    TypeScript implementation of an MCP server that provides tools for web crawling, content extraction, and browser automation, enabling AI systems to access and process web content through 15 specialized tools.
    13
    48 npm
    14
    MIT
  • A
    license
    A
    quality
    D
    maintenance
    Integrates Firecrawl web scraping capabilities, enabling web content extraction, crawling, site mapping, search, and structured data extraction with automatic rate limiting and retry handling.
    6
    2
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Enables coding agents to perform computer use across browsers and native Windows apps by observing the screen, reducing it to a finite list of executable candidates, and letting a small decision model choose one action before input is sent and the result verified. It also returns per-goal outcomes, uncertainty handoffs, and run journals so the calling agent can recover from failures.
    7
    MIT
  • A
    license
    A
    quality
    D
    maintenance
    MCP server for DuckDuckGo web search, enabling AI agents to perform real-time text, news, and image searches without an API key.
    3
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    MCP server for web crawling, searching, and AI-powered content extraction, supporting single-page, batch, and full-site crawling along with text, news, image, book, and video search.
    8
    31 PyPI
    1
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    Enables browser automation and web data extraction through MCP tools, including Markdown reading, screenshots, structured data extraction, page inspection, and allowlisted site crawling.
    10
    51 npm
    MIT
  • A
    license
    A
    quality
    A
    maintenance
    Servo-powered MCP server for JS-aware web fetching, content extraction, crawling, and software-rendered screenshots — Chromium-free single binary.
    6
    164
    Apache 2.0
  • A
    license
    A
    quality
    B
    maintenance
    Enables MCP clients to search the web through DuckDuckGo, Google News, and Wikipedia, and to fetch readable text or pretty-printed JSON from web pages without API keys, accounts, or configuration.
    2
    1
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    Enables LLM agents to read any website by scraping and crawling into clean Markdown, automatically bypassing bot detection with residential proxies.
    3
    32 npm
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Enables crawling sites from start URLs and retrieving internal and external links, file download links, HTML tables as rows, and lists, with controls for crawl depth, page limits, sitemaps, robots.txt, and proxy mode.
    1
    110 npm
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    Fast, token-efficient web content extraction tool that converts websites to clean Markdown for AI agents, featuring smart caching, content extraction with Mozilla Readability, and polite crawling capabilities.
    1
    1,450 npm
    163
    MIT
  • A
    license
    A
    quality
    D
    maintenance
    Enables AI assistants to perform real-time web searches, company research, content crawling, LinkedIn searches, and deep research tasks using the Exa AI Search API. Can be deployed locally or on Heroku for remote access.
    2
    1
    MIT
  • F
    license
    A
    quality
    D
    maintenance
    Enables Claude Desktop to perform advanced web scraping and crawling operations, extracting structured data, analyzing website architectures, and discovering content relationships through natural conversation.
    5
    4
    -
  • A
    license
    A
    quality
    C
    maintenance
    Enables crawling WeChat Official Account articles via the mp.weixin.qq.com search interface, including account search, article listing, incremental crawling, and fetching articles as Markdown with local SQLite storage.
    2
    6
    1
    MIT
  • A
    license
    A
    quality
    D
    maintenance
    Enables AI assistants to perform real-time web searches, company research, content crawling, LinkedIn searches, and deep research using the Exa AI Search API. Provides comprehensive web information retrieval capabilities in a safe and controlled manner.
    2
    1
    MIT
  • A
    license
    A
    quality
    D
    maintenance
    Enables web scraping, crawling, and content extraction by integrating with the Firecrawl API. It supports deep research, batch scraping, and automatic rate limiting for both cloud and self-hosted environments.
    8
    1
    MIT
  • A
    license
    A
    quality
    D
    maintenance
    MCP server for internet access across Western and Indian platforms, enabling reading, searching, and hot content retrieval from stocks, news, hackernews, YouTube, GitHub, and more.
    6
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Enables AI agents to search and fetch high-quality information from multiple sources, including general web APIs, Wikipedia, arXiv, Hacker News, Stack Exchange, and Crossref, with optional pro-mode deep research and clean markdown page extraction.
    10
    MIT
  • A
    license
    A
    quality
    D
    maintenance
    Enables web content scanning and analysis by fetching, analyzing, and extracting information from web pages using tools like page fetching, link extraction, site crawling, and more.
    6
    13
    MIT
  • A
    license
    A
    quality
    D
    maintenance
    Description: An MCP server with 15 tools covering web search, scraping, extraction, crawling, and autonomous data gathering via the SearchClaw API. Tagline: "The complete web data pipeline for AI agents — Search, Extract, Crawl in One API."
    15
    1
    MIT
  • A
    license
    A
    quality
    A
    maintenance
    Web scraping, crawling, and structured data extraction for AI agents. 5 tools: scrape (clean markdown from any URL), crawl (entire sites), map (discover URLs), extract (structured JSON), and search. 833ms avg latency, single binary, self-hostable.
    9
    1,277
    AGPL 3.0
  • A
    license
    A
    quality
    C
    maintenance
    Enables local web crawling and scraping through MCP, providing tools to fetch pages as Markdown, extract structured data with CSS selectors, and capture full-page screenshots while managing a shared browser instance.
    3
    1
    -
  • A
    license
    A
    quality
    B
    maintenance
    Provides an LLM client with self-hosted web scraping capabilities including scraping, crawling, mapping, searching, structured data extraction, browser interaction, and deep research, without reliance on paid proxy or CAPTCHA services.
    4
    GPL 3.0
  • A
    license
    A
    quality
    D
    maintenance
    Provides coding agents with live web capabilities including web search, scraping to Markdown, structured extraction, crawling, screenshots, and company lookup, all with zero dependencies.
    8
    5
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Enables read-only access to heise.de news through the official RSS feed and server-rendered pages: top headlines, seven sections, keyword search, front-page top stories, c't magazine articles, and single-article text with honest paywall handling. No API key or login required.
    7
    PolyForm Noncommercial 1.0.0