Real-time web scraping tools

Glama

Search for:

Real-time web scraping tools

View all MCP Servers

Why this server?
This server is designed explicitly to 'scrape and extract data from any website globally,' bypassing anti-bot systems and handling JavaScript, making it an excellent 'real-time crawler tool'.
Thordata MCP Server
xja1023789-collab
-
security
-
license
-
quality
Enables AI models to scrape and extract data from any website globally using Thordata's 195+ country proxy network. Bypasses anti-bot systems and renders JavaScript content, outputting structured data in Markdown, HTML, or Links format.
Last updated -
MIT License
Why this server?
Directly enables 'web scraping and crawling capabilities for LLM clients,' covering both single-page scraping and multi-page website crawling, which fits the definition of a comprehensive crawler tool.
AnyCrawl MCP Server
any4ai
-
security
-
license
-
quality
Enables web scraping and crawling capabilities for LLM clients, supporting single-page scraping, multi-page website crawling, and web search with multiple engines (Playwright, Cheerio, Puppeteer) and flexible output formats including markdown, HTML, text, and screenshots.
Last updated -
16
4
Why this server?
This server is a 'powerful web scraping MCP server' built on the well-known Scrapy framework, indicating professional-grade crawling capabilities.
Scrapy MCP Server
ThreeFish-AI
A
security
-
license
A
quality
A powerful web scraping MCP server built on Scrapy and FastMCP that supports multiple scraping methods (HTTP, Scrapy, browser automation), anti-detection techniques, form handling, and concurrent crawling. Designed for commercial environments with enterprise-grade features like intelligent retry mechanisms, performance monitoring, and configurable data extraction.
Last updated -
10
1
MIT License
Why this server?
Provides AI-powered web scraping, crawling, and structured data extraction, making it a highly intelligent and comprehensive real-time crawler.
ScrapeGraph MCP Serverofficial
ScrapeGraphAI
A
security
-
license
A
quality
A production-ready Model Context Protocol server that enables language models to leverage AI-powered web scraping capabilities, offering tools for transforming webpages to markdown, extracting structured data, and executing AI-powered web searches.
Last updated -
5
41
MIT License
Why this server?
Explicitly defined as a 'web scraping server' supporting multiple formats and content extraction rules, which directly addresses the user's need for a crawling tool.
Web Scraper MCP Server
naku111
A
security
-
license
A
quality
A TypeScript-based web scraping server built on the Model Context Protocol that offers multiple export formats, content extraction rules, and support for both static and dynamic (SPA) websites.
Last updated -
7
14
1
MIT License
Why this server?
Offers tools to 'scrape and extract data' including web search, web page extraction, and screenshot capture, essential functions for a real-time web crawler tool.
Jina AI Remote MCP Serverofficial
jina-ai
A
security
-
license
A
quality
Enables web content extraction, screenshot capture, web search, arXiv paper search, and image search through Jina AI's APIs. Provides tools for reading URLs as markdown, searching the web for current information, and finding academic papers or images.
Last updated -
15
197
Apache 2.0
Why this server?
Enables browser automation and web page interactions, a core technology used for real-time, dynamic web scraping and data extraction.
Playwright MCP
mattreya
-
security
-
license
-
quality
Enables LLMs to perform browser automation and web page interactions using Playwright's accessibility tree instead of screenshots. Provides fast, deterministic web automation through structured data without requiring vision models.
Last updated -
524,380
Apache 2.0
Why this server?
This server focuses on 'web scraping and crawling' data from websites affected by bot detection, making it suitable for acquiring real-time data from challenging sources.
ScrAPI MCP Server
DevEnterpriseSoftware
A
security
-
license
A
quality
A server that enables web scraping of difficult-to-access websites affected by bot detection, captchas, or geolocation restrictions, returning results in either HTML or Markdown format.
Last updated -
2
21
13
Why this server?
Explicitly covers 'web searching and webpage scraping' using crawler technology, making it a fitting tool for gathering web data.
Spider MCP
Bosegluon2
A
security
-
license
A
quality
Enables web searching and webpage scraping using pure crawler technology without requiring official APIs. Supports Bing web and news search, batch webpage scraping, and content extraction through Puppeteer automation.
Last updated -
4
1
MIT License
Why this server?
Provides tools for 'browser automation' and 'network traffic capture,' functions crucial for deep inspection and extraction of real-time data from web applications.
WebScout MCP
pyscout
A
security
-
license
A
quality
Enables reverse engineering of web applications and chat interfaces through browser automation, network traffic capture, and streaming API discovery. Provides comprehensive tools for analyzing network patterns, capturing streaming responses, and automating complex web interactions.
Last updated -
14
2

ScrapeGraph MCP Serverofficial

Jina AI Remote MCP Serverofficial