@aegis-ai/mcp-scraper
This server does not currently have a deployable release on Glama. Follow the repository's setup instructions to install and configure it for your MCP client, including any required credentials and local dependencies.
@aegis-ai/mcp-scraper
MCP server for intelligent web scraping. Supports static pages, JavaScript-rendered SPAs (via Playwright), and natural language data extraction.
Install
# Add to Claude Desktop config (~/.claude/claude_desktop_config.json):
{
"mcpServers": {
"scraper": {
"command": "bunx",
"args": ["@aegis-ai/mcp-scraper"]
}
}
}
# Or run directly:
bunx @aegis-ai/mcp-scraperRelated MCP server: Crawl4AI MCP Server
Tools
scrape
Fetch a web page and return clean text content.
{
"url": "https://news.ycombinator.com",
"js": false,
"selector": ".titleline",
"headers": { "Cookie": "session=abc" }
}extract
Scrape a page and extract structured data using natural language.
{
"url": "https://example.com/products",
"prompt": "Get all product names, prices, and ratings",
"js": true
}batch_scrape
Scrape multiple URLs with rate limiting (1s between requests).
{
"urls": ["https://example.com/page1", "https://example.com/page2"],
"js": false
}Features
Static page fetching (fast, no browser needed)
JavaScript rendering via Playwright (for SPAs)
CSS selector targeting
Custom headers support
Automatic HTML stripping
Content truncation to avoid context overflow
Rate-limited batch scraping
License
MIT - AEGIS AI Cooperative
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
Loading tool schema changelog…
This server cannot be deployed
Maintenance
Related MCP Connectors
Enable language models to perform advanced AI-powered web scraping with enterprise-grade reliabili…
Fetch and extract data from any public web page, even JS-rendered or anti-bot protected
Web scraping for AI agents. Extract text and metadata from any URL worldwide. $0.005/page.
Turn any website into structured JSON data matching your custom schema.
Related MCP Servers
- AlicenseNot gradedqualityDmaintenanceEnables web scraping and document processing with JavaScript execution, anti-detection measures, batch processing, and structured data extraction. Supports multiple formats including markdown, HTML, screenshots, and handles PDFs with OCR capabilities.44 PyPI4MIT
- FlicenseNot gradedqualityDmaintenanceEnables advanced web crawling and content extraction with JavaScript support, AI-powered analysis, PDF/Office document processing, YouTube transcript extraction, Google search integration, and multi-format data export capabilities.2-
- AlicenseAqualityAmaintenanceEnables web scraping, structured data extraction, and screenshot capture with automatic anti-bot bypass, supporting JavaScript rendering, proxy rotation, and tiered pricing.262,618 npm2MIT

spidra-mcp-serverofficial
AlicenseAqualityBmaintenanceEnables AI assistants to scrape pages, batch-process URLs, and crawl entire websites with AI-powered extraction.28133 npmMIT