F
licenseB
qualityD
maintenanceAn MCP Server for Web scraping and Crawling, built using Crawl4AI
2
24
-
rubber-duck-scraper
Click on "Deploy Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@rubber-duck-scraperscrape the metadata and tables from https://example.com"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
web-lens
Python MCP server with Playwright JS rendering, table extraction, and screenshots.
Tools (3)
Tool | Description |
| Fetch any URL and extract content intelligently |
| Screenshot URL → inline PNG in Claude |
| All HTML tables → clean JSON row arrays |
Related MCP server: mcp-server-scraper
Setup
cd /Users/dev/Desktop/development/azure/Fahad/web-lens
python -m venv .venv
source .venv/bin/activate
pip install -r requirements.txt
python -m playwright install chromiumClaude Desktop Config
Add to ~/Library/Application Support/Claude/claude_desktop_config.json:
{
"mcpServers": {
"web-lens": {
"command": "/Users/dev/Desktop/development/azure/Fahad/web-lens/.venv/bin/python",
"args": ["/Users/dev/Desktop/development/azure/Fahad/web-lens/src/server.py"]
}
}
}Test with MCP Inspector
cd /Users/dev/Desktop/development/azure/Fahad/web-lens
npx @modelcontextprotocol/inspector .venv/bin/python src/server.pyThis server cannot be deployed
Maintenance
ActivityInactive
ResponsivenessNo issues
Related MCP Connectors
MCP server for Firecrawl — web search, scraping, and biomedical/arXiv paper search.
MCP server for web extraction and rendering via AceDataCloud WebExtrator
Programmatic web-scraping MCP server powered by x402 micro-transactions on Base.
One MCP server for 180+ live web-data APIs returning clean JSON from sites that block scrapers.
Related MCP Servers
- AlicenseAqualityBmaintenanceMCP server for web scraping — extract clean markdown, links, and metadata from any URL. Free Firecrawl alternative.5232 npm6MIT
- AlicenseAqualityDmaintenanceA headless web-scraping MCP server built on Scrapy, providing tools for polite fetching, CSS/XPath extraction, link/table extraction, sitemap and robots.txt reading, and bounded asynchronous crawls.10MIT
- AlicenseNot gradedqualityCmaintenanceA Python MCP server that extracts URLs, page content (with browser rendering fallback), and text from images via OCR.1ISC