F
licenseB
qualityD
maintenanceAn MCP Server for Web scraping and Crawling, built using Crawl4AI
2
24
-
rubber-duck-scraper
Click on "Deploy Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@rubber-duck-scraperscrape the metadata and tables from https://example.com"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
web-lens
Python MCP server with Playwright JS rendering, table extraction, and screenshots.
Tools (3)
Tool | Description |
| Fetch any URL and extract content intelligently |
| Screenshot URL → inline PNG in Claude |
| All HTML tables → clean JSON row arrays |
Related MCP server: mcp-server-scraper
Setup
cd /Users/dev/Desktop/development/azure/Fahad/web-lens
python -m venv .venv
source .venv/bin/activate
pip install -r requirements.txt
python -m playwright install chromiumClaude Desktop Config
Add to ~/Library/Application Support/Claude/claude_desktop_config.json:
{
"mcpServers": {
"web-lens": {
"command": "/Users/dev/Desktop/development/azure/Fahad/web-lens/.venv/bin/python",
"args": ["/Users/dev/Desktop/development/azure/Fahad/web-lens/src/server.py"]
}
}
}Test with MCP Inspector
cd /Users/dev/Desktop/development/azure/Fahad/web-lens
npx @modelcontextprotocol/inspector .venv/bin/python src/server.pyThis server cannot be deployed
Maintenance
ActivityInactive
ResponsivenessNo issues
Related MCP Connectors
MCP server for web extraction and rendering via AceDataCloud WebExtrator
One MCP server for 180+ live web-data APIs returning clean JSON from sites that block scrapers.
One MCP for the Web. Easily search, crawl, navigate, and extract websites without getting blocked.…
Free remote MCP server for fetching public web pages through a rotating proxy pool.
Related MCP Servers
- AlicenseAqualityBmaintenanceMCP server for web scraping — extract clean markdown, links, and metadata from any URL. Free Firecrawl alternative.562 npm6MIT
- AlicenseAqualityDmaintenanceA headless web-scraping MCP server built on Scrapy, providing tools for polite fetching, CSS/XPath extraction, link/table extraction, sitemap and robots.txt reading, and bounded asynchronous crawls.10MIT
- AlicenseNot gradedqualityBmaintenanceA Python MCP server that extracts URLs, page content (with browser rendering fallback), and text from images via OCR.1ISC