F
licenseB
qualityD
maintenanceAn MCP Server for Web scraping and Crawling, built using Crawl4AI
2
24
-
rubber-duck-scraper
Click on "Deploy Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@rubber-duck-scraperscrape the metadata and tables from https://example.com"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
web-lens
Python MCP server with Playwright JS rendering, table extraction, and screenshots.
Tools (3)
Tool | Description |
| Fetch any URL and extract content intelligently |
| Screenshot URL → inline PNG in Claude |
| All HTML tables → clean JSON row arrays |
Related MCP server: mcp-server-scraper
Setup
cd /Users/dev/Desktop/development/azure/Fahad/web-lens
python -m venv .venv
source .venv/bin/activate
pip install -r requirements.txt
python -m playwright install chromiumClaude Desktop Config
Add to ~/Library/Application Support/Claude/claude_desktop_config.json:
{
"mcpServers": {
"web-lens": {
"command": "/Users/dev/Desktop/development/azure/Fahad/web-lens/.venv/bin/python",
"args": ["/Users/dev/Desktop/development/azure/Fahad/web-lens/src/server.py"]
}
}
}Test with MCP Inspector
cd /Users/dev/Desktop/development/azure/Fahad/web-lens
npx @modelcontextprotocol/inspector .venv/bin/python src/server.pyThis server cannot be deployed
Maintenance
ActivityInactive
ResponsivenessNo issues
Related MCP Connectors
Web scraping MCP server: any URL to Markdown or JSON, with JavaScript rendering and batch jobs.
One MCP server for all web data. Scrape, search, crawl, and AI research in one install.
MCP server for web extraction and rendering via AceDataCloud WebExtrator
Programmatic web-scraping MCP server powered by x402 micro-transactions on Base.
Related MCP Servers
- AlicenseAqualityBmaintenanceMCP server for web scraping — extract clean markdown, links, and metadata from any URL. Free Firecrawl alternative.562 npm6MIT
- AlicenseAqualityDmaintenanceA headless web-scraping MCP server built on Scrapy, providing tools for polite fetching, CSS/XPath extraction, link/table extraction, sitemap and robots.txt reading, and bounded asynchronous crawls.10MIT
- AlicenseNot gradedqualityDmaintenanceA Python MCP server that extracts URLs, page content (with browser rendering fallback), and text from images via OCR.1ISC