Fetches public posts from a subreddit via the official Reddit API.
Click on "Deploy Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type @ followed by the MCP server name and your instructions, e.g., "@Wafle-Scraper scrape the front page of Hacker News"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
██╗ ██╗ █████╗ ███████╗██╗ ███████╗
██║ ██║ ██╔══██╗ ██╔════╝██║ ██╔════╝
██║ █╗ ██║ ███████║ █████╗ ██║ █████╗
██║███╗██║ ██╔══██║ ██╔══╝ ██║ ██╔══╝
╚███╔███╔╝ ██║ ██║ ██║ ███████╗███████║
╚══╝╚══╝ ╚═╝ ╚═╝ ╚═╝ ╚══════╝╚══════╝Wafle-Scraper is an MCP server that lets AI agents (OpenCode, Claude, Cursor) extract data from the web safely and responsibly.
Rule | Enforcement |
No private data | Every browser session is incognito — no cookies, no localStorage, no saved passwords |
Only what you ask | The scraper never mines extra data beyond your explicit request |
No localhost | Internal/private IPs are blocked by default |
Rate limited | Minimum 2 seconds between requests — never floods servers |
CAPTCHA = human only | No automated CAPTCHA solving. If one appears, you solve it interactively |
User-Agent rotation | Each request looks like a real browser |
Related MCP server: sessemi-mcp
pip install wafle-scraper
playwright install chromium
wafle-scraper{
"mcpServers": {
"wafle-scraper": {
"command": "wafle-scraper",
"description": "Web scraping & browser automation — incognito, audited, safe"
}
}
}wafle-scraper # MCP stdio mode (default for agents)
wafle-scraper --http --port 8000 # HTTP SSE mode
wafle-scraper --version # Show versionTool | Description | Safety |
| Extract text from a static URL (requests + BeautifulSoup) | ✅ Read-only, no JS |
| Navigate a page in isolated incognito browser and extract text | ✅ Incognito, no cookies |
| Fetch public posts from a subreddit via official API | ✅ API, no scraping |
| Find email addresses on a public page | ✅ Only what you ask |
| Click, type, scroll, extract, screenshot in live browser | ✅ You control the actions |
Incognito always: storage_state=None, fresh context per session
No permissions: No camera, mic, location access
Anti-detection: Rotating UA, viewport, locale, timezone
Natural delays: Human-like timing between actions
Gradual scroll: Loads lazy content naturally
Wafle-Scraper does NOT solve CAPTCHAs automatically. When a CAPTCHA is detected:
The scraper pauses
Prompts you to open the URL in your browser
You solve the CAPTCHA manually
Type done and the scraper continues
This is the only ethical and reliable approach without paid services.
Blocked: localhost, 127.0.0.1, private IPs, file://, chrome://
Rate limiting (configurable, default 2s min interval)
Scope enforcement — only processes what you explicitly request
User-Agent rotation
Browser isolation — Playwright contexts are fully sandboxed
Python 3.10+
Playwright with Chromium installed (playwright install chromium)
Windows, macOS, Linux
Standalone — no other MCP servers required.
Issue | Detail | Status |
CDP health check unstable |
| 🟡 Medium |
CAPTCHA handler is interactive only | CAPTCHA solver relies on stdin — doesn't work in MCP server mode (no stdin available in stdio transport). | 🔴 High |
| No exponential backoff, no proxy fallback. If 2 attempts fail, the whole scrape fails. | 🟡 Medium |
Error strings instead of exceptions |
| 🟡 Medium |
Single browser context | Only 1 context at a time. Concurrent | 🔴 High |
Reddit HTML fallback is silent | If JSON API fails, falls back to | 🟢 Low |
git clone https://github.com/creandoaldia/wafle-scraper.git
cd wafle-scraper
pip install -e .
playwright install chromiumMIT
Part of the WAFLE ecosystem (Web AI Framework for Language Ecosystems). Wafle-Scraper gives WAFLE agents the ability to read the live web — safely, transparently, and under your control.
Interact with the active browser page (click, type, extract).
Inputs: action (required), value, selector. Returns: result
Find email addresses on a public page.
Inputs: url (required). Returns: result
Navigate a page in an isolated incognito browser and extract text.
Inputs: url (required), scroll, wait_selector. Returns: result
Fetch public posts from a subreddit via the official Reddit API.
Inputs: subreddit (required), sort, limit. Returns: result
Extract readable text content from a static URL.
Inputs: url (required), extract_links, extract_images. Returns: result
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
Loading tool schema changelog…
Scored across 5 tools
Most tools have clear purposes: extract_emails, scrape_reddit, and scrape_url are distinct. However, browser_interact and scrape_browser both involve browser interaction, potentially causing confusion despite different contexts (active page vs. isolated browser).
Tools use snake_case but mix patterns: 'browser_interact' is noun_verb, while others like 'extract_emails' and 'scrape_browser' are verb_noun. The inconsistent placement of 'browser' in two tool names adds confusion.
With 5 tools, the server covers static scraping, browser scraping, interaction, email extraction, and Reddit API access. This is a well-scoped set for a scraping-focused server.
The tool set covers core scraping needs: static URLs, dynamic pages, specific platform (Reddit), email extraction, and interaction. Minor gaps like handling pagination or form submission exist but are acceptable for this scope.
Web scraping, search, crawling, structured extraction and research for AI agents.
Web search, browser automation, scraping, crawling and CAPTCHA solving for AI agents.
Proxy-rotated web scraping and cross-platform intelligence for AI agents.
Web data for agents. Extract web pages, crawl websites, discover URLs, and search the web.
