x402-scraper-mcp
This server does not currently have a deployable release on Glama. Follow the repository's setup instructions to install and configure it for your MCP client, including any required credentials and local dependencies.
@massnerder/x402-scraper-mcp
Multi-Tier Web Scraper & Structured Data MCP Gateway powered by x402 micropayments on Base (USDC).
Live Gateway:
https://fretful-flap.ngrok.devMCP SSE Endpoint:
https://fretful-flap.ngrok.dev/mcp/sseService Info:
https://fretful-flap.ngrok.dev/get_service_info
Tools & Pricing (Base Mainnet USDC)
Tool | Price (USDC) | What It Does |
| $0.01 | Fast HTML-to-Markdown cleanup for unprotected pages. |
| $0.01 | Extracts up to 200 URLs from XML sitemaps or RSS feeds. |
| $0.05 | Extracts Schema.org JSON-LD, OpenGraph, and metadata with residential proxy fallback. |
| $0.10 | Anti-bot web scraper with rotating residential proxy bypass for Cloudflare and geo-blocks. |
| $0.25 | Concurrent extraction of up to 5 URLs in one call with residential proxy support. |
Related MCP server: Crawlberg MCP Server
Quick Install (Claude Desktop / Cursor / Cline)
Add this block to your MCP client configuration file:
{
"mcpServers": {
"x402-web-scraper": {
"command": "npx",
"args": ["-y", "@massnerder/x402-scraper-mcp"],
"env": {
"X402_PAYMENT_HASH": "0xYOUR_BASE_USDC_TX_HASH"
}
}
}
}Direct SSE Connection (No Install Required)
If your agent framework supports remote SSE endpoints directly:
URL:
https://fretful-flap.ngrok.dev/mcp/sseHeader:
X-402-Payment: <Base_Mainnet_USDC_Tx_Hash>
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
Loading tool schema changelog…
This server cannot be deployed
Maintenance
Related MCP Connectors
Web data for agents. Extract web pages, crawl websites, discover URLs, and search the web.
Web scraping for agents. Point it at a URL and it returns the page as clean markdown, JavaScript-rendered pages included. Point it at a site and it maps the URLs or crawls the section you need in the background, a few pages at a time so results fit in the conversation. Search the web and read full pages, extract fields with a JSON schema you define (validated, never invented), read a store's catalogue or a blog's posts from the platform's own feed, and check whether a page has changed. Failed requests cost nothing. The free plan includes 1,500 credits a month.
Unblocking and fresh web data for agents: URL to Markdown, YouTube, Maps, Amazon, jobs. Pay per call
Web scraping, search, crawling, structured extraction and research for AI agents.
Related MCP Servers
AlicenseAqualityBmaintenanceEnables AI assistants to scrape pages, batch-process URLs, and crawl entire websites with AI-powered extraction.28512 npmMIT- AlicenseNot gradedqualityAmaintenanceEnables AI agents to crawl and scrape websites, converting HTML to clean Markdown and structured metadata with support for JavaScript rendering, bot evasion, and SSRF protection.196MIT
- AlicenseNot gradedqualityCmaintenanceEnables agents to scrape, crawl, map, search, and extract web pages as clean markdown or structured JSON directly through MCP tools.AGPL 3.0
- FlicenseNot gradedqualityAmaintenanceEnables AI agents to search the web through configured providers and crawl individual pages or entire sites into clean, deduplicated Markdown or JSON, including authenticated pages.-