agent-scrape
Click on "Deploy Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@agent-scrapescrape https://example.com into markdown"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
Agent-Scrape
Pay-per-call web scraping for AI agents — no API keys, no signup, no account.
Agents connect over MCP (Model Context Protocol), call scrape_url(), get a
402 Payment Required challenge, their wallet pays micro-USDC on Base via the
x402 protocol, and the scraped markdown comes back.
Payment is the auth.
Live endpoint
https://scrape.diazites.online/mcp — production MCP endpoint (Base mainnet, x402/USDC).
Agent ──tools/call(scrape_url)──▶ Agent-Scrape
◀── 402 + PAYMENT-REQUIRED ──
── signs USDC payment (wallet) ──▶ Base chain
◀────────── 200 + markdown ────── (verified by facilitator)Related MCP server: mdapi-mcp
Endpoints
Endpoint | Purpose |
| MCP streamable-HTTP endpoint (initialize / tools/list / tools/call) |
| Agent-readable pricing discovery (payTo, price, network) |
| Health check |
| Landing info |
Tool pricing
Tool | Price | Description |
| $0.01 USDC | Main content of any page as clean markdown |
Network: Base mainnet (eip155:8453). Assets: USDC
(0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913).
Run it
python3 -m venv venv
venv/bin/pip install -r requirements.txt # or: mcp x402 fastapi uvicorn trafilatura httpx
cp .env.example .env # then fill in keys
venv/bin/python app.py # http://0.0.0.0:8093Configuration (.env)
Variable | Required | Description |
| ✅ | Base wallet that receives USDC |
| for payments | Coinbase CDP API key (portal.cdp.coinbase.com) |
| for payments | Coinbase CDP API key secret (PEM or Ed25519) |
|
| |
|
| |
| Price in USD per call (default | |
| Default |
Seller setup (5 minutes, free)
Generate a Base wallet (or use any EVM wallet you control):
python -c "from eth_account import Account; a=Account.create(); print(a.address, a.key.hex())"Put the address in
AGENT_SCRAPE_PAY_TO. Fund it with USDC on Base to withdraw (optional — payments can also stay on-chain).Create CDP API keys at https://portal.cdp.coinbase.com → API keys. Paste into
.env.Set
AGENT_SCRAPE_DEV_MODE=0, restart.GET /pricingnow shows production mode.
How the payment flow works
Agent calls
scrape_url→ server responds402 Payment Requiredwith aPAYMENT-REQUIREDheader (base64 JSON: schemeexact, networkeip155:8453, USDC amount,payTowallet).Agent's x402-capable wallet (Coinbase Smart Wallet, any EIP-3009 signer) signs a USDC payment authorization.
Server verifies via the Coinbase CDP x402 facilitator (verify → settle on Base).
On success the tool executes and the markdown is returned with a
PAYMENT-RESPONSEsettlement header.
Dev mode (AGENT_SCRAPE_DEV_MODE=1) skips steps 1-3 for testing.
Try it
# demo client (dev mode or production)
venv/bin/python e2e_test.py http://localhost:8093/mcp https://example.com
# see the 402 challenge a real agent gets
curl -s -i -X POST http://localhost:8093/mcp \
-H "Content-Type: application/json" -H "Accept: application/json" \
-d '{"jsonrpc":"2.0","id":1,"method":"initialize","params":{"protocolVersion":"2025-06-18","capabilities":{},"clientInfo":{"name":"x","version":"1"}}}'License
MIT. Payments protocol: x402 (Apache-2.0).
This server cannot be deployed
Maintenance
Related MCP Connectors
Stealth scraping API for AI agents. Clean Markdown from any URL. x402 crypto payments.
Pay-per-call web scraping for AI agents via x402 on Base USDC. Six tools, no signup.
Pay-per-request webpage-to-Markdown extraction for AI agents. $0.005 USDC via x402 on Solana.
x402 MCP web parser: URLs to Markdown for agents. USDC on Base, Polygon, Arbitrum, Ethereum.
Related MCP Servers
- AlicenseAqualityAmaintenanceContext-efficient MCP server for AI agents. fetch_extract reduces token usage by a median 98.1% (53,820 → 2,001 tokens) vs raw HTML — saves ~$0.156/call at Sonnet pricing. Pay $0.02 USDC on Base via x402. First call free per wallet. 10 always-free utility tools included.331MIT
- AlicenseNot gradedqualityCmaintenanceMCP server for converting HTML to Markdown and extracting page data, with pay-per-call using USDC on Base.MIT

fetcher.cloudofficial
AlicenseNot gradedqualityDmaintenanceMCP server that gives AI agents web capabilities such as rendering pages, extracting content, resolving links, and inspecting domains, with per-call USDC payments via x402.MIT
nanoparse-mcpofficial
AlicenseAqualityBmaintenanceMCP server that enables AI agents to fetch web content as clean, structured Markdown via NanoParse's hosted API, using x402 micropayments in USDC on Base.134 npmMIT