Click on "Deploy Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type @ followed by the MCP server name and your instructions, e.g., "@agent-scrape scrape https://example.com into markdown"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
Pay-per-call web scraping for AI agents — no API keys, no signup, no account.
Agents connect over MCP (Model Context Protocol), call scrape_url(), get a
402 Payment Required challenge, their wallet pays micro-USDC on Base via the
x402 protocol, and the scraped markdown comes back.
Payment is the auth.
https://scrape.diazites.online/mcp — production MCP endpoint (Base mainnet, x402/USDC).
Agent ──tools/call(scrape_url)──▶ Agent-Scrape
◀── 402 + PAYMENT-REQUIRED ──
── signs USDC payment (wallet) ──▶ Base chain
◀────────── 200 + markdown ────── (verified by facilitator)Related MCP server: mdapi-mcp
Endpoint | Purpose |
| MCP streamable-HTTP endpoint (initialize / tools/list / tools/call) |
| Agent-readable pricing discovery (payTo, price, network) |
| Health check |
| Landing info |
Tool | Price | Description |
| $0.01 USDC | Main content of any page as clean markdown |
Network: Base mainnet (eip155:8453). Assets: USDC
(0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913).
python3 -m venv venv
venv/bin/pip install -r requirements.txt # or: mcp x402 fastapi uvicorn trafilatura httpx
cp .env.example .env # then fill in keys
venv/bin/python app.py # http://0.0.0.0:8093.env)Variable | Required | Description |
| ✅ | Base wallet that receives USDC |
| for payments | Coinbase CDP API key (portal.cdp.coinbase.com) |
| for payments | Coinbase CDP API key secret (PEM or Ed25519) |
|
| |
|
| |
| Price in USD per call (default | |
| Default |
Generate a Base wallet (or use any EVM wallet you control):
python -c "from eth_account import Account; a=Account.create(); print(a.address, a.key.hex())"Put the address in AGENT_SCRAPE_PAY_TO. Fund it with USDC on Base to withdraw (optional — payments can also stay on-chain).
Create CDP API keys at https://portal.cdp.coinbase.com → API keys. Paste into .env.
Set AGENT_SCRAPE_DEV_MODE=0, restart. GET /pricing now shows production mode.
Agent calls scrape_url → server responds 402 Payment Required with a
PAYMENT-REQUIRED header (base64 JSON: scheme exact, network
eip155:8453, USDC amount, payTo wallet).
Agent's x402-capable wallet (Coinbase Smart Wallet, any EIP-3009 signer) signs a USDC payment authorization.
Server verifies via the Coinbase CDP x402 facilitator (verify → settle on Base).
On success the tool executes and the markdown is returned with a
PAYMENT-RESPONSE settlement header.
Dev mode (AGENT_SCRAPE_DEV_MODE=1) skips steps 1-3 for testing.
# demo client (dev mode or production)
venv/bin/python e2e_test.py http://localhost:8093/mcp https://example.com
# see the 402 challenge a real agent gets
curl -s -i -X POST http://localhost:8093/mcp \
-H "Content-Type: application/json" -H "Accept: application/json" \
-d '{"jsonrpc":"2.0","id":1,"method":"initialize","params":{"protocolVersion":"2025-06-18","capabilities":{},"clientInfo":{"name":"x","version":"1"}}}'MIT. Payments protocol: x402 (Apache-2.0).
This server cannot be deployed
Programmatic web-scraping MCP server powered by x402 micro-transactions on Base.
Stealth scraping API for AI agents. Clean Markdown from any URL. x402 crypto payments.
Pay-per-call web scraping for AI agents via x402 on Base USDC. Six tools, no signup.
Read web pages and PDFs as clean Markdown for AI agents. Pay per call in USDC via x402, no API key.
