x402 Scraper Engine
This server lets you scrape, summarize, audit, search the web, and query Twitter/X through paid x402 microtransactions on Base.
Scrape webpages into clean, token-efficient Markdown for LLM ingestion (
clean_web_scrape, 0.005 USDC).Synthesize webpage content with Edge Llama 3 into executive summaries, key takeaways, and structured entities, optionally focused on a topic (
synthesize_web_digest, 0.025 USDC).Audit websites or smart contract pages for security, credibility, phishing risk, and a 0–100 credibility score (
audit_web_signal, 0.080 USDC).Run deep web research across multiple sources and return Markdown summaries from top results (
clean_web_search, 0.05 USDC).Search Twitter/X for tweets, cashtags, topics, and sentiment without the $100/mo API fee (
twitter_search, 0.05 USDC).Look up Twitter/X profiles to get public bios and recent tweets for any handle (
twitter_profile_lookup, 0.03 USDC).
Uses Cloudflare Workers AI to perform edge LLM context synthesis, generating token-dense Llama 3 digests and entity extraction from webpages.
⚡ x402 Multi-Tier Agent Intelligence & Scraper Engine
Production Multi-Tiered Agent Intelligence & Context Compression API running natively on Base L2 USDC with HTTP 402 micro-settlement.
Convert webpages into clean Markdown, synthesize token-dense Llama 3 digests, audit smart contracts/websites for security risks, or query Twitter sentiment with zero API subscriptions.
🌐 Live Production Endpoints
Resource | URL | Method | Price (Base USDC) | Description |
Health & Info |
|
| Free | Live engine status & pricing catalog |
1-Tap Terminal Read |
|
| 0.005 USDC (2 calls free/IP) | Zero-setup instant Markdown extraction via curl |
Clean Scrape |
|
| 0.005 USDC | Zero-bloat HTML to Markdown extraction |
Recursive Doc Crawl |
|
| 0.250 USDC | Recursive documentation tree crawler (up to 25 pages) |
PDF Stream Parser |
|
| 0.050 USDC | Multi-page whitepaper & academic PDF stream extraction |
Structured JSON |
|
| 0.030 USDC | Schema-validated structured JSON via Edge Llama 3 |
Edge LLM Digest |
|
| 0.025 USDC | Llama 3 Edge Context Synthesis & entity extraction |
Security Signal Audit |
|
| 0.080 USDC | Phishing, contract & credibility risk scoring |
Deep Web Search |
|
| 0.050 USDC | Multi-source web research & synthesized summaries |
Twitter Search |
|
| 0.050 USDC | Cashtags ( |
Twitter Profile |
|
| 0.030 USDC | Bio & recent tweets for any handle |
Bazaar Discovery |
|
| Free | x402 V2 + Bazaar machine discovery |
OpenAPI 3.1 Spec |
|
| Free | Full machine-readable schema |
Related MCP server: Santos Automation
💡 Why Multi-Tiered x402?
Zero Signups & No API Keys: No credit cards, accounts, or monthly commitments.
Pay-Per-Call Micropayments: $0.005 to $0.080 USDC on Base L2 instead of $50–$100/mo SaaS subscriptions.
Context Compression Savings:
/v1/digestsaves 80%+ on downstream Claude/GPT-4o token bills by summarizing 10,000 words into a dense 300-word structured brief on the edge.Crypto Agent Security:
/v1/auditprovides instantaneous scam, drainer, and contract safety checks before agents execute transactions.Bypasses X API Paywall: Query real-time Twitter sentiment and profiles without the $100/mo fee.
x402 V2 + Bazaar Standard: Compatible with automated agent marketplaces (Agentic.market, LangChain, Coinbase AgentKit).
🚀 Quickstart: cURL Examples
1. Instant 1-Tap Terminal Read (2 calls free per IP, then 0.005 USDC)
# Direct terminal extraction - zero JSON or headers required
curl https://x402-scraper-engine.gejoe-tt.workers.dev/read/https://news.ycombinator.com2. Recursive Documentation Crawler (0.250 USDC)
# Crawls documentation trees (up to 25 pages) into unified Table-of-Contents Markdown
curl -i -X POST https://x402-scraper-engine.gejoe-tt.workers.dev/v1/crawl \
-H "Content-Type: application/json" \
-d '{"url": "https://react.dev", "maxPages": 15}'3. Whitepaper & Academic PDF Stream (0.050 USDC)
# Extracts clean Markdown directly from edge V8 isolate in ~1.4s
curl -i -X POST https://x402-scraper-engine.gejoe-tt.workers.dev/v1/pdf \
-H "Content-Type: application/json" \
-d '{"url": "https://bitcoin.org/bitcoin.pdf"}'4. Clean Webpage Scrape (0.005 USDC)
# Challenge request (returns HTTP 402 with PAYMENT-REQUIRED header)
curl -i -X POST https://x402-scraper-engine.gejoe-tt.workers.dev/v1/scrape \
-H "Content-Type: application/json" \
-d '{"url": "https://news.ycombinator.com"}'
# Resubmit with Base L2 Transaction Receipt
curl -X POST https://x402-scraper-engine.gejoe-tt.workers.dev/v1/scrape \
-H "Content-Type: application/json" \
-H "X-Payment-Receipt: 0x...your_tx_hash..." \
-d '{"url": "https://news.ycombinator.com"}'5. Edge LLM Context Synthesis (0.025 USDC)
curl -i -X POST https://x402-scraper-engine.gejoe-tt.workers.dev/v1/digest \
-H "Content-Type: application/json" \
-d '{"url": "https://docs.base.org", "focus": "smart contract deployment"}'🛡️ Ecosystem Security Integration: BountyHunter AI
Autonomous agents consuming external web links should always verify payload safety before injecting text into LLM prompts. We recommend routing pre-flight URL risk checks through our Base L2 partner BountyHunter AI (@dextermos-dev):
Endpoint:
POST https://tea-airplane-trunk-define.trycloudflare.com/api/v1/shield/urlPrice:
0.50 USDC(RFC-x402 on Base L2)Settlement: Canonical USDC (
0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913) to Settlement Wallet0x8366bCe3a2D379De7656D7A67015789FaF999f20.Capability: Real-time detection of prompt injections, malicious payloads, and phishing links in target web content.
🤖 Model Context Protocol (MCP) Configuration
Add the 6-tool suite to Claude Desktop, Cursor, Windsurf, or ElizaOS:
{
"mcpServers": {
"x402-agent-intelligence": {
"command": "npx",
"args": ["-y", "github:ami-guru/x402-scraper-engine"],
"env": {
"BASE_RPC_URL": "https://mainnet.base.org",
"AGENT_PRIVATE_KEY": "0xYourAgentFundedPrivateKey"
}
}
}
}⚡ Autonomous Agent TypeScript SDK (3 Lines of Code)
Import into any Coinbase AgentKit, ElizaOS, LangChain, or custom bot:
import { X402Client } from 'x402-scraper-engine/client';
const agentClient = new X402Client({
privateKey: process.env.AGENT_PRIVATE_KEY, // Base L2 wallet
rpcUrl: 'https://mainnet.base.org'
});
// 1. Scrape webpage to clean Markdown (0.005 USDC)
const page = await agentClient.scrape('https://news.ycombinator.com');
// 2. Synthesize token-dense context with Edge Llama 3 (0.025 USDC)
const digest = await agentClient.digest('https://docs.base.org', 'deployment');
// 3. Search real-time Twitter/X sentiment without $100/mo API fee (0.050 USDC)
const tweets = await agentClient.searchTwitter('$BASE');
// 4. Security & Phishing audit for DeFi sites (0.080 USDC)
const security = await agentClient.audit('https://suspicious-dex.com');📄 License
MIT © 2026 ASOT Marketing and Investment
Available Tools
6 toolsaudit_web_signalB
Performs security, credibility, and phishing risk analysis for any website or smart contract landing page. Returns credibility score (0-100) and risk signals. Automatically handles HTTP 402 microtransactions (0.080 USDC on Base).
Inputs: url (required), contract_address.
clean_web_scrapeA
Scrapes any public webpage and returns clean, sanitized, token-efficient Markdown for LLM ingestion. Automatically handles HTTP 402 microtransactions (0.005 USDC on Base) if required.
Inputs: url (required).
clean_web_searchB
Performs deep web research across multiple sources, extracting clean Markdown summaries from top results. Automatically handles HTTP 402 microtransactions (0.05 USDC on Base).
Inputs: query (required), limit.
synthesize_web_digestB
Scrapes target webpage and executes Edge LLM (Llama 3) context synthesis to extract executive summary, key takeaways, and structured entities. Automatically handles HTTP 402 microtransactions (0.025 USDC on Base).
Inputs: url (required), focus.
twitter_profile_lookupA
Extracts public Twitter/X profile bio and recent tweets for any username without the $100/mo API fee. Automatically handles HTTP 402 microtransactions (0.03 USDC on Base).
Inputs: username (required).
twitter_searchA
Searches public tweets, cashtags ($BTC, $BASE), and sentiment across Twitter/X without the $100/mo API fee. Automatically handles HTTP 402 microtransactions (0.05 USDC on Base).
Inputs: query (required), limit.
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
Loading tool schema changelog…
TDQS
Scored across 6 tools
Tools target distinct actions: single-page scraping, LLM synthesis, security audit, web search, Twitter search, and Twitter profile lookup. Minor overlap exists between clean_web_scrape and synthesize_web_digest since both scrape a target page, but the different output types make them distinguishable.
All names use snake_case, but verb patterns are mixed: clean_web_scrape and clean_web_search start with an adjective-like 'clean', while synthesize_web_digest and audit_web_signal follow verb_noun, and twitter_search / twitter_profile_lookup are noun-based. Readable overall, but lacks a single predictable convention.
Six tools is well-scoped for a scraper engine covering web scraping, synthesis, auditing, search, and Twitter endpoints. Each tool earns its place without obvious redundancy.
The surface covers core scraping, synthesis, security audit, web search, and Twitter search/profile operations. Minor gaps like batch crawling or structured extraction beyond the LLM digest could be workarounds, but no critical lifecycle operation is missing for this read-oriented domain.
Maintenance
Related MCP Connectors
Autonomous HTTP 402 Web Scraping Mesh on Base for $0.02 USDC.
Pay-per-call web reader (Markdown/RAG chunks) and agent utilities; x402 USDC on Base.
Pay-per-call web scraping for AI agents via x402 on Base USDC. Six tools, no signup.
Pay-per-call (x402/USDC-Base) web + crypto data tools for AI agents: audit, extract, crypto, DeFi.
Related MCP Servers
- AlicenseAqualityBmaintenancePay-per-call web scraping for AI agents — no signup, no API keys, just USDC micropayments via the x402 protocol on Base62MIT
- AlicenseNot gradedqualityBmaintenanceWebsite intelligence tools for AI agents. Ten pay-per-call tools via x402 micropayments (USDC on Base) — no accounts, no API keys.1MIT
- AlicenseAqualityBmaintenance⚡ 87% Token-compressed clean web scraping, YouTube AI transcripts, and PDF extraction for LLMs. Instant Free Trial with zero setup (No wallet/crypto required). Supports gasless agent vaults and EIP-712 on-chain oracle verification on Polygon, Base & Arbitrum.144MIT
- AlicenseNot gradedqualityCmaintenanceEnables machine-payable, zero-subscription AI utility tools via HTTP 402 on Base and Solana, including markdown web scraping, prompt injection detection, Solana token audits, and domain intelligence.MIT