x402 Scraper Engine
Uses Cloudflare Workers AI to perform edge LLM context synthesis, generating token-dense Llama 3 digests and entity extraction from webpages.
⚡ x402 Multi-Tier Agent Intelligence & Scraper Engine
Production Multi-Tiered Agent Intelligence & Context Compression API running natively on Base L2 USDC with HTTP 402 micro-settlement.
Convert webpages into clean Markdown, synthesize token-dense Llama 3 digests, audit smart contracts/websites for security risks, or query Twitter sentiment with zero API subscriptions.
🌐 Live Production Endpoints
Resource | URL | Method | Price (Base USDC) | Description |
Health & Info |
|
| Free | Live engine status & pricing catalog |
Clean Scrape |
|
| 0.005 USDC | Zero-bloat HTML to Markdown extraction |
Edge LLM Digest |
|
| 0.025 USDC | Llama 3 Edge Context Synthesis & entity extraction |
Security Signal Audit |
|
| 0.080 USDC | Phishing, contract & credibility risk scoring |
Deep Web Search |
|
| 0.050 USDC | Multi-source web research & synthesized summaries |
Twitter Search |
|
| 0.050 USDC | Cashtags ( |
Twitter Profile |
|
| 0.030 USDC | Bio & recent tweets for any handle |
Bazaar Discovery |
|
| Free | x402 V2 + Bazaar machine discovery |
OpenAPI 3.1 Spec |
|
| Free | Full machine-readable schema |
Related MCP server: Santos Automation
💡 Why Multi-Tiered x402?
Zero Signups & No API Keys: No credit cards, accounts, or monthly commitments.
Pay-Per-Call Micropayments: $0.005 to $0.080 USDC on Base L2 instead of $50–$100/mo SaaS subscriptions.
Context Compression Savings:
/v1/digestsaves 80%+ on downstream Claude/GPT-4o token bills by summarizing 10,000 words into a dense 300-word structured brief on the edge.Crypto Agent Security:
/v1/auditprovides instantaneous scam, drainer, and contract safety checks before agents execute transactions.Bypasses X API Paywall: Query real-time Twitter sentiment and profiles without the $100/mo fee.
x402 V2 + Bazaar Standard: Compatible with automated agent marketplaces (Agentic.market, LangChain, Coinbase AgentKit).
🚀 Quickstart: cURL Examples
1. Scrape Webpage (0.005 USDC)
# Challenge request (returns HTTP 402 with PAYMENT-REQUIRED header)
curl -i -X POST https://x402-scraper-engine.gejoe-tt.workers.dev/v1/scrape \
-H "Content-Type: application/json" \
-d '{"url": "https://news.ycombinator.com"}'
# Resubmit with Base L2 Transaction Receipt
curl -X POST https://x402-scraper-engine.gejoe-tt.workers.dev/v1/scrape \
-H "Content-Type: application/json" \
-H "X-Payment-Receipt: 0x...your_tx_hash..." \
-d '{"url": "https://news.ycombinator.com"}'2. Edge LLM Context Synthesis (0.025 USDC)
curl -i -X POST https://x402-scraper-engine.gejoe-tt.workers.dev/v1/digest \
-H "Content-Type: application/json" \
-d '{"url": "https://docs.base.org", "focus": "smart contract deployment"}'3. Website & Contract Security Audit (0.080 USDC)
curl -i -X POST https://x402-scraper-engine.gejoe-tt.workers.dev/v1/audit \
-H "Content-Type: application/json" \
-d '{"url": "https://example-dex.org", "contract_address": "0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913"}'🤖 Model Context Protocol (MCP) Configuration
Add the 6-tool suite to Claude Desktop, Cursor, Windsurf, or ElizaOS:
{
"mcpServers": {
"x402-agent-intelligence": {
"command": "npx",
"args": ["-y", "github:ami-guru/x402-scraper-engine"],
"env": {
"BASE_RPC_URL": "https://mainnet.base.org",
"AGENT_PRIVATE_KEY": "0xYourAgentFundedPrivateKey"
}
}
}
}⚡ Autonomous Agent TypeScript SDK (3 Lines of Code)
Import into any Coinbase AgentKit, ElizaOS, LangChain, or custom bot:
import { X402Client } from 'x402-scraper-engine/client';
const agentClient = new X402Client({
privateKey: process.env.AGENT_PRIVATE_KEY, // Base L2 wallet
rpcUrl: 'https://mainnet.base.org'
});
// 1. Scrape webpage to clean Markdown (0.005 USDC)
const page = await agentClient.scrape('https://news.ycombinator.com');
// 2. Synthesize token-dense context with Edge Llama 3 (0.025 USDC)
const digest = await agentClient.digest('https://docs.base.org', 'deployment');
// 3. Search real-time Twitter/X sentiment without $100/mo API fee (0.050 USDC)
const tweets = await agentClient.searchTwitter('$BASE');
// 4. Security & Phishing audit for DeFi sites (0.080 USDC)
const security = await agentClient.audit('https://suspicious-dex.com');📄 License
MIT © 2026 ASOT Marketing and Investment
Available Tools
6 toolsaudit_web_signalB
Performs security, credibility, and phishing risk analysis for any website or smart contract landing page. Returns credibility score (0-100) and risk signals. Automatically handles HTTP 402 microtransactions (0.080 USDC on Base).
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | The webpage URL to audit for security signals. | |
| contract_address | No | Optional 0x EVM smart contract address to verify alongside the web page. |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description carries the full burden, and it does disclose a real behavioral trait the schema cannot: the tool auto-handles an HTTP 402 microtransaction of 0.080 USDC on Base, i.e., it is a paid operation. It also states the return shape (credibility score 0-100 plus risk signals). It omits failure/payment-failure behavior and rate limits, so it is informative but not complete.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Three sentences, front-loaded with what the tool does, followed by what it returns and then the payment caveat. No filler sentences, though the third sentence could be tightened. Structure is clean and scannable.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
With no annotations and no output schema, the description must carry the load. It covers purpose, return shape, and payment handling, but leaves the actual content of 'risk signals,' the failure mode when payment fails, and interaction with contract_address unspecified. Adequate but with clear gaps.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, so both 'url' and 'contract_address' are already documented as the URL to audit and an optional EVM address verified alongside it. The description adds nothing parameter-level beyond the schema, so the baseline of 3 applies.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description names a specific verb (audits/analyzes) and resource (website or smart contract landing page), and specifies the analysis dimensions: security, credibility, and phishing risk. It clearly distinguishes the tool from a generic scrape/search, though it never names a sibling. The purpose is unambiguous without opening the schema.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
It says the tool works 'for any website or smart contract landing page,' which implies a use case, but there is no explicit when-to-use versus alternatives (e.g., clean_web_scrape or clean_web_search) and no exclusions or prerequisites. An agent is left to infer that this is the risk-assessment path rather than the content-retrieval path.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
clean_web_scrapeA
Scrapes any public webpage and returns clean, sanitized, token-efficient Markdown for LLM ingestion. Automatically handles HTTP 402 microtransactions (0.005 USDC on Base) if required.
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | The target webpage URL to scrape (must start with http:// or https://). |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description carries the full behavioral burden and does disclose a non-obvious trait: automatic HTTP 402 microtransaction handling at 0.005 USDC on Base, i.e. this call can incur cost. It leaves out rate limits, JS-rendering behavior, and failure modes for blocked or dynamic pages, so it is good but not complete.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Two sentences, zero filler: the purpose and output contract come first, and the payment caveat follows. Every clause earns its place.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a single-parameter, no-output-schema tool, the description covers purpose, return format, and cost behavior adequately. It stops short of describing how the tool behaves on pages requiring JS, login, or anti-bot measures, which matters for a scraper.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100% with a single well-documented url parameter, so the schema does the heavy lifting and the baseline is 3. The description adds no format or constraint detail (e.g. handling redirects or non-HTML content) beyond what the schema already states.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
States a specific verb (scrapes) and resource (any public webpage), plus the output form (clean, sanitized, token-efficient Markdown for LLM ingestion). This clearly separates it from siblings like clean_web_search or synthesize_web_digest, though no sibling is named explicitly.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description never says when to pick this over clean_web_search or synthesize_web_digest, nor what prerequisites exist. The only implicit guidance is the 'public webpage' scope constraint, which mildly excludes authenticated/private pages but is not framed as usage guidance.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
clean_web_searchB
Performs deep web research across multiple sources, extracting clean Markdown summaries from top results. Automatically handles HTTP 402 microtransactions (0.05 USDC on Base).
| Name | Required | Description | Default |
|---|---|---|---|
| limit | No | Max number of top pages to scrape into summaries (default: 3). | |
| query | Yes | The research search query to look up on the web. |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description carries full behavioral burden. It does disclose a genuinely non-obvious trait: automatic handling of HTTP 402 microtransactions at 0.05 USDC on Base, which tells the agent a cost/payment flow exists. It omits rate limits, whether the operation is read-only, and any failure behavior beyond the 402 case.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Two tight sentences with no filler; the core capability is front-loaded and the payment detail follows. Slightly short of a 5 only because the second sentence is a cost side-note rather than routing or scoping information.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a two-parameter tool with no output schema and no annotations, the description covers purpose and payment mechanics but says nothing about result volume, latency, or how summaries are structured. Adequate but with clear gaps around usage and behavior.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, so both parameters (query, limit) are already fully documented in the schema. The description adds no syntax, format, or default information beyond it, so the baseline of 3 applies.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
States a specific verb and resource ('deep web research across multiple sources') and names the output form ('clean Markdown summaries from top results'). It does not, however, distinguish itself from close siblings like clean_web_scrape or synthesize_web_digest, leaving the agent to infer the difference.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
There is no when-to-use or when-not-to-use guidance, no prerequisites, and no mention of alternatives despite four plausible siblings. The agent must guess whether this or clean_web_scrape is appropriate for a given task.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
synthesize_web_digestB
Scrapes target webpage and executes Edge LLM (Llama 3) context synthesis to extract executive summary, key takeaways, and structured entities. Automatically handles HTTP 402 microtransactions (0.025 USDC on Base).
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | The webpage URL to synthesize. | |
| focus | No | Optional focus area or specific query for the synthesis. |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description carries the full burden. It does add genuine behavioral context: the underlying Edge LLM (Llama 3), and notably an automatic HTTP 402 microtransaction of 0.025 USDC on Base, which tells the agent this call has a real monetary cost. However, it omits auth requirements, failure/retry behavior, latency, and rate limits, so the disclosure is partial.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Two tight sentences with the core action front-loaded and the payment caveat second. Nothing is wasted, though the payment sentence is dense enough that the cost detail could be more clearly flagged.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a 2-parameter tool with no output schema and no annotations, the description compensates well by naming the return artifacts (summary, takeaways, entities) and disclosing the microtransaction cost. It leaves some operational gaps (auth, failure handling) but is broadly adequate to call the tool correctly.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, so both 'url' and 'focus' are already documented in the schema. The description adds no syntax, format, or constraint detail beyond what the schema provides, so the baseline 3 applies.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
States a specific verb+resource chain (scrape webpage, run LLM synthesis) and enumerates the concrete outputs (executive summary, key takeaways, structured entities). This distinguishes it in spirit from a plain scrape sibling, but it never names clean_web_scrape or otherwise explicitly differentiates itself from the sibling set.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
There is no when-to-use / when-not-to-use guidance and no mention of alternatives such as clean_web_scrape. Usage is only inferable from the fact that this is the 'synthesis' variant, which is weak routing guidance.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
twitter_profile_lookupA
Extracts public Twitter/X profile bio and recent tweets for any username without the $100/mo API fee. Automatically handles HTTP 402 microtransactions (0.03 USDC on Base).
| Name | Required | Description | Default |
|---|---|---|---|
| username | Yes | The Twitter handle/username to look up (e.g. "jessepollak"). |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description carries the full disclosure burden. It usefully reveals the payment behavior (automatic HTTP 402 handling, 0.03 USDC on Base), which is critical for an agent that will incur per-call cost, but omits rate limits, failure/refund behavior, and whether the charge applies per invocation.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Two tight sentences that front-load what is extracted before the cost/payment caveat. The '$100/mo API fee' framing is mildly promotional but is genuinely informative about why the tool exists.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a one-parameter tool with no output schema, the description adequately names the return contents (bio and recent tweets) and the cost model. It would be stronger with the count/format of returned tweets and error behavior.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100% and the single parameter is documented with an example handle, so the description need not restate it. The description adds no syntax, normalization, or accepted-format guidance beyond the schema's own example.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
States a specific verb (Extracts) and resource (public Twitter/X profile bio and recent tweets) scoped to 'any username'. This distinguishes it implicitly from the sibling twitter_search, which is query-oriented rather than per-handle, though no sibling is named explicitly.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
Usage is only implied: the 'for any username' framing suggests per-handle lookup versus a search tool, but there is no explicit when-to-use, when-not-to-use, or named alternative among the siblings. An agent must infer the routing from the phrase alone.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
twitter_searchA
Searches public tweets, cashtags ($BTC, $BASE), and sentiment across Twitter/X without the $100/mo API fee. Automatically handles HTTP 402 microtransactions (0.05 USDC on Base).
| Name | Required | Description | Default |
|---|---|---|---|
| limit | No | Max number of tweets to extract (default: 5). | |
| query | Yes | Twitter search query, cashtag, or topic (e.g. "$BASE autonomous agents"). |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description carries the full burden, and it does disclose a genuinely non-obvious trait: automatic HTTP 402 microtransactions at 0.05 USDC on Base. However, it omits auth/wallet prerequisites, rate limits, failure behavior when payment fails, and pagination or result volume, so significant behavioral gaps remain.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Two tight sentences with the capability statement front-loaded and the payment mechanism second. Every clause earns its place and there is no filler.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
The tool is simple (2 params, no nesting, no enums), and the description covers purpose and cost behavior. Since there is no output schema, the description should have described the return shape (tweets, sentiment fields, counts), and it also omits wallet/auth prerequisites for the paid path.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, so query and limit are already fully documented in the schema; this sets the baseline at 3. The description only reinforces that cashtags (e.g. $BTC, $BASE) are valid query forms and adds nothing about the limit parameter.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
States a specific verb ('Searches') and resource ('public tweets, cashtags, and sentiment across Twitter/X'), which cleanly separates it from the sibling twitter_profile_lookup (profile-centric) and the web-scraping siblings. An agent can route between search and profile lookup without opening either schema.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No when/when-not guidance and no mention of the sibling alternatives such as twitter_profile_lookup. The '$100/mo API fee' line implies a motivation for using this tool but does not tell the agent in which situations it should be preferred over other tools.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
6 tool updates
v1.4.1- First observed
audit_web_signal - First observed
clean_web_scrape - First observed
clean_web_search - First observed
synthesize_web_digest - First observed
twitter_profile_lookup - First observed
twitter_search
TDQS
Scored across 6 tools
Tools target distinct actions: single-page scraping, LLM synthesis, security audit, web search, Twitter search, and Twitter profile lookup. Minor overlap exists between clean_web_scrape and synthesize_web_digest since both scrape a target page, but the different output types make them distinguishable.
All names use snake_case, but verb patterns are mixed: clean_web_scrape and clean_web_search start with an adjective-like 'clean', while synthesize_web_digest and audit_web_signal follow verb_noun, and twitter_search / twitter_profile_lookup are noun-based. Readable overall, but lacks a single predictable convention.
Six tools is well-scoped for a scraper engine covering web scraping, synthesis, auditing, search, and Twitter endpoints. Each tool earns its place without obvious redundancy.
The surface covers core scraping, synthesis, security audit, web search, and Twitter search/profile operations. Minor gaps like batch crawling or structured extraction beyond the LLM digest could be workarounds, but no critical lifecycle operation is missing for this read-oriented domain.
Maintenance
Related MCP Connectors
Autonomous HTTP 402 Web Scraping Mesh on Base for $0.02 USDC.
Pay-per-call web scraping for AI agents via x402 on Base USDC. Six tools, no signup.
Pay-per-call (x402/USDC-Base) web + crypto data tools for AI agents: audit, extract, crypto, DeFi.
Pay-per-call web extraction, SEO audits and text analysis. USDC on Base via x402, no API keys.
Related MCP Servers
- AlicenseAqualityBmaintenancePay-per-call web scraping for AI agents — no signup, no API keys, just USDC micropayments via the x402 protocol on Base62MIT
- AlicenseNot gradedqualityBmaintenanceWebsite intelligence tools for AI agents. Ten pay-per-call tools via x402 micropayments (USDC on Base) — no accounts, no API keys.1MIT
- AlicenseAqualityBmaintenance⚡ 87% Token-compressed clean web scraping, YouTube AI transcripts, and PDF extraction for LLMs. Instant Free Trial with zero setup (No wallet/crypto required). Supports gasless agent vaults and EIP-712 on-chain oracle verification on Polygon, Base & Arbitrum.41422 PyPI2MIT
- FlicenseNot gradedqualityBmaintenanceEnables AI agents to use pay-per-use web scraping, Base blockchain analytics, and PDF text extraction tools, monetized via x402 USDC micropayments.-