A
licenseB
qualityD
maintenanceA Model Context Protocol server that allows LLMs to retrieve and convert web content to markdown without robots.txt restrictions.
1
2
MIT
Aetheris-MCP
by Timwal78
Click on "Deploy Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@Aetheris-MCPscrape https://example.com/article into markdown"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
🛡️ Aetheris-MCP: The x402 Agentic Web Scraper
Aetheris-MCP is an enterprise-grade Server-Sent Events (SSE) Model Context Protocol server. It provides AI Agents with high-fidelity, ad-free Markdown web scraping capabilities, protected by an on-chain x402 Micropayment Interceptor.
Bring Your Own Key (BYOK) for inference. Settle in USDC on Base for context.
🏗️ Architecture
Engine: Node.js + Express
Scraper: JSDOM (Deep DOM sanitization, strips scripts/styles/ads)
Transport: Server-Sent Events (
/sse&/message)Monetization:
ethers.js(EVM HTTP 402 validation on Base Mainnet)
Related MCP server: Scraper MCP
🚀 One-Click Deployment
This repository is configured with a render.yaml Blueprint.
Fork this repository.
Go to your Render Dashboard.
Click New -> Blueprint.
Connect the forked repository. Render will automatically detect the configuration and deploy the Express server.
⚙️ Environment Variables
Ensure you set these in your hosting environment:
REQUIRE_PAYMENT(boolean) - Enforces the 402 interceptor.BASE_MICROPAYMENT_COST(float) - USDC cost per scrape (e.g.,0.01).USDC_CONTRACT_ADDRESS- The target ERC-20 contract.MERCHANT_WALLET_ADDRESS- Your EVM public key.RPC_URL- Your Web3 RPC provider (defaults tohttps://mainnet.base.org).
💻 Client Integration
Agents should NOT connect to this server manually. Use the official Auto-Settlement SDK:
npm install @aetheris/mcp-client
See the Client SDK Repository for documentation on how the SDK intercepts the 402 challenge and settles the transaction autonomously.
This server cannot be deployed
Maintenance
ActivitySlowing
ResponsivenessSyncing
Related MCP Connectors
Stealth scraping API for AI agents. Clean Markdown from any URL. x402 crypto payments.
Compact, citation-verifiable public web context for AI agents, paid per use with x402.
Pay for HTTP APIs and charge for your own: x402 micropayments in USDC on Base.
Search, read & publish paid essays. Pay-per-read in USDC on Base (x402); wallet-only, no account.
Related MCP Servers
- AlicenseNot gradedqualityDmaintenanceA context-optimized web scraping server that converts HTML to markdown/text and applies CSS selectors server-side, reducing token usage by 70-90% while providing AI tools with clean, filtered web content.7MIT
- AlicenseNot gradedqualityDmaintenanceEnables extracting clean Markdown from any webpage by paying $0.005 USDC per call via the x402 protocol, with automatic wallet-based payment settlement.4MIT
- AlicenseNot gradedqualityCmaintenanceMCP server for converting HTML to Markdown and extracting page data, with pay-per-call using USDC on Base.MIT