agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free)
Server Details
URL to clean markdown for LLMs: a polite, robots.txt-respecting web reader. Free, no API key
- Status
- Healthy
- Uptime
- 100.0% over the last 24 hours
- Last Tested
- Transport
- Streamable HTTP · MCP 2025-06-18
- URL
- Repository
- foomworks/agent-web
- GitHub Stars
- 0
- Server Listing
- agent-web
- ChatGPT
- –
- Claude
- –
TDQS
Scored across 5 tools
Tools have distinct purposes (read full, read preview, render PDF, render preview, render screenshot). However, render_preview is a discovery stub for both PDF and screenshot, which could cause some ambiguity about which specific render tool it relates to.
Consistent verb_noun pattern with underscores: read_url, read_url_preview, render_pdf, render_preview, render_screenshot. Naming clearly indicates whether the tool reads text or renders visual output.
Five tools is appropriate for a web page reader that offers both text extraction and rendering capabilities. The set is neither too sparse nor overloaded.
The core read tools cover the primary purpose of fetching and converting URLs to markdown. The rendering tools are included but currently non-functional (return 503 or x402), leaving a gap in visual rendering capabilities. JavaScript-rendered pages are also unsupported.
Available Tools
5 toolsread_urlAInspect
Fetch one publicly reachable URL and return clean, LLM-ready markdown (title + page description + word count + markdown). HTML pages are extracted to markdown — including HTML tables, which become GitHub-flavored Markdown tables; URLs pointing straight at a Markdown or plain-text document (raw READMEs, llms.txt, docs) are passed through verbatim. Polite by design: honors the origin's robots.txt for our user-agent, identifies honestly, read-only GET, never bypasses anti-bot/CAPTCHA/paywalls. Free. JavaScript-rendered pages are not supported yet.
Inputs: url (required).
read_url_previewAInspect
Like read_url but returns only the page description + the first ~600 characters of the markdown (title + word count + a truncation flag) — a cheap way to check a page's relevance before pulling the full text. Free.
Inputs: url (required).
render_pdfAInspect
PAID (x402): returns x402 payment instructions for a PDF render of a publicly reachable URL, via a real, robots-respecting headless browser. Currently soft-skips 503 until Cloudflare Browser Rendering is provisioned.
Inputs: url (required).
render_previewAInspect
Free discovery stub for the screenshot/PDF render lane. Same robots/SSRF guards as read_url. Currently returns a 503 (no charge) until Cloudflare Browser Rendering is provisioned on this account.
Inputs: url (required).
render_screenshotAInspect
PAID (x402): returns x402 payment instructions for a PNG screenshot of a publicly reachable URL, rendered via a real, robots-respecting headless browser. Use render_preview (free) first. Currently soft-skips 503 until Cloudflare Browser Rendering is provisioned.
Inputs: url (required), width, fullPage.
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
Loading tool schema changelog…
Related MCP Connectors
Read any public web page as clean Markdown for LLMs. Respects robots.txt. Free tier; x402 paid API.
Clean Markdown and AI-readability scoring for any URL. Built for AI agents.
Turn any webpage into clean Markdown for LLM/agent pipelines. Free tier; paid 1 USDC = 1000 req.
Web scraping for AI agents. Converts URLs to clean, LLM-ready Markdown with anti-bot bypass.
Related MCP Servers
- AlicenseNot gradedqualityDmaintenanceEnables clean, LLM-ready markdown extraction from any URL with automatic anti-bot bypass.3MIT
- AlicenseAqualityDmaintenanceConverts URLs and raw HTML to clean Markdown, enabling AI assistants to read web pages for summarization, analysis, or ingestion.213 npm1MIT
- AlicenseNot gradedqualityCmaintenanceTurns any web page into clean, token-budgeted Markdown for AI agents, with no browser installation required.8MIT
- AlicenseAqualityCmaintenanceConverts any URL to clean, LLM-ready Markdown by removing ads, navigation, and other clutter, using Mozilla Readability and Turndown.149 npmMIT
Glama MCP Gateway
Add one secure layer between your agents and this server.