Exports crawled web documentation and converted pages to LangChain-compatible JSONL format for use in LangChain applications and workflows.
Click on "Deploy Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type @ followed by the MCP server name and your instructions, e.g., "@UnWeb MCP Server convert https://docs.python.org/3/tutorial/ to markdown"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
MCP server for converting webpages to markdown in Claude Code, Cursor, and Windsurf. Content quality scoring. Multi-page crawl. LangChain + LlamaIndex exports.
Get your free API key at app.unweb.info (500 credits/month, no credit card).
Add to ~/.claude/settings.json:
{
"mcpServers": {
"unweb": {
"command": "npx",
"args": ["-y", "@mbsoftsystems/unweb-mcp"],
"env": { "UNWEB_API_KEY": "unweb_your_key_here" }
}
}
}Add to .cursor/mcp.json:
{
"mcpServers": {
"unweb": {
"command": "npx",
"args": ["-y", "@mbsoftsystems/unweb-mcp"],
"env": { "UNWEB_API_KEY": "unweb_your_key_here" }
}
}
}Same format in your Windsurf MCP configuration file.
Related MCP server: icecrawl MCP server
Tool | Description | Credits |
| Convert a webpage URL to clean markdown with quality score | 1 |
| Convert raw HTML string to markdown | 1 |
| Start crawling a documentation site (path-bounded BFS) | 1/page |
| Check crawl job progress | 0 |
| Download all crawled pages as concatenated markdown | 0 |
Convert any webpage to clean CommonMark markdown:
"Convert https://docs.stripe.com/api/charges to markdown"
Returns the markdown content plus a quality score (0-100) indicating extraction confidence. Scores below 40 indicate the page likely needs JavaScript rendering.
Convert HTML you already have — API responses, scraped content, generated markup:
"Convert this HTML to markdown:
<h1>Title</h1><p>Content</p>"
Crawl entire documentation sites:
"Crawl https://docs.example.com starting from /guides/ and get all pages as markdown"
The crawler runs a path-bounded BFS, converting each page. Use crawl_status to check progress and crawl_download to get all pages concatenated with separators:
--- Page: guides/getting-started.md ---
# Getting Started
Content here...
--- Page: guides/authentication.md ---
# Authentication
Content here...Export formats: raw-md (default), langchain (JSONL for LangChain), llamaindex (JSON for LlamaIndex).
Feature | UnWeb | Firecrawl | Jina Reader |
Content quality score | 0-100 on every response | No | No |
Multi-page crawl | Yes | Yes | No |
LangChain/LlamaIndex export | Native | No | No |
Convert raw HTML | Yes | No (URL only) | No (URL only) |
Free tier | 500 credits/month (recurring) | 500 credits (one-time) | Rate-limited |
Cheapest paid | $12/month | $16/month | Token-based |
Plan | Credits/month | Price |
Free | 500 | $0 |
Starter | 2,000 | $12/month |
Pro | 15,000 | $39/month |
Scale | 60,000 | $99/month |
UnWeb — Landing page
Documentation — Full API docs
Dashboard — Manage API keys and usage
Python SDK — pip install unweb
Node.js SDK — npm install @mbsoftsystems/unweb
GitHub — Examples and community
MIT
This server cannot be deployed
Web scraping for AI agents. Converts URLs to clean, LLM-ready Markdown with anti-bot bypass.
Web pages and whole sites to clean Markdown for RAG and AI agents. Crawls links and sitemaps.
Clean Markdown and AI-readability scoring for any URL. Built for AI agents.
Convert any webpage to clean LLM-ready markdown, extraction-first, with article and news modes.