UnWeb MCP Server
Exports crawled web documentation and converted pages to LangChain-compatible JSONL format for use in LangChain applications and workflows.
This server does not currently have a deployable release on Glama. Follow the repository's setup instructions to install and configure it for your MCP client, including any required credentials and local dependencies.
UnWeb MCP Server
MCP server for converting webpages to markdown in Claude Code, Cursor, and Windsurf. Content quality scoring. Multi-page crawl. LangChain + LlamaIndex exports.
Quick Start
Get your free API key at app.unweb.info (500 credits/month, no credit card).
Claude Code
Add to ~/.claude/settings.json:
{
"mcpServers": {
"unweb": {
"command": "npx",
"args": ["-y", "@mbsoftsystems/unweb-mcp"],
"env": { "UNWEB_API_KEY": "unweb_your_key_here" }
}
}
}Cursor
Add to .cursor/mcp.json:
{
"mcpServers": {
"unweb": {
"command": "npx",
"args": ["-y", "@mbsoftsystems/unweb-mcp"],
"env": { "UNWEB_API_KEY": "unweb_your_key_here" }
}
}
}Windsurf
Same format in your Windsurf MCP configuration file.
Related MCP server: icecrawl MCP server
Tools
Tool | Description | Credits |
| Convert a webpage URL to clean markdown with quality score | 1 |
| Convert raw HTML string to markdown | 1 |
| Start crawling a documentation site (path-bounded BFS) | 1/page |
| Check crawl job progress | 0 |
| Download all crawled pages as concatenated markdown | 0 |
convert_url
Convert any webpage to clean CommonMark markdown:
"Convert https://docs.stripe.com/api/charges to markdown"
Returns the markdown content plus a quality score (0-100) indicating extraction confidence. Scores below 40 indicate the page likely needs JavaScript rendering.
convert_html
Convert HTML you already have — API responses, scraped content, generated markup:
"Convert this HTML to markdown:
<h1>Title</h1><p>Content</p>"
crawl_start → crawl_status → crawl_download
Crawl entire documentation sites:
"Crawl https://docs.example.com starting from /guides/ and get all pages as markdown"
The crawler runs a path-bounded BFS, converting each page. Use crawl_status to check progress and crawl_download to get all pages concatenated with separators:
--- Page: guides/getting-started.md ---
# Getting Started
Content here...
--- Page: guides/authentication.md ---
# Authentication
Content here...Export formats: raw-md (default), langchain (JSONL for LangChain), llamaindex (JSON for LlamaIndex).
Why UnWeb MCP?
Feature | UnWeb | Firecrawl | Jina Reader |
Content quality score | 0-100 on every response | No | No |
Multi-page crawl | Yes | Yes | No |
LangChain/LlamaIndex export | Native | No | No |
Convert raw HTML | Yes | No (URL only) | No (URL only) |
Free tier | 500 credits/month (recurring) | 500 credits (one-time) | Rate-limited |
Cheapest paid | $12/month | $16/month | Token-based |
Pricing
Plan | Credits/month | Price |
Free | 500 | $0 |
Starter | 2,000 | $12/month |
Pro | 15,000 | $39/month |
Scale | 60,000 | $99/month |
Links
UnWeb — Landing page
Documentation — Full API docs
Dashboard — Manage API keys and usage
Python SDK —
pip install unwebNode.js SDK —
npm install @mbsoftsystems/unwebGitHub — Examples and community
License
MIT
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
Loading tool schema changelog…
This server cannot be deployed
Maintenance
Related MCP Connectors
Convert any web page into clean, LLM-ready Markdown. Strips ads, navigation and clutter; keeps headings, tables, code and links.
Web scraping for AI agents. Converts URLs to clean, LLM-ready Markdown with anti-bot bypass.
Web pages and whole sites to clean Markdown for RAG and AI agents. Crawls links and sitemaps.
Convert URLs or whole websites to clean Markdown for LLMs and RAG; respects robots.txt.
Related MCP Servers
- AlicenseNot gradedqualityDmaintenanceScrapes webpages and converts them to markdown using AI-powered interaction to automatically handle cookie banners, CAPTCHAs, paywalls, and other blocking elements before extracting clean content.49Apache 2.0
- FlicenseNot gradedqualityDmaintenanceEnables scraping single pages or crawling entire websites, converting content to markdown and optionally extracting structured data with Claude.-
- FlicenseNot gradedqualityCmaintenanceEnables web scraping and conversion of any page to clean markdown, with crawling, mapping, and multiple output formats, deployable to Cloudflare Workers for use in Claude and Codex sessions.-
- AlicenseNot gradedqualityCmaintenanceEnables converting any URL or website into clean, LLM-ready Markdown, supporting single-page scraping and full-site crawling for AI agents.MIT