Supports structured data extraction from web content using CSS selectors to accurately target and retrieve specific page elements.
Converts crawled web pages into clean, optimized Markdown format to facilitate easier processing and understanding by AI agents.
Leverages OpenAI's models to perform complex structured data extraction from crawled URLs using defined schemas or instructions.
Click on "Install Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type @ followed by the MCP server name and your instructions, e.g., "@Crawl4AI MCP Server Extract all product names and prices from https://example.com/shop"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
本地运行的 Crawl4AI MCP Server，为 AI 助手提供强大的网页爬取能力。
🌐 网页爬取：爬取单个或多个 URL，返回干净的 Markdown
📝 结构化提取：使用 CSS/XPath 或 LLM 提取结构化数据
📸 截图功能：获取网页截图
🕸️ 深度爬取：支持深度爬取整个网站
🚀 本地运行：完全本地运行，无需 API Key（基础功能）
⚡ 高性能：异步并发，智能缓存
Related MCP server: superFetch MCP Server
# 克隆项目
git clone <your-repo-url>
cd crawl4ai-mcp
# 使用启动脚本（推荐）
chmod +x start.sh
./start.sh
# 或者手动安装
uv sync
uv run crawl4ai-setup# 复制环境变量示例
cp .env.example .env
# 编辑 .env 文件，添加你的 API keys（用于结构化提取）# stdio 模式（用于 Claude Code）
uv run crawl4ai-mcp
# HTTP 模式（用于开发调试）
uv run crawl4ai-mcp --transport http --port 8000claude mcp add crawl4ai uv run --project /path/to/crawl4ai-mcp crawl4ai-mcp# 1. 启动服务器
uv run crawl4ai-mcp --transport http --port 8000
# 2. 添加到 Claude Code
claude mcp add --transport http crawl4ai http://localhost:8000/mcpcrawl_url(
url="https://example.com",
word_count_threshold=10,
bypass_cache=False,
magic=False
)crawl_multiple(
urls=["https://example.com/page1", "https://example.com/page2"],
max_concurrent=3,
word_count_threshold=10
)extract_structured(
url="https://example.com/products",
instruction="提取所有产品名称和价格",
provider="openai/gpt-4o-mini",
api_token="your-api-key"
)get_screenshot(
url="https://example.com",
full_page=True,
viewport_width=1920,
viewport_height=1080
)deep_crawl(
url="https://example.com",
max_depth=2,
max_pages=10,
strategy="bfs" # 或 "dfs"
)详细使用指南 - 完整的工具说明和使用示例
Crawl4AI 文档 - 底层库文档
MCP 协议 - MCP 协议文档
# 运行测试
make test
# 代码格式化
make fmt
# 代码检查
make lint
# 类型检查
make typecheck
# 运行所有检查
make check# LLM API Keys（用于结构化提取）
OPENAI_API_KEY=sk-...
ANTHROPIC_API_KEY=sk-ant-...
# 或使用通用配置
LLM_PROVIDER=openai/gpt-4o-mini
LLM_API_KEY=sk-...MIT License
欢迎提交 Issue 和 PR！
This server cannot be installed
Unclaimed servers have limited discoverability.
If you are the server author, to access and configure the admin panel.
Driflyte MCP server which lets AI assistants query topic-specific knowledge from web and GitHub.
Web scraping for AI agents. Converts URLs to clean, LLM-ready Markdown with anti-bot bypass.
Jina AI Reader/Search MCP — turn any URL into clean LLM-ready markdown, plus web search.
We provide all the information about MCP servers via our MCP API.
curl -X GET 'https://glama.ai/api/mcp/v1/servers/stevenzxs/crawl4ai-mcp'
If you have feedback or need assistance with the MCP directory API, please join our Discord server