cloudflare-crawl-mcp
Provides tools to fetch and crawl web pages via Cloudflare's Browser Rendering API, returning Markdown content.
Click on "Install Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@cloudflare-crawl-mcpscrape https://example.com"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
cloudflare-crawl-mcp
MCP server for Cloudflare Browser Rendering Crawl API. Fetches and crawls web pages, returning clean Markdown optimized for LLM consumption.
Tools
Tool | Description |
| Fetch a single page as Markdown. The primary tool — use this when you know the URL. |
| Discover URLs on a site without fetching content. Use to find the right page first. |
| Crawl multiple pages and return all content as Markdown. |
Typical workflow: map_url to find pages → scrape_url to read the right one.
Related MCP server: @hauntapi/mcp-server
Prerequisites
A Cloudflare account with Browser Rendering enabled
An API token with Account > Browser Rendering > Edit permission (create one here)
uv installed
Configuration
Variable | Required | Description |
| Yes | Cloudflare API token |
| Yes | Cloudflare Account ID |
| No | API requests per minute (default: |
Setup
Claude Code
claude mcp add cloudflare-crawl \
-e CF_API_TOKEN=your_api_token \
-e CF_ACCOUNT_ID=your_account_id \
-- uv run --directory /path/to/cloudflare-crawl-mcp python server.pyCodex
codex mcp add cloudflare-crawl \
-- env CF_API_TOKEN="your_api_token" CF_ACCOUNT_ID="your_account_id" \
uv run --directory /path/to/cloudflare-crawl-mcp python server.pyClaude Desktop
Add to ~/Library/Application Support/Claude/claude_desktop_config.json (macOS) or %APPDATA%\Claude\claude_desktop_config.json (Windows):
{
"mcpServers": {
"cloudflare-crawl": {
"command": "uv",
"args": ["run", "--directory", "/path/to/cloudflare-crawl-mcp", "python", "server.py"],
"env": {
"CF_API_TOKEN": "your_api_token",
"CF_ACCOUNT_ID": "your_account_id"
}
}
}
}Cursor
Add to .cursor/mcp.json in your project or ~/.cursor/mcp.json globally:
{
"mcpServers": {
"cloudflare-crawl": {
"command": "uv",
"args": ["run", "--directory", "/path/to/cloudflare-crawl-mcp", "python", "server.py"],
"env": {
"CF_API_TOKEN": "your_api_token",
"CF_ACCOUNT_ID": "your_account_id"
}
}
}
}Tool Reference
scrape_url
Fetch a single page and return its content as Markdown.
url (string, required) — The URL to fetch
render (boolean, optional) — Render JavaScript with headless browser (default: true, set false for static pages)map_url
Discover URLs on a website without fetching full content.
url (string, required) — Starting URL
limit (number, optional) — Max URLs to discover (default: 50)
depth (number, optional) — Link depth to follow (default: 2)
include_subdomains (boolean, optional) — Follow subdomain links (default: false)
include_external_links (boolean, optional) — Follow external links (default: false)
include_patterns (string[], optional) — Only visit matching URLs (e.g. "https://example.com/docs/**")
exclude_patterns (string[], optional) — Skip matching URLscrawl_url
Crawl multiple pages and return all content as Markdown.
url (string, required) — Starting URL
limit (number, optional) — Max pages to crawl (default: 10)
depth (number, optional) — Link depth (default: 1)
include_subdomains (boolean, optional) — Follow subdomain links (default: false)
include_external_links (boolean, optional) — Follow external links (default: false)
include_patterns (string[], optional) — Only visit matching URLs
exclude_patterns (string[], optional) — Skip matching URLs
render (boolean, optional) — Render JavaScript (default: true)Cloudflare Plan Limits
Free | Paid | |
Browser time | 10 min/day | 10 hrs/month |
API rate limit | 6 req/min | 600 req/min |
Concurrent browsers | 3 | 10 |
Max pages per job | 100,000 | 100,000 |
Max job duration | 7 days | 7 days |
Results available | 14 days | 14 days |
render: false crawls run on Workers instead of a headless browser and do not consume browser time.
License
MIT
Maintenance
Resources
Unclaimed servers have limited discoverability.
Looking for Admin?
If you are the server author, to access and configure the admin panel.
Tools
Related MCP Servers
- AlicenseAqualityDmaintenanceThis MCP server provides tools for interacting with Cloudflare Browser Rendering, allowing you to fetch and process web content for use as context in LLMs directly from Cline or Claude Desktop.511MIT
- AlicenseAqualityBmaintenanceWeb extraction MCP server for AI agents. Extract structured data from any URL with built-in Cloudflare bypass, JavaScript rendering, and intelligent parsing. Returns clean markdown or JSON.57942MIT
- AlicenseAqualityCmaintenanceMCP server that converts URLs to clean Markdown/Text for LLM agents.5875MIT
- FlicenseNot gradedqualityDmaintenanceMCP server to scrape web pages to clean Markdown via headless Chromium, with support for single or batch URLs.
Related MCP Connectors
Web scraping for AI agents. Converts URLs to clean, LLM-ready Markdown with anti-bot bypass.
Converts any URL to clean, LLM-ready Markdown using real Chrome browsers
Firecrawl MCP — wraps the Firecrawl API (firecrawl.dev) for web
Latest Blog Posts
- Who's Calling? MCP Hosts Are an Identity Blind Spot (And the Spec Knows It)By Om-Shree-0709 on .mcpAgent IdentityOAuth 2.1
- Your AI Chatbot Just Exposed Your CEO's Salary to an InternBy Om-Shree-0709 on .Agent IdentityMCP SecurityOAuth Delegation
- Why MCP Servers Need Execution Sandboxing (And Why Your Current Stack Isn't Enough)By Om-Shree-0709 on .Agentic AiPrompt InjectionWebAssembly
MCP directory API
We provide all the information about MCP servers via our MCP API.
curl -X GET 'https://glama.ai/api/mcp/v1/servers/bidouilles/cloudflare-crawl-mcp'
If you have feedback or need assistance with the MCP directory API, please join our Discord server