Which integrations are available for this server?

Provides tools to fetch and crawl web pages via Cloudflare's Browser Rendering API, returning Markdown content.

How do I use cloudflare-crawl-mcp?

1. Click on "Install Server". 2. Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state. 3. In the chat, type @ followed by the MCP server name and your instructions, e.g., "@cloudflare-crawl-mcp scrape https://example.com" That's it! The server will respond to your query, and you can continue using it as needed. Here is a step-by-step guide with screenshots.

cloudflare-crawl-mcp

by bidouilles

Overview Schema Related Servers Score Discussions

Python

Remote

cloudflare-crawl-mcp

MCP server for Cloudflare Browser Rendering Crawl API. Fetches and crawls web pages, returning clean Markdown optimized for LLM consumption.

Built with FastMCP and uv.

Tools

Tool	Description
`scrape_url`	Fetch a single page as Markdown. The primary tool — use this when you know the URL.
`map_url`	Discover URLs on a site without fetching content. Use to find the right page first.
`crawl_url`	Crawl multiple pages and return all content as Markdown.

Typical workflow: map_url to find pages → scrape_url to read the right one.

Related MCP server: superFetch MCP Server

Prerequisites

A Cloudflare account with Browser Rendering enabled
An API token with Account > Browser Rendering > Edit permission (create one here)
uv installed

Configuration

Variable	Required	Description
`CF_API_TOKEN`	Yes	Cloudflare API token
`CF_ACCOUNT_ID`	Yes	Cloudflare Account ID
`CF_RATE_LIMIT`	No	API requests per minute (default: `6` for Free, set to `600` for Paid)

Setup

Claude Code

claude mcp add cloudflare-crawl \
  -e CF_API_TOKEN=your_api_token \
  -e CF_ACCOUNT_ID=your_account_id \
  -- uv run --directory /path/to/cloudflare-crawl-mcp python server.py

Codex

codex mcp add cloudflare-crawl \
  -- env CF_API_TOKEN="your_api_token" CF_ACCOUNT_ID="your_account_id" \
  uv run --directory /path/to/cloudflare-crawl-mcp python server.py

Claude Desktop

Add to ~/Library/Application Support/Claude/claude_desktop_config.json (macOS) or %APPDATA%\Claude\claude_desktop_config.json (Windows):

{
  "mcpServers": {
    "cloudflare-crawl": {
      "command": "uv",
      "args": ["run", "--directory", "/path/to/cloudflare-crawl-mcp", "python", "server.py"],
      "env": {
        "CF_API_TOKEN": "your_api_token",
        "CF_ACCOUNT_ID": "your_account_id"
      }
    }
  }
}

Cursor

Add to .cursor/mcp.json in your project or ~/.cursor/mcp.json globally:

{
  "mcpServers": {
    "cloudflare-crawl": {
      "command": "uv",
      "args": ["run", "--directory", "/path/to/cloudflare-crawl-mcp", "python", "server.py"],
      "env": {
        "CF_API_TOKEN": "your_api_token",
        "CF_ACCOUNT_ID": "your_account_id"
      }
    }
  }
}

Tool Reference

`scrape_url`

Fetch a single page and return its content as Markdown.

url (string, required)    — The URL to fetch
render (boolean, optional) — Render JavaScript with headless browser (default: true, set false for static pages)

`map_url`

Discover URLs on a website without fetching full content.

url (string, required)                  — Starting URL
limit (number, optional)                — Max URLs to discover (default: 50)
depth (number, optional)                — Link depth to follow (default: 2)
include_subdomains (boolean, optional)  — Follow subdomain links (default: false)
include_external_links (boolean, optional) — Follow external links (default: false)
include_patterns (string[], optional)   — Only visit matching URLs (e.g. "https://example.com/docs/**")
exclude_patterns (string[], optional)   — Skip matching URLs

`crawl_url`

Crawl multiple pages and return all content as Markdown.

url (string, required)                  — Starting URL
limit (number, optional)                — Max pages to crawl (default: 10)
depth (number, optional)                — Link depth (default: 1)
include_subdomains (boolean, optional)  — Follow subdomain links (default: false)
include_external_links (boolean, optional) — Follow external links (default: false)
include_patterns (string[], optional)   — Only visit matching URLs
exclude_patterns (string[], optional)   — Skip matching URLs
render (boolean, optional)              — Render JavaScript (default: true)

Cloudflare Plan Limits

	Free	Paid
Browser time	10 min/day	10 hrs/month
API rate limit	6 req/min	600 req/min
Concurrent browsers	3	10
Max pages per job	100,000	100,000
Max job duration	7 days	7 days
Results available	14 days	14 days

render: false crawls run on Workers instead of a headless browser and do not consume browser time.

License

MIT

This server cannot be installed

license - not found

quality - not tested

maintenance

How are these scores calculated?

Maintenance

–Maintainers

–Response time

–Release cycle

–Releases (12mo)

Commit activity

Resources

GitHub Repository

Need Help?

Related Servers

Unclaimed servers have limited discoverability.

Looking for Admin?

If you are the server author, to access and configure the admin panel.

Related MCP Servers

cloudflare-browser-rendering
Web Scraping Browser Automation Search
amotivv
A
license
A
quality
D
maintenance
This MCP server provides tools for interacting with Cloudflare Browser Rendering, allowing you to fetch and process web content for use as context in LLMs directly from Cline or Claude Desktop.
Last updated 2025-03-13
5
11
MIT
superFetch MCP Server
Browser Automation Web Scraping RAG Systems
j0hanz
A
license
A
quality
D
maintenance
An MCP server that fetches web pages and extracts clean, AI-friendly Markdown content using Mozilla Readability. It provides secure web access for LLMs with built-in SSRF protection and automated content cleaning for improved context retrieval and summarization.
Last updated 2026-04-11
1
259
MIT
@hauntapi/mcp-server
Browser Automation Data Platforms Web Scraping
Darko893
A
license
A
quality
B
maintenance
Web extraction MCP server for AI agents. Extract structured data from any URL with built-in Cloudflare bypass, JavaScript rendering, and intelligent parsing. Returns clean markdown or JSON.
Last updated 2026-07-29
5
794
2
MIT
Scrapi MCP Server
Web Scraping Browser Automation
bamchi
A
license
A
quality
C
maintenance
MCP server that converts URLs to clean Markdown/Text for LLM agents.
Last updated 2026-05-27
5
70
5
MIT

View all related MCP servers

Related MCP Connectors

scrapi
Web scraping for AI agents. Converts URLs to clean, LLM-ready Markdown with anti-bot bypass.
anybrowse
Converts any URL to clean, LLM-ready Markdown using real Chrome browsers
Firecrawl
Firecrawl MCP — wraps the Firecrawl API (firecrawl.dev) for web

View all MCP Connectors

Latest Blog Posts

Who's Calling? MCP Hosts Are an Identity Blind Spot (And the Spec Knows It)
By Om-Shree-0709 on July 25, 2026.
mcp
Agent Identity
OAuth 2.1
Your AI Chatbot Just Exposed Your CEO's Salary to an Intern
By Om-Shree-0709 on July 2, 2026.
Agent Identity
MCP Security
OAuth Delegation
Why MCP Servers Need Execution Sandboxing (And Why Your Current Stack Isn't Enough)
By Om-Shree-0709 on June 30, 2026.
Agentic Ai
Prompt Injection
WebAssembly

MCP directory API

We provide all the information about MCP servers via our MCP API.

curl -X GET 'https://glama.ai/api/mcp/v1/servers/bidouilles/cloudflare-crawl-mcp'

If you have feedback or need assistance with the MCP directory API, please join our Discord server

cloudflare-crawl-mcp

Tools

Prerequisites

Configuration

Setup

Claude Code

Codex

Claude Desktop

Cursor

Tool Reference

scrape_url

map_url

crawl_url

Cloudflare Plan Limits

License

Maintenance

Resources

Looking for Admin?

Related MCP Servers

cloudflare-browser-rendering

superFetch MCP Server

@hauntapi/mcp-server

Scrapi MCP Server

Related MCP Connectors

Latest Blog Posts

MCP directory API

`scrape_url`

`map_url`

`crawl_url`