CloudScraper MCP Server

A Model Context Protocol server that enables AI agents to bypass Cloudflare protection and scrape web content

Quick Start

Clone the repository and install dependencies:

git clone https://github.com/yourusername/cloudscraper-mcp-server.git
cd cloudscraper-mcp-server
uv sync

Add to Claude Code:

claude mcp add cloudscraper-mcp \
  --type stdio \
  --command "uv" \
  --args "run" "server.py" \
  --directory "/path/to/cloudscraper-mcp-server"

Add to VSCode / any MCP-compatible IDE:

{
  "mcpServers": {
    "cloudscraper-mcp": {
      "type": "stdio",
      "command": "uv",
      "args": ["run", "server.py"],
      "cwd": "/path/to/cloudscraper-mcp-server"
    }
  }
}

Features

• Cloudflare Bypass — Automatically handles Cloudflare protection so AI agents can reach pages that block standard requests

• Content Cleaning — Converts HTML to clean, LLM-friendly Markdown

• Smart Chunking — Automatically splits large responses into 10k-token chunks with continuation tokens

• Binary Handling — Base64-encodes non-text content so agents can handle images and downloads

• File Export — Save scraped content directly to disk via scrape_url_to_file

• Docker Support — Containerized deployment via DOCKER.md

Three tools are available: scrape_url (returns content as a string), scrape_url_raw (returns content plus response metadata), and scrape_url_to_file (saves content to disk).

Configuration

Transport Protocols

Run with HTTP transport:

MCP_TRANSPORT=http MCP_HOST=0.0.0.0 MCP_PORT=8000 uv run server.py

Environment Variables