Skip to main content
Glama

Crawlee MCP

A local Model Context Protocol server for web fetching, crawling, and screenshots with Crawlee. It runs over stdio, so it works with Claude Code, Claude Desktop, Codex, Cursor, and any MCP-compatible client.

Tools

Tool

Description

fetch_url

Fetch a single URL and return clean markdown

fetch_multiple

Fetch multiple URLs in parallel

crawl

Crawl a site, discover links, and return page content

screenshot

Take a PNG screenshot of a page

ping

Health check

Install

Requires Node.js 20 or newer. The first use of JavaScript rendering or screenshots also requires the Chromium browser:

npx playwright install chromium

Once published to npm, every client can start it with:

npx -y @patrikmichi/crawlee-mcp

Until the npm package is published, install directly from GitHub:

npx -y github:patrikmichi/crawlee-mcp

Client configuration

Claude Code

claude mcp add --transport stdio crawlee -- npx -y @patrikmichi/crawlee-mcp

Claude Desktop

Add this to your Claude Desktop configuration file:

{
  "mcpServers": {
    "crawlee": {
      "command": "npx",
      "args": ["-y", "@patrikmichi/crawlee-mcp"]
    }
  }
}

Codex

Add this to ~/.codex/config.toml:

[mcp_servers.crawlee]
command = "npx"
args = ["-y", "@patrikmichi/crawlee-mcp"]

Other MCP clients

Use the same command and arguments: npx -y @patrikmichi/crawlee-mcp.

Configuration

cp env.example .env

Variable

Required

Description

CRAWLEE_PROXY_URLS

No

Comma-separated proxy URLs for rotation

CRAWLEE_TIMEOUT_MS

No

Request timeout in ms (default: 30000)

CRAWLEE_STEALTH

No

Set to false to disable stealth mode (default: true)

Development

npm install
npm start          # Run with tsx (no build needed)
npm run build      # Compile TypeScript
npm run typecheck  # Type check only

This server is intentionally local and stdio-only because JavaScript rendering and screenshots require a local Playwright browser.

Latest Blog Posts

MCP directory API

We provide all the information about MCP servers via our MCP API.

curl -X GET 'https://glama.ai/api/mcp/v1/servers/patrikmichi/crawlee-mcp'

If you have feedback or need assistance with the MCP directory API, please join our Discord server