Skip to main content
Glama

Crawlee MCP

A local Model Context Protocol server for web fetching, crawling, and screenshots with Crawlee. It runs over stdio, so it works with Claude Code, Claude Desktop, Codex, Cursor, and any MCP-compatible client.

Tools

Tool

Description

fetch_url

Fetch a single URL and return clean markdown

fetch_multiple

Fetch multiple URLs in parallel

crawl

Crawl a site, discover links, and return page content

screenshot

Take a PNG screenshot of a page

ping

Health check

Related MCP server: Crawl4AI MCP

Install

Requires Node.js 20 or newer. The first use of JavaScript rendering or screenshots also requires the Chromium browser:

npx playwright install chromium

Once published to npm, every client can start it with:

npx -y @patrikmichi/crawlee-mcp

Until the npm package is published, install directly from GitHub:

npx -y github:patrikmichi/crawlee-mcp

Client configuration

Claude Code

claude mcp add --transport stdio crawlee -- npx -y @patrikmichi/crawlee-mcp

Claude Desktop

Add this to your Claude Desktop configuration file:

{
  "mcpServers": {
    "crawlee": {
      "command": "npx",
      "args": ["-y", "@patrikmichi/crawlee-mcp"]
    }
  }
}

Codex

Add this to ~/.codex/config.toml:

[mcp_servers.crawlee]
command = "npx"
args = ["-y", "@patrikmichi/crawlee-mcp"]

Other MCP clients

Use the same command and arguments: npx -y @patrikmichi/crawlee-mcp.

Configuration

cp env.example .env

Variable

Required

Description

CRAWLEE_PROXY_URLS

No

Comma-separated proxy URLs for rotation

CRAWLEE_TIMEOUT_MS

No

Request timeout in ms (default: 30000)

CRAWLEE_STEALTH

No

Set to false to disable stealth mode (default: true)

Development

npm install
npm start          # Run with tsx (no build needed)
npm run build      # Compile TypeScript
npm run typecheck  # Type check only

This server is intentionally local and stdio-only because JavaScript rendering and screenshots require a local Playwright browser.

Install Server
A
license - permissive license
A
quality
C
maintenance

Maintenance

Maintainers
Response time
Release cycle
Releases (12mo)
Commit activity

Resources

Unclaimed servers have limited discoverability.

Looking for Admin?

If you are the server author, to access and configure the admin panel.

Related MCP Servers

  • A
    license
    -
    quality
    C
    maintenance
    Enables web scraping and crawling capabilities for LLM clients, supporting single-page scraping, multi-page website crawling, and web search with multiple engines (Playwright, Cheerio, Puppeteer) and flexible output formats including markdown, HTML, text, and screenshots.
    18
    6
    MIT
  • A
    license
    B
    quality
    A
    maintenance
    Enables AI assistants to crawl websites, extract dynamic content, navigate links, and save structured Markdown files via the MCP protocol, with support for anti-bot bypass, CSS selectors, and custom JavaScript execution.
    1
    42
    MIT
  • A
    license
    -
    quality
    C
    maintenance
    Enables AI agents to fetch and render web pages (including JavaScript-heavy SPAs) with headless Chromium, extract readable content with Mozilla Readability, capture navigation links, download images, and return a clean markdown file path.
    12
    ISC

View all related MCP servers

Related MCP Connectors

  • Read a URL as clean markdown, screenshot a website, url to PDF. Web access for agents, no signup.

  • Screenshots, PDFs and Markdown from any URL or HTML for AI agents, via the SnapForge API

  • Web tools for agents: fetch URL as markdown (free MCP) + x402 scrape, links, AI JSON, snapshot.

View all MCP Connectors

Latest Blog Posts

MCP directory API

We provide all the information about MCP servers via our MCP API.

curl -X GET 'https://glama.ai/api/mcp/v1/servers/patrikmichi/crawlee-mcp'

If you have feedback or need assistance with the MCP directory API, please join our Discord server