Crawlee MCP
Crawlee MCP
A local Model Context Protocol server for web fetching, crawling, and screenshots with Crawlee. It runs over stdio, so it works with Claude Code, Claude Desktop, Codex, Cursor, and any MCP-compatible client.
Tools
Tool | Description |
| Fetch a single URL and return clean markdown |
| Fetch multiple URLs in parallel |
| Crawl a site, discover links, and return page content |
| Take a PNG screenshot of a page |
| Health check |
Install
Requires Node.js 20 or newer. The first use of JavaScript rendering or screenshots also requires the Chromium browser:
npx playwright install chromiumOnce published to npm, every client can start it with:
npx -y @patrikmichi/crawlee-mcpUntil the npm package is published, install directly from GitHub:
npx -y github:patrikmichi/crawlee-mcpClient configuration
Claude Code
claude mcp add --transport stdio crawlee -- npx -y @patrikmichi/crawlee-mcpClaude Desktop
Add this to your Claude Desktop configuration file:
{
"mcpServers": {
"crawlee": {
"command": "npx",
"args": ["-y", "@patrikmichi/crawlee-mcp"]
}
}
}Codex
Add this to ~/.codex/config.toml:
[mcp_servers.crawlee]
command = "npx"
args = ["-y", "@patrikmichi/crawlee-mcp"]Other MCP clients
Use the same command and arguments: npx -y @patrikmichi/crawlee-mcp.
Configuration
cp env.example .envVariable | Required | Description |
| No | Comma-separated proxy URLs for rotation |
| No | Request timeout in ms (default: |
| No | Set to |
Development
npm install
npm start # Run with tsx (no build needed)
npm run build # Compile TypeScript
npm run typecheck # Type check onlyThis server is intentionally local and stdio-only because JavaScript rendering and screenshots require a local Playwright browser.
Latest Blog Posts
- Who's Calling? MCP Hosts Are an Identity Blind Spot (And the Spec Knows It)By Om-Shree-0709 on .mcpAgent IdentityOAuth 2.1
- Your AI Chatbot Just Exposed Your CEO's Salary to an InternBy Om-Shree-0709 on .Agent IdentityMCP SecurityOAuth Delegation
- Why MCP Servers Need Execution Sandboxing (And Why Your Current Stack Isn't Enough)By Om-Shree-0709 on .Agentic AiPrompt InjectionWebAssembly
MCP directory API
We provide all the information about MCP servers via our MCP API.
curl -X GET 'https://glama.ai/api/mcp/v1/servers/patrikmichi/crawlee-mcp'
If you have feedback or need assistance with the MCP directory API, please join our Discord server