Skip to main content
Glama
deenesjakoruzh
patrikmichi

Crawlee MCP

by patrikmichi
OverviewSchemaRelated ServersScoreDiscussions
TypeScript
Local

Crawlee MCP

一个用于网页抓取、爬取和截图的本地模型上下文协议服务器，基于Crawlee。它通过 stdio 运行，因此可与 Claude Code、Claude Desktop、Codex、Cursor 以及任何兼容 MCP 的客户端配合使用。

工具

工具

描述

fetch_url

获取单个 URL 并返回干净的 markdown

fetch_multiple

并行获取多个 URL

crawl

爬取网站、发现链接并返回页面内容

screenshot

对页面进行 PNG 截图

ping

健康检查

Related MCP server: Crawl4AI MCP

安装

需要 Node.js 20 或更高版本。首次使用 JavaScript 渲染或截图还需要 Chromium 浏览器：

npx playwright install chromium

一旦发布到 npm，每个客户端都可以通过以下方式启动：

npx -y @patrikmichi/crawlee-mcp

在 npm 包发布之前，直接从 GitHub 安装：

npx -y github:patrikmichi/crawlee-mcp

客户端配置

Claude Code

claude mcp add --transport stdio crawlee -- npx -y @patrikmichi/crawlee-mcp

Claude Desktop

将以下内容添加到 Claude Desktop 配置文件：

{
  "mcpServers": {
    "crawlee": {
      "command": "npx",
      "args": ["-y", "@patrikmichi/crawlee-mcp"]
    }
  }
}

Codex

将以下内容添加到 ~/.codex/config.toml：

[mcp_servers.crawlee]
command = "npx"
args = ["-y", "@patrikmichi/crawlee-mcp"]

其他 MCP 客户端

使用相同的命令和参数：npx -y @patrikmichi/crawlee-mcp。

配置

cp env.example .env

变量

必需

描述

CRAWLEE_PROXY_URLS

否

用于轮换的逗号分隔代理 URL

CRAWLEE_TIMEOUT_MS

否

请求超时时间（毫秒）（默认：30000）

CRAWLEE_STEALTH

否

设置为 false 以禁用隐身模式（默认：true）

开发

npm install
npm start          # Run with tsx (no build needed)
npm run build      # Compile TypeScript
npm run typecheck  # Type check only

此服务器特意设计为仅限本地和 stdio，因为 JavaScript 渲染和截图需要本地 Playwright 浏览器。

Install Server
A
license - permissive license
A
quality
C
maintenance

How are these scores calculated?

Maintenance

–Maintainers
–Response time
–Release cycle
–Releases (12mo)
Commit activity

Resources

Unclaimed servers have limited discoverability.

Looking for Admin?

If you are the server author, to access and configure the admin panel.

Tools

Related MCP Servers

  • AnyCrawl MCP Server

    any4ai
    A
    license
    -
    quality
    C
    maintenance
    Enables web scraping and crawling capabilities for LLM clients, supporting single-page scraping, multi-page website crawling, and web search with multiple engines (Playwright, Cheerio, Puppeteer) and flexible output formats including markdown, HTML, text, and screenshots.
    18
    6
    MIT

  • Crawl4AI MCP

    laurentvv
    A
    license
    B
    quality
    A
    maintenance
    Enables AI assistants to crawl websites, extract dynamic content, navigate links, and save structured Markdown files via the MCP protocol, with support for anti-bot bypass, CSS selectors, and custom JavaScript execution.
    1
    42
    MIT

  • weblens-mcp

    Bariskau
    A
    license
    -
    quality
    C
    maintenance
    Enables AI agents to fetch and render web pages (including JavaScript-heavy SPAs) with headless Chromium, extract readable content with Mozilla Readability, capture navigation links, download images, and return a clean markdown file path.
    12
    ISC

View all related MCP servers

Related MCP Connectors

  • Pagewatch

    Read a URL as clean markdown, screenshot a website, url to PDF. Web access for agents, no signup.

  • snapforge

    Screenshots, PDFs and Markdown from any URL or HTML for AI agents, via the SnapForge API

  • web-scraper

    Web tools for agents: fetch URL as markdown (free MCP) + x402 scrape, links, AI JSON, snapshot.

View all MCP Connectors

Latest Blog Posts

MCP directory API

We provide all the information about MCP servers via our MCP API.

curl -X GET 'https://glama.ai/api/mcp/v1/servers/patrikmichi/crawlee-mcp'

If you have feedback or need assistance with the MCP directory API, please join our Discord server