Skip to main content
Glama

Crawl4AI MCP Server

by gkzhb

Crawl4AI Model Context Protocol Server

This MCP Server helps you connect to your Crawl4AI docker API server.

Built with gkzhb/fastmcp-template: TypeScript MCP Server Template.

Quick Start

Prerequisites:

  • Node.js 18+

To start Crawl4AI MCP server:

export CRAWL4AI_URL=http://your-server-ip:port npx -y @gkzhb/crawl4ai-mcp

Notice that the command above is for Crawl4AI server v0.6.x.

For Crawl4AI server before v0.6.0, please use 0.0.x:

npx -y @gkzhb/crawl4ai-mcp@0.0.8

This MCP server uses Streamable HTTP. And the default Streamable HTTP URL is http://localhost:8585/mcp. SSE is also supported and the SSE HTTP URL is http://localhost:8585/sse.

To customize MCP server, here are the shell environment variables:

VariableIf OptionalDescription
CRAWL4AI_URLRequiredCrawl4AI docker API server URL, eg. http://localhost:11545
CRAWL4AI_API_TOKENOptionalIf Crawl4AI server enables authentication, you need to use this
SERVER_PORTOptionalMCP server port, default value is 8585

This MCP also supports Browserless to crawl web page since v0.2.1

See env.ts for Browserless environment variables:

  • BROWSERLESS_URL
  • BROWSERLESS_TOKEN
  • BROWSERLESS_BLOCK_ADS
  • BROWSERLESS_STEALTH_MODE
-
security - not tested
A
license - permissive license
-
quality - not tested

remote-capable server

The server can be hosted and run remotely because it primarily relies on remote services or has no dependency on the local environment.

Connect to your Crawl4AI docker API server.

  1. Quick Start

    Related MCP Servers

    • -
      security
      A
      license
      -
      quality
      Crawl4AI MCP Server is an intelligent information retrieval server offering robust search capabilities and LLM-optimized web content understanding, utilizing multi-engine search and intelligent content extraction to efficiently gather and comprehend internet information.
      Last updated -
      100
      Python
      MIT License
      • Apple
      • Linux
    • A
      security
      F
      license
      A
      quality
      An MCP Server for Web scraping and Crawling, built using Crawl4AI
      Last updated -
      2
      24
      Python
    • -
      security
      -
      license
      -
      quality
      Exposes CrewAI tools through a REST API that allows Claude and other LLMs to access web search functionality, data analysis capabilities, and custom CrewAI tools.
      Last updated -
      1
      Python

    View all related MCP servers

    MCP directory API

    We provide all the information about MCP servers via our MCP API.

    curl -X GET 'https://glama.ai/api/mcp/v1/servers/gkzhb/crawl4ai-mcp'

    If you have feedback or need assistance with the MCP directory API, please join our Discord server