Skip to main content
Glama
spider-rs

spider-cloud-mcp

by spider-rs
OverviewSchemaRelated ServersScoreDiscussions
JavaScript
Remote

spider-cloud-mcp

MCP server for the Spider web crawling and scraping API. Crawl, scrape, search, and extract web data for AI agents, RAG pipelines, and LLMs.

Setup

1. Get your API key

Sign up at spider.cloud and get your API key from the API Keys page.

2. Configure your MCP client

Claude Desktop

Add to your claude_desktop_config.json:

{
  "mcpServers": {
    "spider": {
      "command": "npx",
      "args": ["-y", "spider-cloud-mcp"],
      "env": {
        "SPIDER_API_KEY": "your-api-key"
      }
    }
  }
}

Claude Code

claude mcp add spider -- npx -y spider-cloud-mcp

Then set your API key in the environment or .env file:

SPIDER_API_KEY=your-api-key

Cursor

Add to your Cursor MCP settings:

{
  "mcpServers": {
    "spider": {
      "command": "npx",
      "args": ["-y", "spider-cloud-mcp"],
      "env": {
        "SPIDER_API_KEY": "your-api-key"
      }
    }
  }
}

Related MCP server: crawl4ai-mcp

Tools

Core Tools

Tool

Description

spider_crawl

Crawl a website and extract content from multiple pages

spider_scrape

Scrape a single page (no crawling)

spider_search

Search the web with optional page content fetching

spider_links

Extract all links from a page

spider_screenshot

Capture page screenshots

spider_unblocker

Access bot-protected content with anti-bot bypass

spider_transform

Transform HTML to markdown/text/other formats

spider_get_credits

Check your credit balance

AI Tools (Subscription Required)

These tools require an active AI subscription plan.

Tool

Description

spider_ai_crawl

AI-guided crawling with natural language prompts

spider_ai_scrape

Extract structured data using plain English

spider_ai_search

AI-enhanced semantic web search

spider_ai_browser

Automate browser interactions with natural language

spider_ai_links

Intelligent link extraction and filtering

Examples

Crawl a website to markdown

Use spider_crawl to crawl https://example.com with limit 10 and return_format "markdown"

Search the web

Use spider_search to search for "latest AI research papers" with fetch_page_content true and num 5

AI-powered extraction

Use spider_ai_scrape on https://news.ycombinator.com with prompt "Extract all article titles, URLs, points, and comment counts as structured JSON"

Check credits

Use spider_get_credits to check my balance

API Reference

Full API documentation: spider.cloud/docs/api

License

MIT

This server cannot be installed

A
license - permissive license
-
quality - not tested
C
maintenance

How are these scores calculated?

Maintenance

–Maintainers
–Response time
–Release cycle
–Releases (12mo)
Commit activity

Resources

Unclaimed servers have limited discoverability.

Looking for Admin?

If you are the server author, to access and configure the admin panel.

Related MCP Servers

  • crawl4ai-mcp

    stgmt
    A
    license
    -
    quality
    C
    maintenance
    MCP server integrating Crawl4AI for universal web crawling and data extraction. Enables AI agents to crawl, extract markdown/HTML, take screenshots, generate PDFs, and execute JavaScript on web pages.
    Last updated
    143
    7
    MIT

  • crawl4ai-mcp-server

    sadiuysal
    A
    license
    -
    quality
    D
    maintenance
    A lightweight MCP server that exposes Crawl4AI web scraping and crawling capabilities as tools for AI agents, enabling single-page scraping and multi-page crawling with adaptive stopping.
    Last updated
    101
    MIT

  • crawl4ai-mcp-server

    amienbou121
    -
    license
    -
    quality
    C
    maintenance
    Self-hosted MCP server that provides web scraping and crawling tools, integrating seamlessly with AI frameworks like OpenAI Agents SDK, Cursor, and Claude Code.
    Last updated
    4

View all related MCP servers

Related MCP Connectors

  • mcp-serp

    MCP server for Google search results via SERP API

  • Rampify

    SEO MCP server: crawl your site, find AI-visibility gaps, and ship the fix from your coding agent.

  • GTM API: LinkedIn MCP Server

    Managed LinkedIn MCP server for AI agents: search, connect, message and enrich on accounts you own.

View all MCP Connectors

Latest Blog Posts

MCP directory API

We provide all the information about MCP servers via our MCP API.

curl -X GET 'https://glama.ai/api/mcp/v1/servers/spider-rs/spider-cloud-mcp-server'

If you have feedback or need assistance with the MCP directory API, please join our Discord server