spider-cloud-mcp
Click on "Install Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@spider-cloud-mcpCrawl https://docs.spider.cloud and limit to 10 pages"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
spider-cloud-mcp
MCP server for the Spider web crawling and scraping API. Crawl, scrape, search, and extract web data for AI agents, RAG pipelines, and LLMs.
Setup
1. Get your API key
Sign up at spider.cloud and get your API key from the API Keys page.
2. Configure your MCP client
Claude Desktop
Add to your claude_desktop_config.json:
{
"mcpServers": {
"spider": {
"command": "npx",
"args": ["-y", "spider-cloud-mcp"],
"env": {
"SPIDER_API_KEY": "your-api-key"
}
}
}
}Claude Code
claude mcp add spider -- npx -y spider-cloud-mcpThen set your API key in the environment or .env file:
SPIDER_API_KEY=your-api-keyCursor
Add to your Cursor MCP settings:
{
"mcpServers": {
"spider": {
"command": "npx",
"args": ["-y", "spider-cloud-mcp"],
"env": {
"SPIDER_API_KEY": "your-api-key"
}
}
}
}Related MCP server: crawl4ai-mcp
Tools
Core Tools
Tool | Description |
| Crawl a website and extract content from multiple pages |
| Scrape a single page (no crawling) |
| Search the web with optional page content fetching |
| Extract all links from a page |
| Capture page screenshots |
| Access bot-protected content with anti-bot bypass |
| Transform HTML to markdown/text/other formats |
| Check your credit balance |
AI Tools (Subscription Required)
These tools require an active AI subscription plan.
Tool | Description |
| AI-guided crawling with natural language prompts |
| Extract structured data using plain English |
| AI-enhanced semantic web search |
| Automate browser interactions with natural language |
| Intelligent link extraction and filtering |
Examples
Crawl a website to markdown
Use spider_crawl to crawl https://example.com with limit 10 and return_format "markdown"Search the web
Use spider_search to search for "latest AI research papers" with fetch_page_content true and num 5AI-powered extraction
Use spider_ai_scrape on https://news.ycombinator.com with prompt "Extract all article titles, URLs, points, and comment counts as structured JSON"Check credits
Use spider_get_credits to check my balanceAPI Reference
Full API documentation: spider.cloud/docs/api
License
MIT
This server cannot be installed
Maintenance
Resources
Unclaimed servers have limited discoverability.
Looking for Admin?
If you are the server author, to access and configure the admin panel.
Latest Blog Posts
- Your AI Chatbot Just Exposed Your CEO's Salary to an InternBy Om-Shree-0709 on .Agent IdentityMCP SecurityOAuth Delegation
- Why MCP Servers Need Execution Sandboxing (And Why Your Current Stack Isn't Enough)By Om-Shree-0709 on .Agentic AiPrompt InjectionWebAssembly
MCP directory API
We provide all the information about MCP servers via our MCP API.
curl -X GET 'https://glama.ai/api/mcp/v1/servers/spider-rs/spider-cloud-mcp-server'
If you have feedback or need assistance with the MCP directory API, please join our Discord server