A
licenseB
qualityD
maintenanceA local web scraping MCP server with RAG capabilities that provides intelligent web search, content extraction, and screenshot tools without requiring API keys.
Last updated
4
28
MIT
Arachne MCP Server
This server provides 9 MCP tools for web scraping, browser automation, computer vision, audio transcription, and RAG-based querying, powered by the Arachne backend.
🌐 Web Search & Scraping:
arachne_search: Perform web searches via DuckDuckGo, returning titles, URLs, and descriptions.arachne_scrape: Extract clean markdown from static pages, blogs, and documentation.arachne_extract: Auto-detect and extract content from web pages, audio, video, PDFs, images, and YouTube, with output in JSON, CSV, XLSX, PPTX, or Markdown.arachne_browser_extract: Real browser extraction with Cloudflare/CAPTCHA/WAF evasion, optionally capturing screenshots.
🤖 Browser Automation:
arachne_browser_run: Execute sequences of actions (navigate, click, type, select, wait, scroll, extract, screenshot) for login flows and multi-page forms.
👁️ Computer Vision:
arachne_vision: Analyze images for OCR text, color palette, face detection, quality metrics, and AI-generated descriptions; supports optional custom questions.
🎙️ Audio Transcription:
arachne_transcribe: Transcribe audio, video, or YouTube URLs using Whisper, with selectable model size and language options.
🧠 RAG Knowledge Base:
arachne_query: Ask questions to a RAG knowledge base, receiving grounded answers with source citations.
📡 Discovery:
arachne_capabilities: Auto-discover all available features and recommended tools of the Arachne platform.
Web search using DuckDuckGo via the arachne_search tool.
Extract content and transcribe audio from YouTube videos using arachne_extract and arachne_transcribe.
Click on "Install Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@Arachne MCP Serversearch for latest AI news"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
🕷️ Arachne MCP Server
9 MCP tools para web scraping, browser automation, visão computacional, transcrição de áudio e RAG — tudo via API.
Conecta no Arachne como backend. Funciona com Claude Desktop, Cursor, Codex CLI, e qualquer cliente MCP.
✨ Tools
Tool | O que faz | Ideal para |
| Busca na web via DuckDuckGo | Pesquisa, coleta de informações |
| Extrai markdown limpo de URLs | Páginas estáticas, blogs, docs |
| Extrai QUALQUER formato (áudio, vídeo, PDF, YouTube) | Canivete suíço |
| Navegador real com evasão Cloudflare/CAPTCHA | Sites que bloqueiam scraper |
| Executa ações em navegador (click, type, login) | Automação de formulários |
| Pergunta pra sua base de conhecimento RAG | Chatbot com seus dados |
| Analisa imagens: OCR, cores, faces, descrição AI | Extrair texto de fotos |
| Transcreve áudio/vídeo/YouTube com Whisper | Podcast, reunião, vídeo |
| Auto-descoberta de capacidades | Saber o que o Arachne faz |
Related MCP server: CloakMCP
🚀 Quick Start
1. Pegue uma API Key
Crie em arachne.seu.pet/dev (plano Free: 500 req/mês).
2. Configure no Claude Desktop
{
"mcpServers": {
"arachne": {
"command": "python3",
"args": ["-m", "arachne_mcp"],
"env": {
"ARACHNE_API_KEY": "sua_chave_aqui"
}
}
}
}3. Ou teste direto
export ARACHNE_API_KEY="sua_chave"
python3 arachne_mcp.pyPrecisa de
httpx:pip install httpx
📦 Como funciona
O MCP server é um cliente HTTP que chama a API pública do Arachne. Zero dependência de infra local — roda de qualquer lugar.
Seu agente AI → MCP stdio → arachne_mcp.py → HTTP → Arachne API → resultado🔧 Exemplos
# Via arachne-sdk (pip install arachne-sdk)
from arachne_sdk import Arachne
client = Arachne(api_key="sua_chave")
# Busca na web
results = client.search("preço iPhone 16 Brasil")
for r in results:
print(f"{r.title}: {r.url}")
# Extrair página
content = client.scrape("https://exemplo.com")
print(content[:500])
# Analisar imagem
vision = client.vision("https://exemplo.com/foto.jpg")
print(vision.ocr.text)
# Perguntar ao RAG
answer = client.query("Qual a diferença do Arachne pro Firecrawl?")
print(answer)📊 Planos
Plano | Preço | Requests/mês | Features |
Free | R$ 0 | 500 | search, scrape, jobs |
Pro | R$ 49/mês | 10.000 | + browser, vision, transcribe, MCP |
Enterprise | R$ 199/mês | 100.000 | + admin, export, suporte dedicado |
🏗️ Stack
Backend: FastAPI + Crawl4AI + Whisper + Tesseract + SQLite
Engines: Trafilatura → Crawl4AI SDK → Sidecar Docker → Camoufox
MCP Transport: stdio (compatível com Claude Desktop, Cursor, Codex)
🔗 Links
🕷️ Built with the Arachne engine. Open source MCP server.
Maintenance
–Maintainers
–Response time
–Release cycle
–Releases (12mo)
Commit activity
Issues opened vs closed
Resources
Unclaimed servers have limited discoverability.
Looking for Admin?
If you are the server author, to access and configure the admin panel.
Related MCP Servers
- AlicenseAqualityDmaintenanceAn MCP server that provides LLMs with stealth browser automation capabilities via CloakBrowser to bypass bot detection services like Cloudflare and reCAPTCHA. It supports full page interaction, content extraction, and human-like behavior through 30 specialized tools.Last updated2012Apache 2.0
- AlicenseAqualityDmaintenanceMCP server for AI browser automation with tools for navigation, actions, data extraction, and scripting, supporting local and cloud execution.Last updated141032Apache 2.0
- -license-qualityCmaintenanceSelf-hosted MCP server that provides web scraping and crawling tools, integrating seamlessly with AI frameworks like OpenAI Agents SDK, Cursor, and Claude Code.Last updated4
Related MCP Connectors
OCR, transcription, file extraction, and image generation for AI agents via MCP.
MCP server exposing the Backtest360 engine API as tools for AI agents.
Hosted MCP with 91 agent tools: X, domains, SEO, Maps, Trends, Search, YouTube, TikTok, and more.
Latest Blog Posts
- Who's Calling? MCP Hosts Are an Identity Blind Spot (And the Spec Knows It)By Om-Shree-0709 on .mcpAgent IdentityOAuth 2.1
- Your AI Chatbot Just Exposed Your CEO's Salary to an InternBy Om-Shree-0709 on .Agent IdentityMCP SecurityOAuth Delegation
- Why MCP Servers Need Execution Sandboxing (And Why Your Current Stack Isn't Enough)By Om-Shree-0709 on .Agentic AiPrompt InjectionWebAssembly
MCP directory API
We provide all the information about MCP servers via our MCP API.
curl -X GET 'https://glama.ai/api/mcp/v1/servers/Samuelfmedeiros/arachne-mcp'
If you have feedback or need assistance with the MCP directory API, please join our Discord server