What can you do with this server?

This server provides 9 MCP tools for web scraping, browser automation, computer vision, audio transcription, and RAG-based querying, powered by the Arachne backend. 🌐 Web Search & Scraping: * arachne_search: Perform web searches via DuckDuckGo, returning titles, URLs, and descriptions. * arachne_scrape: Extract clean markdown from static pages, blogs, and documentation. * arachne_extract: Auto-detect and extract content from web pages, audio, video, PDFs, images, and YouTube, with output in JSON, CSV, XLSX, PPTX, or Markdown. * arachne_browser_extract: Real browser extraction with Cloudflare/CAPTCHA/WAF evasion, optionally capturing screenshots. 🤖 Browser Automation: * arachne_browser_run: Execute sequences of actions (navigate, click, type, select, wait, scroll, extract, screenshot) for login flows and multi-page forms. 👁️ Computer Vision: * arachne_vision: Analyze images for OCR text, color palette, face detection, quality metrics, and AI-generated descriptions; supports optional custom questions. 🎙️ Audio Transcription: * arachne_transcribe: Transcribe audio, video, or YouTube URLs using Whisper, with selectable model size and language options. 🧠 RAG Knowledge Base: * arachne_query: Ask questions to a RAG knowledge base, receiving grounded answers with source citations. 📡 Discovery: * arachne_capabilities: Auto-discover all available features and recommended tools of the Arachne platform.

Which integrations are available for this server?

Web search using DuckDuckGo via the arachne_search tool. Extract content and transcribe audio from YouTube videos using arachne_extract and arachne_transcribe.

How do I use Arachne MCP Server?

1. Click on "Deploy Server". 2. Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state. 3. In the chat, type @ followed by the MCP server name and your instructions, e.g., "@Arachne MCP Server search for latest AI news" That's it! The server will respond to your query, and you can continue using it as needed. Here is a step-by-step guide with screenshots.

🕷️ Arachne MCP Server

🌐 English · 🇧🇷 Português

49 MCP tools for web scraping, browser automation, computer vision, audio transcription, RAG, Social Sentiment Research, and Visual Regression Testing (VRT) — the Oito Olhos (Spider's Eight Eyes) — all through the Arachne API.

Backed by Arachne. Works with Claude Desktop, Cursor, Codex CLI, Hermes, and any MCP client.

✨ Tools (49)

🔍 Web & Data

Tool	What it does	Best for
`arachne_search`	Web search via DuckDuckGo	Research, lead collection
`arachne_scrape`	Clean markdown from URLs	Static pages, blogs, docs
`arachne_extract`	Extracts ANY format (audio, video, PDF, YouTube)	Swiss-army knife
`arachne_browser_extract`	Real browser with Cloudflare/CAPTCHA evasion	Sites that block scrapers
`arachne_browser_run`	Browser actions (click, type, login)	Form automation
`arachne_screenshot`	Screenshot of a URL (full page or viewport)	Visual evidence
`arachne_record`	Records a screencast of a page (.webm)	Interactions, demos
`arachne_torrent_extract`	Extracts magnet links from BR torrent sites	Torrent acquisition
`arachne_download`	Universal download (URL, repo, PyPI, npm)	Fetch any artifact
`arachne_query`	Ask your RAG knowledge base	Chatbot with your data

Tool	What it does	Best for
`arachne_social_research`	Searches what people REALLY say (HN/Reddit/YouTube, last N days) + AI judge via local VLM	Hype vs reality, complaints, market sentiment

👁️ Vision & Audio

Tool	What it does	Best for
`arachne_vision`	Image analysis: OCR, colors, faces, AI description	Text extraction from photos
`arachne_screenshot_vision`	Screenshot + full vision pipeline	Visual page inspection
`arachne_pdf_vision`	Extracts images from PDF + vision analysis	Scanned PDFs
`arachne_analyze_video`	Video metadata: colors, OCR, geometry, VQA, audio	Video understanding
`arachne_transcribe`	Audio/video/YouTube transcription with Whisper	Podcast, meeting, video

🕷️ Oito Olhos — Visual Regression Testing (VRT)

Tool	What it does	Best for
`arachne_visual_snapshot`	Captures URL → creates baseline (1st time) or compares	Idempotent visual tests
`arachne_visual_diff`	Compares with baseline → diff + semantic verdict	Post-deploy verification
`arachne_visual_gates`	Deterministic audit: overflow, text collision, JS errors	Key-free, no baseline
`arachne_visual_report`	Test suite → HTML side-by-side	Consolidated review
`arachne_visual_approve`	Promotes current → new baseline	Accept an expected change
`arachne_visual_list`	Lists baselines + status	Monitor what exists
`arachne_visual_video`	Video VRT: records screencast + compares (animations)	Hover, carousels, transitions
`arachne_visual_video_report`	Video suite → interactive HTML report	Animation regression review

🤖 Desktop & Agentic

Tool	What it does	Best for
`arachne_desktop`	Desktop control (windows, type, key, click)	OS automation
`arachne_desktop_os`	Desktop agentic with VLM "eye" (screenshot + describe)	See before acting
`arachne_observe`	Screenshot + numbered clickable bounding boxes	GUI agent navigation

📦 GitHub / GitLab / Packages

Tool	What it does
`arachne_repo_download`	Download GitHub repo as zip (branch/token)
`arachne_repo_fork`	Fork a GitHub repo
`arachne_repo_forks`	List forks by stars
`arachne_repo_index`	Download + index repo into RAG
`arachne_releases`	List GitHub releases with assets
`arachne_release_download`	Download a release asset
`arachne_pypi_download`	Download PyPI package (sdist/wheel)
`arachne_npm_download`	Download npm package tarball
`arachne_gitlab_download`	Download GitLab project archive
`arachne_github_trending`	GitHub trending repos + developers (period/language, zero cost)
`arachne_github_user_prs`	PRs authored by a user (since/until filters)
`arachne_github_user_activity`	Monthly activity + event types for a user
`arachne_github_repo_metadata`	Full repo metadata (stars/forks/issues/license)

🧠 Code Knowledge Graph

Tool	What it does
`code_graph`	Explore code structure: stats, search, routes, files, deps
`kg_context`	Ranked BFS code context (~2K tokens)
`kg_communities`	Community detection (Leiden/greedy)
`kg_god_nodes`	Most influential code entities (PageRank)
`kg_watch`	Git watcher — incremental change detection

🧭 Utilities

Tool	What it does
`arachne_capabilities`	Auto-discover capabilities
`arachne_ping`	Health check
`arachne_metrics`	Server metrics (CPU, RAM, disk)
`arachne_plan`	Goal analysis → tool chain suggestion
`arachne_calc`	Safe math calculator (AST-sandboxed)
`arachne_format_converter`	Universal converter (65+ formats)
`arachne_sandbox_status`	Check ai-jail sandbox availability

VRT with local LLM: Oito Olhos uses pixel diff + DOM pairing + CLIP semantic triage + local VLM (Qwen2.5-VL via Douglas, Samuel mirror fallback) — classifying changes as regression | expected | noise, with a fix suggestion (CORRECAO:) when it detects a bug. No third-party API key for the verdict.

Social Research with local AI judge: arachne_social_research searches Hacker News (Algolia), Reddit (JSON API + browser_agent/Camoufox fallback) and YouTube (yt-dlp) in the last N days, scores by real engagement (upvotes/points/views), and synthesizes a hype vs reality report with a local VLM (no third-party API keys).

Related MCP server: CloakMCP

🚀 Quick Start

1. Get an API key

Create one at arachne.seu.pet/dev (Free plan: 500 req/month).

2. Configure in Claude Desktop

{
  "mcpServers": {
    "arachne": {
      "command": "python3",
      "args": ["-m", "arachne_mcp"],
      "env": {
        "ARACHNE_API_KEY": "arn_your_key_here",
        "ARACHNE_API_URL": "https://arachne.seu.pet"
      }
    }
  }
}

3. Or run directly

pip install arachne-mcp
export ARACHNE_API_KEY="arn_your_key_here"
python3 -m arachne_mcp

🪟 Windows install (works out of the box)

arachne-mcp is a pure-Python client (only httpx) — no Linux-only dependencies, no WSL required. Install it on Windows with:

pip install arachne-mcp

Then configure it in any MCP client using the console-script entry point (arachne-mcp is on your PATH after install):

{
  "mcpServers": {
    "arachne": {
      "command": "arachne-mcp",
      "args": [],
      "env": {
        "ARACHNE_API_KEY": "arn_your_key_here",
        "ARACHNE_API_URL": "https://arachne.seu.pet"
      }
    }
  }
}

⚠️ Do not point command at a Linux path (e.g. /home/user/.../venv/bin/arachne-mcp) — that only exists on the machine where the Arachne server runs. On Windows (and any other client machine) use the pip package + API key: the server does all heavy work (browser, VLM, vision, RAG) behind https://arachne.seu.pet.

📡 Architecture

The MCP server is a thin proxy: it forwards each tool call to the Arachne API (POST /api/mcp/proxy), which executes the tool server-side and returns the result. This keeps the client light (only httpx), while all heavy work — browser, VLM, vision, RAG — runs on the Arachne server.

Claude Desktop / Cursor / Codex
        │  MCP (stdio)
        ▼
arachne-mcp (thin proxy, 49 tools)
        │  HTTP + X-API-Key
        ▼
Arachne API (arachne.seu.pet) → executes tool → returns JSON

🔐 Security

API key auth: every request carries X-API-Key (create at /dev)
Rate limits enforced server-side per plan
No code runs client-side — the proxy only forwards arguments

Available Tools

9 tools

arachne_browser_extractA

Extract content using a real browser with Cloudflare/CAPTCHA/WAF evasion. Use when arachne_scrape fails.

Inputs: url (required), screenshot.

arachne_browser_runB

Execute actions in a real browser: click, type, navigate, screenshot. For login flows, multi-page forms.

Inputs: url (required), actions (required), screenshot.

arachne_capabilitiesA

Auto-discover all capabilities, engines, and recommended tools of the Arachne platform.

Inputs: no named parameters.

arachne_extractB

Universal extract — auto-detects format. Works with web pages, audio, video, PDFs, images, YouTube.

Inputs: url (required), format.

arachne_queryB

Ask questions to a RAG knowledge base. Retrieves grounded answers with source citations.

Inputs: question (required), kb_id.

arachne_scrapeA

Extract clean markdown from any URL. Best for static pages, blogs, docs.

Inputs: url (required).

arachne_searchB

Search the web via DuckDuckGo. Returns titles, URLs, and descriptions.

Inputs: query (required), limit.

arachne_transcribeB

Transcribe audio, video, or YouTube URL using Whisper. Supports MP3, WAV, MP4, WebM, YouTube.

Inputs: url (required), language, model.

arachne_visionA

Analyze an image: OCR text extraction, color palette, face detection, quality metrics, AI description.

Inputs: image_url (required), question.

Tool Schema Changelog

Recent tool additions, removals, and schema changes observed during successful MCP inspections.

Loading tool schema changelog…

Deploy Server

One endpoint for every MCP toolRayrun runs every MCP server behind one URL and holds the credentials. Each call is decided per client, tool, and argument, then recorded.ray.runAd

TDQS

A3.8/5.0

Scored 2026-06-23 23:40 across 9 tools

Disambiguation5/5

Each tool has a distinct purpose: web search, static scraping, universal extraction, browser automation, transcription, vision, RAG querying, and capabilities discovery. No overlap or ambiguity exists.

Naming Consistency5/5

All tools follow the 'arachne_verb' pattern (e.g., arachne_scrape, arachne_extract, arachne_search). Even 'arachne_capabilities' fits as a clear noun-based exception. The naming is predictable and intuitive.

Tool Count5/5

With 9 tools, the server is well-scoped for a web/media extraction and automation platform. Each tool serves a distinct purpose without feeling sparse or bloated.

Completeness4/5

The set covers core workflows: scraping, browser interaction, search, transcription, vision, RAG, and capabilities. Minor gaps like file management or output processing do not hinder typical use cases.

Maintenance

ActivityNo data

ResponsivenessOutdated data

Resources

Related MCP Connectors

Irmu — Web Data MCP
io.github.polgoide
Web scraping, browser automation, screenshots and AI data extraction for AI agents via MCP.
Browser Automation Web Scraping Agent Orchestration
1
https://app.irmu.com/mcp
mcp-serverA
io.alterlab
Web scraping MCP server — scrape, extract structured data, screenshot any site with anti-bot bypass.
Web Scraping Browser Automation
7312
https://mcp.alterlab.io/mcp
SearchPipeA
tech.searchpipe
Web search API and MCP server for developers building AI agents.
Search Browser Automation Agent Orchestration
31
https://searchpipe.tech/mcp/
Novada MCP
io.github.NovadaLabs
One MCP server for all web data. Scrape, search, crawl, and AI research in one install.
Browser Automation Web Scraping Search
13
https://mcp.novada.com/mcp

Related MCP Servers

ISIS MCP
RAG Systems Web Scraping Search
alucardeht
A
license
B
quality
D
maintenance
A local web scraping MCP server with RAG capabilities that provides intelligent web search, content extraction, and screenshot tools without requiring API keys.
Updated 9 months ago (2026-02-25 04:07 UTC)
4
12 npm
MIT
CloakMCP
Browser Automation Web Scraping
overtimepog
A
license
A
quality
C
maintenance
An MCP server that provides LLMs with stealth browser automation capabilities via CloakBrowser to bypass bot detection services like Cloudflare and reCAPTCHA. It supports full page interaction, content extraction, and human-like behavior through 30 specialized tools.
Updated 20 days ago (2026-10-26 14:59 UTC)
20
52 PyPI
14
Apache 2.0
Browser Automation MCP
Browser Automation Autonomous Agents
PopoverAI
A
license
A
quality
B
maintenance
MCP server for AI browser automation with tools for navigation, actions, data extraction, and scripting, supporting local and cloud execution.
Updated a month ago (2026-09-30 19:20 UTC)
14
496 npm
3
Apache 2.0
hidrix-tools
Search Web Scraping Social Media
sonpiaz
A
license
Not graded
quality
C
maintenance
MCP tool server that gives any AI agent the ability to search, scrape, and analyze content across the internet.
Updated 2 months ago (2026-09-12 18:37 UTC)
42
MIT