"Scrapy" matching MCP servers:

A headless web-scraping MCP server built on Scrapy, providing tools for polite fetching, CSS/XPath extraction, link/table extraction, sitemap and robots.txt reading, and bounded asynchronous crawls.

Enables real-time job discovery across multiple job boards and remote APIs, providing normalized and deduplicated job listings to AI agents via MCP.

A general-purpose MCP server for crawling and extracting structured data from any website. Supports tools for crawling, single-page extraction, search-and-crawl, and schema extraction.

A powerful web scraping MCP server built on Scrapy and FastMCP that supports multiple scraping methods (HTTP, Scrapy, browser automation), anti-detection techniques, form handling, and concurrent crawling. Designed for commercial environments with enterprise-grade features like intelligent retry mechanisms, performance monitoring, and configurable data extraction.

Real-time Amazon Sponsored Products (SP) ad placements, keyword tracking, and comprehensive review data for AI Agents. Enables LLMs to autonomously conduct competitor ad audits, consumer sentiment analysis (VOC), and product optimization.

Local MCP server for web search and page extraction, providing clean markdown from URLs, search results, site mapping, and research endpoints without API keys or accounts.

A server that enables web scraping of difficult-to-access websites affected by bot detection, captchas, or geolocation restrictions, returning results in either HTML or Markdown format.

MCP server that exposes Abrasio as an agentic browser for AI models, allowing Claude, Cursor, and other MCP-compatible AIs to control a real web browser with anti-detection fingerprinting.

Enables AI models to fetch real web pages while automatically bypassing anti-bot protections, login walls, and JS rendering, then returns clean, token-efficient article content.

Extracts YouTube video metadata, titles, and descriptions along with transcripts generated from subtitles or OpenAI Whisper speech-to-text. This server enables users to retrieve and analyze detailed video content directly within MCP-compatible environments.

Enables AI assistants to access Twitter/X data, including user profiles, tweets, trends, and more, through the ScrapeBadger API.

Pay-per-call web scraping for AI agents — no signup, no API keys, just USDC micropayments via the x402 protocol on Base

MCP server that converts URLs to clean Markdown/Text for LLM agents.

Provides AI agents with real-time vision and control over Android devices through screen streaming, UI automation, and fast input control via scrcpy protocol.

MCP server that gives AI agents full vision and control over Android devices via ADB and scrcpy. Supports screenshots, input, apps, UI automation, shell, files, and clipboard.

MCP server for Android device control via ADB and scrcpy, enabling AI agents to see and interact with Android devices.

A Model Context Protocol server that enables AI clients to interact with virtual Ubuntu desktops, allowing them to browse the web, run code, and control instances through mouse/keyboard actions and bash commands.

Enables agents to run Google searches across web, images, videos, news, books, shopping, scholar, patents, and AI Mode without an API key, using a cookie-bootstrapped HTTP fast path with a headless browser fallback, proxy rotation, and adaptive cooldowns. Every response reports an explicit status (ok, blocked, rate_limited, empty, error) so results are never fabricated.

This Serper MCP Server supports search and webpage scraping, and all the most recent parameters introduced by the Serper API, like location.

Enables web search via Serper API with advanced search operators and webpage scraping capabilities to extract content in plain text or markdown format.

Local MCP server for observing and controlling an authorized Android device over USB using ADB and scrcpy, providing screen capture, UI automation, app inspection, logcat, and evidence recording.

A comprehensive web scraping server that transforms web content into clean, agent-ready Markdown with automatic citations and efficient caching. It features a robust suite of tools for metadata extraction, sentiment analysis, SEO auditing, and security scanning while strictly adhering to robots.txt policies.

Enables LLMs to perform web browsing tasks, take screenshots, and execute JavaScript using Puppeteer for browser automation.

Exposes a dynamically registered tool for each public social data endpoint, letting MCP clients like Claude, Cursor, and VS Code pull profiles, posts, comments, transcripts, and search results as clean typed JSON from nine platforms. Tool descriptions surface credit costs and returned fields upfront, with failed calls refunded, bounded results, and readable errors that never auto-retry.

Gives AI agents vision and control over Android devices using ADB and scrcpy, enabling screenshots, input gestures, app management, UI automation, shell commands, file transfer, and audio/video streaming.

Enables converting any URL or website into clean, LLM-ready Markdown, supporting single-page scraping and full-site crawling for AI agents.

Enables scraping and fetching websites with protection handling like Cloudflare and captchas, via an MCP interface.

Enables AI agents to see and control Android devices through ADB and scrcpy, supporting screenshots, input, app management, UI automation, shell/file access, and audio/video streaming.

Gives AI agents vision and control over Android devices through ADB and scrcpy, enabling screenshots, taps, swipes, typing, app launching, UI inspection, file transfer, and shell commands. Uses scrcpy's control protocol for fast input and near-instant screenshots, with ADB as a fallback.

Gives AI agents vision and control over Android devices through ADB and scrcpy, enabling them to capture screenshots, tap, swipe, type, launch and manage apps, inspect UI elements, stream audio and video, transfer files, and run shell commands. Input and screenshots run over a fast binary control protocol when a session is active, with ADB fallback so interaction keeps working without scrcpy.