Skip to main content
Glama

Scrapy MCP tools

Production-ready MCP servers that extend AI capabilities through file access, database connections, APIs, and contextual services.

X
70,663 tools. Last updated 2026-02-08 02:29

  • scrape_webpage

    Scrapy MCP Server

    Extract and scrape webpage content using auto, simple, Scrapy, or Selenium methods. Define extraction rules or wait for specific elements to retrieve targeted data.
    MIT

  • scrape_multiple_webpages

    Scrapy MCP Server

    Concurrently scrape multiple URLs using the Scrapy MCP Server. Extract data efficiently with configurable methods (auto, simple, Scrapy, Selenium) and handling for complex web structures.
    MIT

  • clear_cache

    Scrapy MCP Server

    Remove all cached scraping results to force fresh requests in subsequent operations, ensuring updated and accurate data extraction with Scrapy MCP Server.
    MIT

  • get_server_metrics

    Scrapy MCP Server

    Retrieve detailed server performance metrics, including request counts, success rates, method usage, error categories, and cache statistics, to monitor and optimize Scrapy MCP Server operations.
    MIT

  • check_robots_txt

    Scrapy MCP Server

    Analyze a website's robots.txt file to determine crawl permissions and ensure compliance with ethical web scraping practices. Provides insights into allowed and disallowed paths for crawling.
    MIT

  • extract_links

    Scrapy MCP Server

    Extract and filter links from webpages by domain, specify internal links only, or exclude unwanted domains using this specialized web scraping tool.
    MIT

Interested in MCP?

Join the MCP community for support and updates.

RedditDiscord

Matching MCP servers

  • Scrapy MCP Server

    ThreeFish-AI
    A
    security
    A
    license
    A
    quality
    A powerful web scraping MCP server built on Scrapy and FastMCP that supports multiple scraping methods (HTTP, Scrapy, browser automation), anti-detection techniques, form handling, and concurrent crawling. Designed for commercial environments with enterprise-grade features like intelligent retry mechanisms, performance monitoring, and configurable data extraction.
    Last updated 13 days ago
    10
    2
    MIT