Skip to main content
Glama
737,131 tools. Updated 2026-11-02 18:53

"Scrapy" matching MCP tools:

  • Extract and scrape webpage content using auto, simple, Scrapy, or Selenium methods. Define extraction rules or wait for specific elements to retrieve targeted data.
    MIT
  • Generate web scrapers using Playwright, Scrapy, or httpx with anti-bot configuration and data extraction logic to pull structured content from websites.
    MIT
  • Fetch any webpage’s full content as markdown, HTML, PDF, or screenshot, using automatic JavaScript rendering and proxies to handle protected or dynamic pages.
    MIT
  • Fetch raw HTML content from any URL with optional JavaScript rendering for dynamic websites and Single Page Applications.
    MIT
  • Fetch a single URL and return selected page content—markdown, HTML, links, images, screenshots, or metadata—for one-shot extraction; use CSS selectors to pull named values like prices and titles.
    Apache 2.0
  • Fetch a webpage and return its text content synchronously, with optional country proxy routing or cache bypass for fresh results.
    MIT

Matching MCP Servers

  • A
    license
    A
    quality
    D
    maintenance
    A headless web-scraping MCP server built on Scrapy, providing tools for polite fetching, CSS/XPath extraction, link/table extraction, sitemap and robots.txt reading, and bounded asynchronous crawls.
    10
    MIT
  • A
    license
    Not graded
    quality
    B
    maintenance
    Enables real-time job discovery across multiple job boards and remote APIs, providing normalized and deduplicated job listings to AI agents via MCP.
    MIT

Matching MCP Connectors

  • Pay-per-call web scraping for AI agents — no signup, no API keys, just USDC micropayments via the x402 protocol on Base. Six tools: scrape webpages, extract structured data, capture screenshots, parse metadata, manage browser sessions, and run workflows. Runs on Cloudflare Workers with Browser Rendering. Free tier: 10 calls per wallet per 30 days.

  • Pay-per-call web scraping for AI agents via x402 on Base USDC. Six tools, no signup.

  • Fetch a URL and return its content as clean, LLM-ready Markdown. Automatically renders JavaScript and bypasses bot detection for any single page.
    MIT
  • Fetch a single web page through a residential proxy and return clean Markdown, escalating to a real browser when bot-protected. Supports structured or AI extraction for targeted data.
    MIT
  • Fetch a URL to get clean markdown or AI-extracted structured JSON. Enable browser rendering for JavaScript-heavy pages and login-protected content.
    Apache 2.0
  • Scrape any URL through Sessemi, bypassing Cloudflare, DataDome, and Akamai anti-bot protections. Returns page content as HTML or JSON.
    MIT
  • Scrapes a single web page and returns its content as structured JSON with markdown, HTML, links, or metadata.
    Apache 2.0
  • Search keywords to return structured candidate URLs with titles and snippets, so you can find entry points before fetching full page content.
    MIT
  • Fetch a public URL and convert it to clean, readable markdown with extraction details. Handles HTML, JavaScript-rendered pages, and PDFs, while verifying redirects and upstream errors.
    Apache 2.0
  • Generate a ready-to-use NodeMaven proxy URL with geo-targeted username for curl, Playwright, or Scrapy. Encodes country, session, and IP filters into the connection string.
    MIT
  • Fetch and read a single URL, including JavaScript-heavy and bot-protected pages, returning Markdown content that bypasses blocks and consent walls.
    MIT
  • Scrape any public webpage by providing a target URL and API key. Automatically handles rotating proxies, CAPTCHA bypass, and optional JavaScript rendering to return the raw HTML.
    MIT
  • Search live web or news index and return ranked results with URLs, titles, and snippets. Customize query, type, and limit for precise findings.
    Apache 2.0
  • Check Scrapyard's version, breaker state, adapter registry, and cache counters to diagnose search failures or fallback adapter usage.
    Apache 2.0
  • Extract structured JSON from web pages by defining field schemas, returning targeted field values instead of full-page text for direct storage or analysis.
    MIT
  • Start an asynchronous website crawl and immediately return a job ID, allowing multi-page crawls to run in the background without blocking MCP requests.
    MIT