Skip to main content
Glama
72,746 servers. Updated

Matching MCP tools:

Matching MCP Connectors:

"Web crawling techniques and tools" matching MCP servers:

  • redup.mcp-web-parser by redup-ai

    redup.mcp-web-parserofficial

    redup-ai
    A
    license
    A
    quality
    B
    maintenance
    MCP server that parses web pages into clean markdown via Crawl4AI's HTTP API, exposing parse_page and health-check tools with configurable proxy and timeout.
    2
    MIT

  • Ollama Web Search

    deXterbed
    A
    license
    A
    quality
    A
    maintenance
    Enables web search and web fetch operations using Ollama's hosted APIs, allowing MCP clients to search the web and retrieve page content.
    2
    MIT

  • web-fetch-mcp

    bpzx
    A
    license
    A
    quality
    C
    maintenance
    MCP server for web page fetching (converting to Markdown/text with automatic fallback between Tavily and Firecrawl) and web search via Tavily.
    2
    MIT

  • Web Check MCP

    ameobius-ai
    A
    license
    A
    quality
    B
    maintenance
    MCP server that exposes 31 OSINT checks from Lissy93/web-check as tools for website analysis, including SSL, DNS, headers, WHOIS, and security presets. Enables natural-language-driven web recon and health checks.
    8
    MIT

  • mcp-web-search

    nacho4d
    A
    license
    A
    quality
    C
    maintenance
    Provides DuckDuckGo web search and site fetching tools for Claude Desktop, enabling up to 10 search results and text content extraction from URLs.
    2
    MIT

  • web-performance-mcp

    teles
    A
    license
    B
    quality
    B
    maintenance
    Enables web performance analysis using Google PageSpeed Insights and Chrome UX Report APIs, providing compact metrics and diagnostics without local browser automation.
    5
    9
    MIT

  • Web Search MCP

    guhcostan
    A
    license
    B
    quality
    D
    maintenance
    Enables web searching via DuckDuckGo and extracting readable content from any URL using Mozilla Readability, providing web context similar to Cursor's built-in functionality.
    2
    86
    4
    MIT

  • MCP Web Scrape

    mukul975
    A
    license
    B
    quality
    D
    maintenance
    A comprehensive web scraping server that transforms web content into clean, agent-ready Markdown with automatic citations and efficient caching. It features a robust suite of tools for metadata extraction, sentiment analysis, SEO auditing, and security scanning while strictly adhering to robots.txt policies.
    48
    23
    36
    MIT

  • Reuters Business and Financial

    BACH-AI-Tools
    A
    license
    C
    quality
    D
    maintenance
    Provides access to the Reuters Business and Financial News API to retrieve articles, trending news, and market data. It enables searching and filtering financial content by date, author, category, and keywords.
    20
    MIT

  • Usage And Billing MCP Server

    BACH-AI-Tools
    A
    license
    C
    quality
    D
    maintenance
    Enables access to Usage and Billing APIs for managing accounts, products, meters, plans, and usage reporting. Supports operations like creating products/plans, reporting usage, and retrieving billing information.
    18
    MIT

  • Vercel MCP Web Crawler

    AIEterprise
    A
    license
    -
    quality
    C
    maintenance
    Provides lightweight web crawling and scraping capabilities, enabling users to fetch pages as clean Markdown, recursively crawl domains, extract metadata, and perform search-and-crawl operations.
    6
    MIT

  • web-scrapper-stdio

    JustAzul
    A
    license
    -
    quality
    C
    maintenance
    A headless web scraping server that extracts main content from web pages into Markdown, text, or HTML for AI and automation integration. It features per-domain rate limiting and robust error handling using Playwright and BeautifulSoup.
    MIT

  • agent-tools

    garnetlyx
    A
    license
    -
    quality
    C
    maintenance
    A multi-function Streamable HTTP MCP tool aggregation server that provides web search via Brave, Exa, and SearXNG with multi-key rotation and cross-provider fallback, and supports extensible tool families (URL fetch, code search, RAG) through a pluggable architecture.
    MIT

  • agent-web

    foomworks
    A
    license
    -
    quality
    C
    maintenance
    Converts URLs into clean, LLM-ready markdown, respecting robots.txt and never bypassing anti-bot measures or paywalls.
    MIT