Skip to main content
Glama
21,594 servers. Last updated

Matching MCP tools:

Matching MCP Connectors:

"Web crawling techniques and tools" matching MCP servers:

  • MCP Web Tools

    SayreBlades
    A
    security
    F
    license
    -
    quality
    Provides local web search and content fetching capabilities for AI assistants, enabling them to search DuckDuckGo and extract clean text from web pages. All requests originate from the user's machine to ensure direct network control and bypass external proxies.
    Last updated
    2

  • Usage And Billing MCP Server

    BACH-AI-Tools
    A
    security
    A
    license
    -
    quality
    Enables access to Usage and Billing APIs for managing accounts, products, meters, plans, and usage reporting. Supports operations like creating products/plans, reporting usage, and retrieving billing information.
    Last updated
    18
    MIT

  • mcp-web

    TsFreddie
    -
    security
    A
    license
    -
    quality
    Enables AI agents to search DuckDuckGo and fetch web content with human-assisted CAPTCHA handling, designed for local use where humans can intervene when bot detection occurs.
    Last updated
    7
    MIT

  • Web Research Assistant

    elad12390
    A
    security
    A
    license
    -
    quality
    Comprehensive web research toolkit with 13 tools for searching (via SearXNG), crawling, package discovery, GitHub metrics, error translation, API documentation lookup, data extraction, technology comparison, and service status checking.
    Last updated
    13
    8
    MIT

  • Web Analysis MCP

    himly0302
    A
    security
    F
    license
    -
    quality
    Enables intelligent web searching using SearXNG with content crawling via Creeper, then summarizes webpage content using LLM to avoid token limit issues. Supports smart filtering with domain blacklist/whitelist and optional LLM-based relevance filtering.
    Last updated
    1

  • Web Search MCP

    uk0
    -
    security
    A
    license
    -
    quality
    A high-performance search service that converts results from Google, Bing, and DuckDuckGo into structured JSON or Markdown. It features multi-layer depth crawling and uses the Camoufox anti-detection browser for reliable content extraction and fallback search logic.
    Last updated
    21
    MIT

  • MCP Web Scrape

    mukul975
    A
    security
    A
    license
    -
    quality
    A comprehensive web scraping server that transforms web content into clean, agent-ready Markdown with automatic citations and efficient caching. It features a robust suite of tools for metadata extraction, sentiment analysis, SEO auditing, and security scanning while strictly adhering to robots.txt policies.
    Last updated
    48
    7
    7
    MIT

  • Web Resource Ledger

    benpeter
    -
    security
    F
    license
    -
    quality
    πŸ“‡ ☁️ - Capture web pages as cryptographically signed, tamper-evident evidence. Ed25519 signatures, RFC 3161 timestamps, and WACZ archives. Four tools: capture_url, get_capture, list_captures, verify_capture.
    Last updated
    0
    1

  • mcp-web-calc

    tickernelz
    A
    security
    A
    license
    -
    quality
    An MCP server that enables web searching, URL content extraction, and summarization without requiring API keys. It also provides advanced mathematical evaluation and multi-language Wikipedia summary retrieval tools.
    Last updated
    5
    271
    3
    MIT
    • Apple
    • Linux

  • web-scrapper-stdio

    JustAzul
    -
    security
    A
    license
    -
    quality
    A headless web scraping server that extracts main content from web pages into Markdown, text, or HTML for AI and automation integration. It features per-domain rate limiting and robust error handling using Playwright and BeautifulSoup.
    Last updated
    MIT

  • MCP Tools

    joehuangcoding
    -
    security
    A
    license
    -
    quality
    A local Model Context Protocol (MCP) server that exposes custom tools to Claude Desktop, enabling direct interaction with your local environment. It provides a framework for building and integrating custom TypeScript tools into the Claude interface.
    Last updated
    7
    MIT

  • Web Search MCP

    pranavms13
    -
    security
    A
    license
    -
    quality
    Enables web searching through Google, DuckDuckGo, and Bing using a headless Chrome browser, returning structured results with titles, URLs, and snippets. Also supports fetching and extracting text content from any webpage.
    Last updated
    8
    MIT
    • Apple
    • Linux

  • MCP Tools

    dlightyupgrade
    -
    security
    F
    license
    -
    quality
    A modular multi-server architecture providing development automation, JIRA management, and performance reporting for Claude Code. It features specialized tools for PR health analysis, code reviews, and generating comprehensive team and individual quarterly reports.
    Last updated

  • Graph-Tools

    dromologue
    -
    security
    F
    license
    -
    quality
    Provides tools for AI-powered graph analysis, including relationship extraction, adjacency matrix creation, and network centrality calculations. It enables users to perform complex structural analysis and generate interactive D3.js visualizations from structured data.
    Last updated

  • web-fetch-mcp

    xiaozhuABCD1234
    -
    security
    A
    license
    -
    quality
    An MCP server that provides web scraping and Bing search capabilities, supporting both static and dynamic content through Puppeteer. It allows AI assistants to extract page summaries, SEO metadata, and full text with automatic detection for headless browser rendering.
    Last updated

  • perplexity-web-mcp

    quequiere
    A
    security
    A
    license
    A
    quality
    An MCP server that enables AI assistants to perform web searches on Perplexity.ai using browser automation instead of an official API. It supports persistent authenticated sessions and returns search results along with cited sources directly to the client.
    Last updated
    3
    27
    3
    MIT

  • Web Search MCP Server

    rohanraja
    -
    security
    F
    license
    -
    quality
    Enables free web searching using Google search results without the need for API keys or authentication. It returns structured data including titles, URLs, and descriptions with configurable result limits.
    Last updated
    37

  • Web Search MCP Server

    mrkrsl
    -
    security
    A
    license
    -
    quality
    Enables comprehensive web searching and content extraction using multiple search engines (Bing, Brave, DuckDuckGo) without API keys. Provides tools for full web searches with content extraction, quick search summaries, and single webpage content retrieval.
    Last updated
    718
    MIT

  • Reuters Business and Financial

    BACH-AI-Tools
    A
    security
    A
    license
    -
    quality
    Provides access to the Reuters Business and Financial News API to retrieve articles, trending news, and market data. It enables searching and filtering financial content by date, author, category, and keywords.
    Last updated
    20
    MIT

  • Web Crawler MCP Server

    dhannusch
    -
    security
    F
    license
    -
    quality
    An intelligent web crawling server that uses Cloudflare's headless browser to render dynamic pages and Workers AI to extract relevant links based on natural language queries. It enables AI assistants to search and filter website content while providing secure access through GitHub OAuth authentication.
    Last updated
    3

  • MCP Web Scraper Server

    Aniruddha1202
    -
    security
    F
    license
    -
    quality
    An advanced web search and scraping server that enables AI models to perform targeted DuckDuckGo searches and extract clean content, tables, and metadata from webpages. It provides specialized tools for news discovery, link extraction, and comprehensive search-and-scrape workflows.
    Last updated
    • Apple

  • MCP Web Docs

    cosmocoder
    -
    security
    A
    license
    -
    quality
    A self-hosted MCP server that crawls, indexes, and searches documentation from any website locally, including private sites requiring authentication. It provides hybrid search capabilities and local embedding generation to maintain privacy while keeping AI assistant knowledge up to date.
    Last updated
    103
    1
    MIT

  • Qontinui Web MCP Server

    qontinui
    -
    security
    A
    license
    -
    quality
    Enables AI assistants to create and manage visual automation configurations, workflows, and UI states through the Qontinui API. It supports project management, workflow execution, and configuration handling for automated web interactions.
    Last updated
    MIT

  • MCP API Tools

    jamalexfo
    -
    security
    F
    license
    -
    quality
    FastAPI server with Google Gemini AI integration that provides auto-routing to multiple tools including weather, news, web search, dictionary, and quotes APIs through natural language prompts.
    Last updated

  • mcp-web-audit

    Shen-zhihao
    A
    security
    F
    license
    -
    quality
    A Node.js-based frontend security audit tool that performs comprehensive dependency security audits for both local projects and remote repositories. Generates detailed Markdown reports with vulnerability detection, risk assessment, and fix recommendations.
    Last updated
    1
    4
    6

  • Web Research MCP Server

    CSOAI-ORG
    -
    security
    A
    license
    -
    quality
    Enables AI agents to perform web searches via DuckDuckGo without API keys and automate browser tasks with headless Chromium. Supports multi-step research workflows that automatically search and extract content from multiple pages.
    Last updated
    MIT

  • MCP OpenAI Tools

    evandavid1
    -
    security
    -
    license
    -
    quality
    Provides access to OpenAI's advanced models (including o3) with integrated web search, Python code interpreter, and combined analysis capabilities. Enables users to perform web searches, execute code in sandboxed environments, and combine search with analysis through natural language.
    Last updated
    MIT

  • Web Development Agent

    shark-bot-0118
    -
    security
    -
    license
    -
    quality
    An MCP server that automatically generates static websites from natural language instructions, creating Next.js-based sites with optional automatic deployment to AWS S3.
    Last updated