Skip to main content
Glama

Information about web crawlers or related technology MCP servers

Production-ready MCP servers that extend AI capabilities through file access, database connections, APIs, and contextual services.

X
16,807 servers. Last updated 2026-02-01 13:08

Matching MCP tools:

Matching MCP Connectors:

"Information about web crawlers or related technology" matching MCP servers:

  • mcp-web

    TsFreddie
    -
    security
    A
    license
    -
    quality
    Enables AI agents to search DuckDuckGo and fetch web content with human-assisted CAPTCHA handling, designed for local use where humans can intervene when bot detection occurs.
    Last updated 3 months ago
    1
    MIT

  • Web Research Assistant

    elad12390
    A
    security
    A
    license
    A
    quality
    Comprehensive web research toolkit with 13 tools for searching (via SearXNG), crawling, package discovery, GitHub metrics, error translation, API documentation lookup, data extraction, technology comparison, and service status checking.
    Last updated a month ago
    13
    3
    MIT

  • web-scrapper-stdio

    JustAzul
    -
    security
    A
    license
    -
    quality
    A headless web scraping server that extracts main content from web pages into Markdown, text, or HTML for AI and automation integration. It features per-domain rate limiting and robust error handling using Playwright and BeautifulSoup.
    Last updated 6 months ago
    MIT

  • Web Search MCP Server

    rohanraja
    -
    security
    F
    license
    -
    quality
    Enables free web searching using Google search results without the need for API keys or authentication. It returns structured data including titles, URLs, and descriptions with configurable result limits.
    Last updated 7 months ago
    34

Interested in MCP?

Join the MCP community for support and updates.

RedditDiscord