Skip to main content
Glama

information-about-web-scraping-or-crawling MCP servers

Production-ready MCP servers that extend AI capabilities through file access, database connections, APIs, and contextual services.

17,761 servers. Last updated 2026-02-24 12:18

Matching MCP tools:

Matching MCP Connectors:

"information-about-web-scraping-or-crawling" matching MCP servers:

  • A
    security
    F
    license
    A
    quality
    Enables retrieval and cleaning of official documentation content for popular AI/Python libraries (uv, langchain, openai, llama-index) through web scraping and LLM-powered content extraction. Uses Serper API for search and Groq API to clean HTML into readable text with source attribution.
    Last updated 5 months ago
    1
    1
  • -
    security
    A
    license
    -
    quality
    A headless web scraping server that extracts main content from web pages into Markdown, text, or HTML for AI and automation integration. It features per-domain rate limiting and robust error handling using Playwright and BeautifulSoup.
    Last updated 6 months ago
    MIT
  • -
    security
    A
    license
    -
    quality
    Enables AI agents to search DuckDuckGo and fetch web content with human-assisted CAPTCHA handling, designed for local use where humans can intervene when bot detection occurs.
    Last updated 4 months ago
    39
    MIT
  • A
    security
    A
    license
    A
    quality
    Comprehensive web research toolkit with 13 tools for searching (via SearXNG), crawling, package discovery, GitHub metrics, error translation, API documentation lookup, data extraction, technology comparison, and service status checking.
    Last updated 2 months ago
    13
    4
    MIT

Interested in MCP?

Join the MCP community for support and updates.

RedditDiscord