Information about web scraping or crawling MCP servers

"Information about web scraping or crawling" matching MCP servers:

• Documentation Retrieval & Web

  AIwithhassan

  A

  security

  F

  license

  A

  quality

  Enables retrieval and cleaning of official documentation content for popular AI/Python libraries (uv, langchain, openai, llama-index) through web scraping and LLM-powered content extraction. Uses Serper API for search and Groq API to clean HTML into readable text with source attribution.

  Last updated 3 months ago

  1

  1

• FastMCP Documentation & Web

  jcdumlao14

  A

  security

  F

  license

  A

  quality

  Enables web page scraping via Jina reader API and searching FastMCP documentation using minsearch. Supports fetching markdown content from URLs and querying indexed documentation files.

  Last updated 21 days ago

  3

• Web-Scout

  UpperMoon0

  -

  security

  F

  license

  -

  quality

  Enables AI-powered web searches using DuckDuckGo with automatic summarization via Google's Gemini AI. Supports both summary and detailed analysis modes for search results.

  Last updated 8 days ago

• mcp-web

  TsFreddie

  -

  security

  A

  license

  -

  quality

  Enables AI agents to search DuckDuckGo and fetch web content with human-assisted CAPTCHA handling, designed for local use where humans can intervene when bot detection occurs.

  Last updated 2 months ago

  7

  MIT License

• Web Research Assistant

  elad12390

  A

  security

  A

  license

  A

  quality

  Comprehensive web research toolkit with 13 tools for searching (via SearXNG), crawling, package discovery, GitHub metrics, error translation, API documentation lookup, data extraction, technology comparison, and service status checking.

  Last updated 8 days ago

  13

  2

  MIT License

• MCP Web Scraper

  navin4078

  -

  security

  F

  license

  -

  quality

  A lightweight web scraping server that allows Claude Desktop users to extract various types of data from websites, including text, links, images, tables, headlines, and metadata using CSS selectors.

  Last updated 7 months ago

  4