Search for:

Information about web crawlers or related technology

  • Why this server?

    This server fetches RSS feeds and shares them with LLMs.

    -
    security
    F
    license
    -
    quality
    An MCP server that fetches RSS feeds and shares them with LLMs, allowing AI assistants to access and present the latest news and articles from configured feeds.
    Last updated -
    1
    TypeScript
  • Why this server?

    Provides functionality to fetch and transform web content in various formats (HTML, JSON, plain text, and Markdown) through simple API calls.

    -
    security
    F
    license
    -
    quality
    Provides functionality to fetch and transform web content in various formats (HTML, JSON, plain text, and Markdown) through simple API calls.
    Last updated -
    137,083
    TypeScript
  • Why this server?

    Enables web content scanning and analysis by fetching, analyzing, and extracting information from web pages.

    A
    security
    A
    license
    A
    quality
    Enables web content scanning and analysis by fetching, analyzing, and extracting information from web pages using tools like page fetching, link extraction, site crawling, and more.
    Last updated -
    6
    7
    TypeScript
    MIT License
  • Why this server?

    A documentation server based on MCP protocol designed for various development frameworks that provides multi-threaded document crawling, local document loading, keyword searching, and document detail retrieval.

    A
    security
    A
    license
    A
    quality
    A documentation server based on MCP protocol designed for various development frameworks that provides multi-threaded document crawling, local document loading, keyword searching, and document detail retrieval.
    Last updated -
    2
    37
    JavaScript
    MIT License
    • Apple
    • Linux
  • Why this server?

    A browser automation server providing Playwright capabilities for controlling web browsers, capturing screenshots, extracting content, and performing complex interactions through an MCP interface.

    -
    security
    A
    license
    -
    quality
    A browser automation server providing Playwright capabilities for controlling web browsers, capturing screenshots, extracting content, and performing complex interactions through an MCP interface.
    Last updated -
    Python
    Apache 2.0
    • Apple
  • Why this server?

    Enhances LLM applications with deep autonomous web research capabilities, delivering higher quality information than standard search tools by exploring and validating numerous trusted sources.

    -
    security
    A
    license
    -
    quality
    Enhances LLM applications with deep autonomous web research capabilities, delivering higher quality information than standard search tools by exploring and validating numerous trusted sources.
    Last updated -
    65
    Python
    MIT License
    • Apple
  • Why this server?

    A server for downloading, processing, and managing YouTube content with features like video quality selection, format conversion, and metadata extraction.

    -
    security
    F
    license
    -
    quality
    A server for downloading, processing, and managing YouTube content with features like video quality selection, format conversion, and metadata extraction.
    Last updated -
    JavaScript
  • Why this server?

    A service that extracts and transcribes audio content from videos across 1000+ streaming websites including YouTube, Bilibili, TikTok, and Twitter, supporting multiple transcription providers like Deepgram, Gladia, Speechmatics, and AssemblyAI.

    -
    security
    A
    license
    -
    quality
    A service that extracts and transcribes audio content from videos across 1000+ streaming websites including YouTube, Bilibili, TikTok, and Twitter, supporting multiple transcription providers like Deepgram, Gladia, Speechmatics, and AssemblyAI.
    Last updated -
    5
    Python
    MIT License
    • Linux
    • Apple
  • Why this server?

    Provides a standardized protocol for tool invocation, enabling an AI system to search the web, retrieve information, and provide relevant answers through integration with LangChain, RAG, and Ollama.

    -
    security
    A
    license
    -
    quality
    Provides a standardized protocol for tool invocation, enabling an AI system to search the web, retrieve information, and provide relevant answers through integration with LangChain, RAG, and Ollama.
    Last updated -
    Python
    MIT License
  • Why this server?

    A Model Context Protocol server that enables LLMs to interact with web pages through structured accessibility snapshots, providing browser automation capabilities without requiring screenshots or visually-tuned models.

    -
    security
    A
    license
    -
    quality
    A Model Context Protocol server that enables LLMs to interact with web pages through structured accessibility snapshots, providing browser automation capabilities without requiring screenshots or visually-tuned models.
    Last updated -
    TypeScript
    Apache 2.0
    • Apple
    • Linux