Search for:

Information about web crawlers

  • Why this server?

    Provides AgentQL's data extraction capabilities enabling AI agents to get structured data from unstructured web.

    A
    security
    A
    license
    A
    quality
    A server that provides AgentQL's data extraction capabilities enabling AI agents to get structured data from unstructured web
    1
    183
    28
    JavaScript
    MIT License
    • Apple
    • Linux
  • Why this server?

    A comprehensive Model Context Protocol server implementation that enables AI assistants to interact with file systems, databases, GitHub repositories, web resources, and system tools while maintaining security and control.

    -
    security
    F
    license
    -
    quality
    A comprehensive Model Context Protocol server implementation that enables AI assistants to interact with file systems, databases, GitHub repositories, web resources, and system tools while maintaining security and control.
    16
    TypeScript
  • Why this server?

    Provides functionality to fetch and transform web content in various formats (HTML, JSON, plain text, and Markdown) through simple API calls.

    -
    security
    F
    license
    -
    quality
    Provides functionality to fetch and transform web content in various formats (HTML, JSON, plain text, and Markdown) through simple API calls.
    137,083
    TypeScript
  • Why this server?

    Bridge the gap between your web crawl and AI language models. With mcp-server-webcrawl, your AI client filters and analyzes web content under your direction or autonomously, extracting insights from your web content. Supports WARC, wget, InterroBot, Katana, and SiteOne crawlers.

    -
    security
    F
    license
    -
    quality
    Bridge the gap between your web crawl and AI language models. With mcp-server-webcrawl, your AI client filters and analyzes web content under your direction or autonomously, extracting insights from your web content. Supports WARC, wget, InterroBot, Katana, and SiteOne crawlers.
    Python
    • Apple
  • Why this server?

    Provides a robust interface for searching TikTok videos by hashtags and retrieving trending content, with anti-detection measures and comprehensive metadata extraction.

    -
    security
    A
    license
    -
    quality
    Provides a robust interface for searching TikTok videos by hashtags and retrieving trending content, with anti-detection measures and comprehensive metadata extraction.
    2
    Python
    MIT License
  • Why this server?

    Enables AI agents to control web browsers via a standardized interface for operations like launching, interacting with, and closing browsers.

  • Why this server?

    A Model Context Protocol (MCP) server implementation that integrates with FireCrawl for advanced web scraping capabilities.

    A
    security
    A
    license
    A
    quality
    A Model Context Protocol (MCP) server implementation that integrates with FireCrawl for advanced web scraping capabilities.
    9
    8,264
    2,147
    JavaScript
    MIT License
    • Apple
    • Linux
  • Why this server?

    Enables AI agents to interact with web browsers using natural language, featuring automated browsing, form filling, vision-based element detection, and structured JSON responses for systematic browser control.

    A
    security
    F
    license
    A
    quality
    Enables AI agents to interact with web browsers using natural language, featuring automated browsing, form filling, vision-based element detection, and structured JSON responses for systematic browser control.
    1
    23
    Python
    • Linux
    • Apple
  • Why this server?

    A Model Context Protocol (MCP) server lets AI assistants like Cursor & Claude use the Exa AI Search API for web searches. This setup allows AI models to get real-time web information in a safe and controlled way.

    A
    security
    A
    license
    A
    quality
    A Model Context Protocol (MCP) server lets AI assistants like Claude use the Exa AI Search API for web searches. This setup allows AI models to get real-time web information in a safe and controlled way.
    1
    1,858
    510
    TypeScript
    MIT License
    • Apple
  • Why this server?

    This MCP scraps vinted for product info. This script is designed for educational purposes only. It is intended to demonstrate web scraping techniques and should not be used for any commercial or personal gain. Please note that using this software may violate the terms of service of Vint

    -
    security
    A
    license
    -
    quality
    This MCP scraps vinted for product info. Disclaimer: This script is designed for educational purposes only. It is intended to demonstrate web scraping techniques and should not be used for any commercial or personal gain. Please note that using this software may violate the terms of service of Vint
    98
    Python
    GPL 3.0