Search for:

Information about web scraping or crawling

  • Why this server?

    Provides web search, scraping, crawling, and content extraction capabilities, useful for gathering data like a web crawler.

    -
    security
    A
    license
    -
    quality
    A Model Context Protocol server that enables web search, scraping, crawling, and content extraction through multiple engines including SearXNG, Firecrawl, and Tavily.
    35
    11
    TypeScript
    MIT License
  • Why this server?

    Provides advanced web search, content extraction, web crawling, and scraping capabilities.

    A
    security
    F
    license
    A
    quality
    Built as a Model Context Protocol (MCP) server that provides advanced web search, content extraction, web crawling, and scraping capabilities using the Firecrawl API.
    4
    1
    Python
    • Apple
    • Linux
  • Why this server?

    Enables web scraping of LinkedIn data, which might be useful as part of a web crawling task, and provides some level of data analysis with LinkedIn's API.

    -
    security
    A
    license
    -
    quality
    A Model Context Protocol (MCP) server that provides tools to interact with LinkedIn's Feeds and Job API. You can do "search for 3 data engineer jobs in . For each job check if it a good match for me by analyzing it against my resume in file resume.md."
    2
    31
    Python
    The Unlicense
  • Why this server?

    Offers Google search capabilities and web content extraction, allowing for efficient and cost-effective information gathering.

    -
    security
    A
    license
    -
    quality
    Provides Google search capabilities, web content extraction, and screenshot functionality with advanced bot detection avoidance through the MCP protocol.
    15
    4
    TypeScript
    MIT License
    • Apple
    • Linux
  • Why this server?

    Provides capabilities to capture and analyze browser activity, which includes extracting content from web pages, and monitoring network requests.

    -
    security
    A
    license
    -
    quality
    A browser monitoring and interaction tool that enables AI applications to capture and analyze browser data through a Chrome extension via Anthropic's Model Context Protocol.
    13
    JavaScript
    MIT License
  • Why this server?

    Offers access to government datasets, useful for retrieving information which might be gathered by web crawling.

    A
    security
    A
    license
    A
    quality
    An MCP server that provides access to government datasets from Data.gov, enabling users to search packages, view dataset details, list groups and tags, and access resources by URL.
    4
    7
    5
    JavaScript
    MIT License
    • Apple
  • Why this server?

    Focuses on efficient and cost-effective web scraping with the ability to search Google and individual websites.

    -
    security
    A
    license
    -
    quality
    Searching google, individual websites and scraping their content. Fast and cost-effective. ⚡️
    16
    TypeScript
    MIT License
  • Why this server?

    Enables browser automation for extracting information from web pages.

    A
    security
    F
    license
    A
    quality
    Enables browser automation using Python scripts, offering operations like taking webpage screenshots, retrieving HTML content, and executing JavaScript.
    4
    15
    Python
    • Linux