Search for:

Information about web scraping or crawling

  • Why this server?

    Provides web search, scraping, crawling, and content extraction capabilities, useful for gathering data like a web crawler.

    -
    security
    A
    license
    -
    quality
    A Model Context Protocol server that enables web search, scraping, crawling, and content extraction through multiple engines including SearXNG, Firecrawl, and Tavily.
    Last updated -
    35
    11
    TypeScript
    MIT License
  • Why this server?

    Provides advanced web search, content extraction, web crawling, and scraping capabilities.

    A
    security
    F
    license
    A
    quality
    Built as a Model Context Protocol (MCP) server that provides advanced web search, content extraction, web crawling, and scraping capabilities using the Firecrawl API.
    Last updated -
    4
    1
    Python
    • Apple
    • Linux
  • Why this server?

    Enables web scraping of LinkedIn data, which might be useful as part of a web crawling task, and provides some level of data analysis with LinkedIn's API.

    -
    security
    A
    license
    -
    quality
    A Model Context Protocol (MCP) server that provides tools to interact with LinkedIn's Feeds and Job API. You can do "search for 3 data engineer jobs in . For each job check if it a good match for me by analyzing it against my resume in file resume.md."
    Last updated -
    2
    31
    Python
    The Unlicense
  • Why this server?

    Offers Google search capabilities and web content extraction, allowing for efficient and cost-effective information gathering.

    -
    security
    A
    license
    -
    quality
    Provides Google search capabilities, web content extraction, and screenshot functionality with advanced bot detection avoidance through the MCP protocol.
    Last updated -
    46
    4
    TypeScript
    MIT License
    • Apple
    • Linux
  • Why this server?

    Provides capabilities to capture and analyze browser activity, which includes extracting content from web pages, and monitoring network requests.

    -
    security
    A
    license
    -
    quality
    A browser monitoring and interaction tool that enables AI applications to capture and analyze browser data through a Chrome extension via Anthropic's Model Context Protocol.
    Last updated -
    13
    JavaScript
    MIT License
  • Why this server?

    Offers access to government datasets, useful for retrieving information which might be gathered by web crawling.

    A
    security
    A
    license
    A
    quality
    An MCP server that provides access to government datasets from Data.gov, enabling users to search packages, view dataset details, list groups and tags, and access resources by URL.
    Last updated -
    4
    7
    5
    JavaScript
    MIT License
    • Apple
  • Why this server?

    Focuses on efficient and cost-effective web scraping with the ability to search Google and individual websites.

    -
    security
    A
    license
    -
    quality
    Searching google, individual websites and scraping their content. Fast and cost-effective. ⚡️
    Last updated -
    16
    TypeScript
    MIT License
  • Why this server?

    Enables browser automation for extracting information from web pages.

    A
    security
    F
    license
    A
    quality
    Enables browser automation using Python scripts, offering operations like taking webpage screenshots, retrieving HTML content, and executing JavaScript.
    Last updated -
    4
    18
    Python
    • Linux