Skip to main content
Glama
Sign In

Search for:

A server for crawling web pages and finding subpages

View all MCP Servers

  • Why this server?

    This server enables web content scanning and analysis by fetching, analyzing, and extracting information from web pages, useful for crawling and finding subpages.

    MCP Webscan Server

    bsmi021
    A
    security
    A
    license
    A
    quality
    Enables web content scanning and analysis by fetching, analyzing, and extracting information from web pages using tools like page fetching, link extraction, site crawling, and more.
    6
    3
    TypeScript
    MIT License

  • Why this server?

    This server uses the Brave API for web search functionality, allowing you to crawl pages on the internet.

    MCP2Brave

    mcp2everything
    -
    security
    A
    license
    -
    quality
    A server based on the MCP protocol that uses the Brave API for web search functionality.
    6
    Python
    MIT License
    • Apple
    • Linux

  • Why this server?

    Provides functionality to fetch and transform web content in various formats, which is a key requirement for crawling pages and extracting subpages.

    Fetch MCP Server

    phpmac
    Verified
    -
    security
    F
    license
    -
    quality
    Provides functionality to fetch and transform web content in various formats (HTML, JSON, plain text, and Markdown) through simple API calls.
    137,083
    TypeScript

  • Why this server?

    Enables AI agents to interact with web browsers using natural language, featuring automated browsing, form filling, vision-based element detection, and structured JSON responses for systematic browser control, essential for crawling and analyzing web pages.

    MCP Browser Use Server

    JovaniPink
    A
    security
    F
    license
    A
    quality
    Enables AI agents to interact with web browsers using natural language, featuring automated browsing, form filling, vision-based element detection, and structured JSON responses for systematic browser control.
    1
    34
    Python
    • Linux
    • Apple

  • Why this server?

    Enhances LLM applications with deep autonomous web research capabilities, delivering higher quality information by exploring and validating numerous trusted sources.

    GPT Researcher MCP Server

    assafelovic
    -
    security
    A
    license
    -
    quality
    Enhances LLM applications with deep autonomous web research capabilities, delivering higher quality information than standard search tools by exploring and validating numerous trusted sources.
    65
    Python
    MIT License
    • Apple

  • Why this server?

    An MCP server paired with a Firefox extension that enables LLM clients to control the user's browser, supporting tab management, history search, and content reading.

    Browser Control MCP

    eyalzh
    Verified
    -
    security
    A
    license
    -
    quality
    An MCP server paired with a Firefox extension that enables LLM clients to control the user's browser, supporting tab management, history search, and content reading.
    14
    TypeScript
    MIT License

  • Why this server?

    Provides functionality to fetch web content, supports multiple HTTP methods, allows LLM-controlled request headers, and provides LLM-accessible response headers.

    mcp-server-requests

    coucya
    Verified
    -
    security
    A
    license
    -
    quality
    Web Content Retrieval (full webpage, filtered content, or Markdown-converted), Custom User-Agent, Multi-HTTP Method Support (GET/POST/PUT/DELETE/PATCH), LLM-Controlled Request Headers, LLM-Accessible Response Headers, and more.
    1
    Python
    MIT License

  • Why this server?

    An MCP server that fetches RSS feeds and shares them with LLMs, allowing AI assistants to access and present the latest news and articles from configured feeds.

    MCP-RSS-Crawler

    mshk
    Verified
    -
    security
    F
    license
    -
    quality
    An MCP server that fetches RSS feeds and shares them with LLMs, allowing AI assistants to access and present the latest news and articles from configured feeds.
    1
    TypeScript

  • Why this server?

    A service that extracts and transcribes audio content from videos across 1000+ streaming websites, supporting multiple transcription providers.

    MCP Video Digest

    R-lz
    -
    security
    A
    license
    -
    quality
    A service that extracts and transcribes audio content from videos across 1000+ streaming websites including YouTube, Bilibili, TikTok, and Twitter, supporting multiple transcription providers like Deepgram, Gladia, Speechmatics, and AssemblyAI.
    5
    Python
    MIT License
    • Linux
    • Apple

  • Why this server?

    Next-generation platform enabling effortless, scalable browser automation for AI agents.

    Hyperbrowserofficial

    hyperbrowserai
    A
    security
    A
    license
    A
    quality
    Welcome to Hyperbrowser, the Internet for AI. Hyperbrowser is the next-generation platform empowering AI agents and enabling effortless, scalable browser automation. Built specifically for AI developers, it eliminates the headaches of local infrastructure and performance bottlenecks, allowing you to
    10
    688
    213
    TypeScript
    MIT License
    • Linux
    • Apple