Skip to main content
Glama
123,580 servers. Updated

Matching MCP tools:

Matching MCP Connectors:

"Information about web crawlers or related technology" matching MCP servers:

GET /v1/servers – MCP directory API reference
  • A
    license
    A
    quality
    B
    maintenance
    A fast web reader for AI assistants, served over MCP. It reads web pages and PDFs and returns only the passages that answer the question, not whole pages. It runs locally and keeps nothing.
    3
    7
    Apache 2.0
  • A
    license
    Not graded
    quality
    C
    maintenance
    Enables extracting clean, structured markdown from any URL—stripping nav, ads, and scripts—for RAG pipelines and AI research agents, with pay-per-call micropayments via x402.
    MIT
  • F
    license
    Not graded
    quality
    D
    maintenance
    Provides free web search, content fetching, image search, and deep research via SearXNG, no API keys required.
    -
  • F
    license
    Not graded
    quality
    C
    maintenance
    Provides standard MCP tools for web search, page fetching with content extraction, and a combined research workflow that returns sources with excerpts, plus a session resource and fact-check prompt template.
    -
  • F
    license
    Not graded
    quality
    D
    maintenance
    MCP server that provides web search via LLM API gateways with server-side search, returning cited answers and multi-provider fallback.
    -
  • F
    license
    A
    quality
    D
    maintenance
    A focused MCP server that provides a single web_search tool for web searches, integrating Tavily and Brave with automatic fallback and key rotation.
    1
    -
  • A
    license
    A
    quality
    B
    maintenance
    A Model Context Protocol server that gives AI assistants access to 7 search providers with intelligent auto-routing. Analyzes query intent and picks the best provider automatically — no manual switching needed. Install, configure your keys, and go.
    2
    172 PyPI
    5
    MIT
  • A
    license
    B
    quality
    B
    maintenance
    Enables an agent to run ten ready-made research and monitoring workflows — competitor digests, cited reports, paper alerts, market maps, regulatory and due-diligence watches — pulling from Firecrawl, Tavily, GitHub and landing results in Notion, Slack, Google Docs, Sheets and Linear. Fields are filed with the user's own keys held in the operating system keychain, and every action that creates, sends or changes anything is shown and approved first.
    21
    Apache 2.0
  • A
    license
    B
    quality
    D
    maintenance
    An MCP server that enables AI models to perform Google Web searches using the Gemini API, complete with citations and grounding metadata for accurate information retrieval. It is compatible with Claude Desktop and other MCP clients for real-time web access.
    1
    3
    Apache 2.0
  • A
    license
    C
    quality
    A
    maintenance
    Enables AI agents and users to query Perplexity AI's premium models (GPT-5.4, Claude 4.6 Opus, Gemini 3.1 Pro, etc.) via MCP tools, CLI, or API, with support for deep research, model council, and multi-turn conversations.
    34
    293 PyPI
    210
    MIT
  • A
    license
    Not graded
    quality
    F
    maintenance
    Implementation of an MCP server for the RAG Web Browser Actor. This Actor serves as a web browser for large language models (LLMs) and RAG pipelines, similar to a web search in ChatGPT.
    41 npm
    206
    Apache 2.0
  • A
    license
    Not graded
    quality
    B
    maintenance
    A self-hosted MCP server that crawls, indexes, and searches documentation from any website locally, including private sites requiring authentication. It provides hybrid search capabilities and local embedding generation to maintain privacy while keeping AI assistant knowledge up to date.
    747 npm
    2
    MIT
  • A
    license
    Not graded
    quality
    B
    maintenance
    Provides ranked full-text search over Obsidian vaults using SQLite FTS5, BM25 scoring, and multilingual stemming, adding a vault_fts_search tool to find relevant notes beyond exact line matches.
    MIT
  • A
    license
    Not graded
    quality
    B
    maintenance
    Enables AI clients to search a user's licensed Logos library, retrieve targeted passages and bounded context blocks, and support human-initiated research through an authenticated local Safari session.
    1
    MIT
  • A
    license
    Not graded
    quality
    D
    maintenance
    Provides AI assistants with access to 102 curated UK Government technology standards, enabling context-aware recommendations for accessibility, APIs, security, cloud strategy, and more.
    MIT
  • F
    license
    Not graded
    quality
    C
    maintenance
    Provides AI agents and RAG pipelines with production-grade web search, deep research, news, academic, extraction, crawling, and source verification tools. Enables citation-anchored, deduplicated, fresh, and security-hardened evidence gathering from across the web.
    -
  • F
    license
    Not graded
    quality
    D
    maintenance
    Provides a Google search tool via the Serper API, returning structured results and a summary answer for LLMs like Claude.
    1
    -
  • F
    license
    Not graded
    quality
    D
    maintenance
    Fetches YouTube transcripts and enables semantic search within them using local embeddings, allowing an LLM to retrieve relevant passages with timestamps.
    -
  • A
    license
    B
    quality
    D
    maintenance
    Enables LLMs and AI agents to access real-time web data, search websites, and navigate the web without getting blocked. Includes 5,000 free monthly requests and supports web scraping, browser automation, and bypassing geo-restrictions.
    60
    1
    MIT
  • F
    license
    B
    quality
    D
    maintenance
    Enables web search capabilities through the Tavily API. Allows users to search the web for information using natural language queries via the MCP protocol.
    4
    1
    -
  • A
    license
    B
    quality
    D
    maintenance
    A server that leverages Cloudflare Browser Rendering to extract and process web content for use as context in LLMs, offering tools for fetching pages, searching documentation, extracting structured content, and summarizing content.
    4
    12
    MIT
  • F
    license
    C
    quality
    D
    maintenance
    Enables web search capabilities through the Tavily API, allowing users to search the internet for information using natural language queries. Demonstrates MCP server implementation with external API integration.
    3
    -
  • F
    license
    C
    quality
    D
    maintenance
    Enables web search capabilities through the Tavily API via the Model Context Protocol. Allows users to perform web searches and retrieve information from the internet through natural language queries.
    5
    -
  • F
    license
    C
    quality
    D
    maintenance
    Enables web search capabilities through the Tavily API, allowing users to search the web for information using natural language queries. Demonstrates MCP (Model Context Protocol) server implementation with stdio transport mode.
    4
    -
  • F
    license
    C
    quality
    D
    maintenance
    Enables web search capabilities through the Tavily API. Allows users to search the web for information using natural language queries through the MCP protocol.
    3
    -
  • A
    license
    Not graded
    quality
    B
    maintenance
    DocPull v6 is a local-first MCP server that turns public web sources into cited, versioned context packs for AI agents, RAG systems, and developer workflows. It can fetch and sync public static and server-rendered sources such as changelogs, standards, API references, OpenAPI specs, feeds, repo/package metadata, papers, filings, pricing pages, blogs, and other web sources.
    212 PyPI
    29
    MIT
  • A
    license
    Not graded
    quality
    D
    maintenance
    Enables web content retrieval and semantic search capabilities through the Jina AI API. Provides tools to fetch content from URLs and perform intelligent web searches with natural language queries.
    3
    MIT
  • A
    license
    Not graded
    quality
    D
    maintenance
    An MCP server that integrates real-time web search capabilities into AI assistants using the Exa API, providing both basic and advanced search functionality with formatted markdown results.
    144
    MIT
  • F
    license
    Not graded
    quality
    D
    maintenance
    MCP server that enables live web search via Gemini's built-in grounding, returning synthesized answers with source citations through a single web_search tool.
    -
  • A
    license
    A
    quality
    C
    maintenance
    Enables AI agents to fetch any web page and receive clean, token-efficient Markdown, escalating only as needed from direct HTTP with browser TLS fingerprints to headless-browser rendering and residential proxies when a site blocks access. Supports question-focused passage retrieval with BM25 ranking, pagination, caching, JS rendering control, and safe-by-default restrictions on local and private-network URLs.
    1
    AGPL 3.0
  • A
    license
    A
    quality
    D
    maintenance
    An enterprise-grade Model Context Protocol server for high-performance web analysis that discovers subpages, provides AI-based page summaries, and extracts structured content for RAG using FastMCP and FastAPI.
    2
    4
    MIT
  • F
    license
    A
    quality
    D
    maintenance
    Enables retrieval and cleaning of official documentation content for popular AI/Python libraries (uv, langchain, openai, llama-index) through web scraping and LLM-powered content extraction. Uses Serper API for search and Groq API to clean HTML into readable text with source attribution.
    1
    4
    -
  • A
    license
    B
    quality
    B
    maintenance
    Crawls any website or sitemap into clean, LLM-ready Markdown and token-bounded RAG chunks without headless browser overhead. Also extracts verified corporate emails, phone numbers, social links, DNS MX deliverability providers, and 50+ B2B technologies from company domains.
    2
    MIT
  • A
    license
    B
    quality
    B
    maintenance
    Evidence-governed coding agent memory and knowledge lifecycle MCP server for DeepSeek Harness (DSH), OpenAI Codex, and Google Antigravity. Provides local SQLite FTS5 + semantic hybrid retrieval, automatic session/compaction checkpointing, counter-example demotion, and a hard 1,200-char context budget guardrail with zero third-party Python dependencies.
    11
    1
    MIT
  • F
    license
    D
    quality
    C
    maintenance
    Enables users to search and fetch documentation from supported libraries (langchain, llama-index, openai, uv) as clean, readable text, which can be used as context for answering questions.
    1
    -
  • A
    license
    Not graded
    quality
    B
    maintenance
    Enables agents to find relevant documentation with source URLs, evidence, and freshness, search and browse an llms.txt directory, validate or draft llms.txt files, and manage site registration, verification, and change watches.
    MIT
  • A
    license
    Not graded
    quality
    B
    maintenance
    Free web search and page fetching for AI agents. No account or API key required. Connect to https://search.parallel.ai/mcp over Streamable HTTP. Tools: web_search and web_fetch. Free-tier rate limits apply.
    33
    MIT
  • A
    license
    Not graded
    quality
    B
    maintenance
    Turns a composer's own MIDI catalogue into a learned style profile, phrase index and critics, then composes from those phrases inside Ableton Live through Producer Pal. It hears the open Set, writes only to sanctioned SIDEKICK tracks, and closes the loop by scoring which suggestions survive the session.
    MIT
  • A
    license
    Not graded
    quality
    C
    maintenance
    A minimal server/client application implementation utilizing the Model Context Protocol (MCP) and Azure OpenAI.
    35
    MIT
  • A
    license
    Not graded
    quality
    C
    maintenance
    Enables AI agents to perform web research in one tool call by searching, fetching and cleaning full pages, and ranking cited passages. Provides web_research, web_fetch, web_search, and status tools for MCP clients.
    1
    MIT
  • A
    license
    Not graded
    quality
    D
    maintenance
    A multi-provider MCP server that acts as a unified bridge for Tavily, Brave Search, and GrokSearch APIs. It features a comprehensive Admin UI for managing API key rotation, client authentication, and real-time usage monitoring across all search providers.
    19 npm
    ISC