Skip to main content
Glama
124,518 servers. Updated
Browse by product

Matching MCP tools:

Matching MCP Connectors:

"Information about web crawlers or related technology" matching MCP servers:

GET /v1/servers – MCP directory API reference
  • F
    license
    Not graded
    quality
    C
    maintenance
    MCP server that provides OpenRouter model pricing data, enabling price lookups, trending/cheapest lists, and model searches without an API key.
    -
  • F
    license
    A
    quality
    D
    maintenance
    An MCP (Model Context Protocol) server that gives AI agents live, structured ad intelligence across Facebook, Google, and Instagram — data that no base model can produce from training alone. Powered by Apify actors. Works with any MCP-compatible client: Cursor, Claude, etc.
    11
    -
  • F
    license
    Not graded
    quality
    C
    maintenance
    HandaaS的MCP服务器,提供全域资讯搜索、企业新闻、行业资讯、主题跟踪和企业动态监控能力,帮助用户开展行业研究和舆情分析。
    2
    -
  • A
    license
    A
    quality
    B
    maintenance
    Enables web search and web fetch operations using Ollama's hosted APIs, allowing MCP clients to search the web and retrieve page content.
    2
    34 PyPI
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Enables MCP clients to search the web through DuckDuckGo, Google News, and Wikipedia, and to fetch readable text or pretty-printed JSON from web pages without API keys, accounts, or configuration.
    2
    1
    MIT
  • F
    license
    A
    quality
    B
    maintenance
    Odysseus Web MCP is a standalone Model Context Protocol (MCP) server for safe public-web search and URL fetching.
    2
    -
  • A
    license
    A
    quality
    C
    maintenance
    Gives any AI agent two web capabilities: ranked search results with titles, URLs, dates and excerpts via Exa, and clean Markdown extraction of a page's main content with navigation, scripts and footers stripped. Responses are structured and schema-declared, and URL fetching is hardened against private addresses, redirects and DNS rebinding, so agents can research and cite sources safely across MCP clients.
    2
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    MCP server for web page fetching (converting to Markdown/text with automatic fallback between Tavily and Firecrawl) and web search via Tavily.
    2
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Enables AI agents to search and fetch high-quality information from multiple sources, including general web APIs, Wikipedia, arXiv, Hacker News, Stack Exchange, and Crossref, with optional pro-mode deep research and clean markdown page extraction.
    10
    MIT
  • F
    license
    A
    quality
    C
    maintenance
    Enables a locally-run LLM to search the web, fetch pages as markdown, make arbitrary HTTP requests, and optionally render pages with headless Chromium.
    3
    -
  • A
    license
    A
    quality
    B
    maintenance
    Gives AI agents local web search and page reading with no API keys, layering a SearXNG-backed search cache with browser-based fallbacks and returning clean page text from HTML, PDF, JSON, and archived snapshots. Fetches run in Docker alongside the search engine with SSRF protection, egress filtering, and untrusted-content marking so agents can safely retrieve live web data.
    2
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    A self-hosted MCP server providing web search and URL fetching tools, running locally without external API keys or accounts.
    2
    280 npm
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Enables any MCP client to query DeepSeek's web chat, including its built-in live web search, with no separate search API, provider account, or extra cost. Also supports continuing chat sessions, uploading local files as prompt attachments, and automatic token re-harvesting from a logged-in browser profile.
    7
    Apache 2.0
  • A
    license
    A
    quality
    C
    maintenance
    Enables MCP-capable agents to perform local web research under a declared plan with session budgets, user-approved limit extensions, and guardrails for safe searching, page fetching, content extraction, and audit logging.
    4
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Enables agents to perform compact, cited web research within caller-set token caps, returning direct answers, short verbatim quotes, numbered sources, and noted gaps.
    5
    44 npm
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    Enables agents to perform local metasearch, scholarly and code/model lookups, and fetch rendered web pages or PDFs as paginated markdown, including stealth browsing and arXiv paper overviews.
    11
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    Enables MCP clients to perform web searches and fetch HTTP(S) pages as Markdown through Search and Fetch APIs.
    2
    64 npm
    MIT
  • F
    license
    A
    quality
    D
    maintenance
    Persists web fetch and search results as timestamped JSONL files, indexed for full-text search, enabling users to retrieve and search across archived web pages even after they are removed or changed.
    17
    -
  • A
    license
    A
    quality
    C
    maintenance
    Comprehensive web research toolkit with 13 tools for searching (via SearXNG), crawling, package discovery, GitHub metrics, error translation, API documentation lookup, data extraction, technology comparison, and service status checking.
    14
    9
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    A local MCP server for semantic search over RSS/Atom feeds, providing tools for ranked search, trending topics, digests, and feed health monitoring without requiring an API key.
    9
    MIT
  • A
    license
    B
    quality
    D
    maintenance
    A local MCP server providing web search, page extraction, and safe browser automation tools for Hermes, Claude Code, and other MCP clients.
    10
    MIT
  • A
    license
    B
    quality
    D
    maintenance
    Enables web searching via DuckDuckGo and extracting readable content from any URL using Mozilla Readability, providing web context similar to Cursor's built-in functionality.
    2
    172 npm
    6
    MIT
  • A
    license
    Not graded
    quality
    B
    maintenance
    Enables web research through multi-provider search, documentation lookup, public code search, and clean Markdown extraction from static or JavaScript-rendered pages via five read-only tools.
    1
    Apache 2.0
  • A
    license
    Not graded
    quality
    B
    maintenance
    Enables AI assistants to search and inspect a Calibre-Web library, see recent books, mark books read or unread, manage shelves, and send books to an e-reader.
    MIT
  • A
    license
    Not graded
    quality
    C
    maintenance
    MCP server for multi-engine web search and web page fetching, supporting parallel search, content extraction, and optional LLM-powered search summarization and deep search.
    6
    MIT
  • A
    license
    Not graded
    quality
    B
    maintenance
    Enables MCP hosts to search 46 web platforms and keyword-free hot lists, fetch and read page bodies with two-level caching, assemble scored evidence packs with coverage and gap notes, and run per-site connectivity health checks through shared configuration and provider extensions.
    1,909 npm
    1
    MIT
  • A
    license
    Not graded
    quality
    B
    maintenance
    Enables agents and analysts to gather public web information through seven MCP tools, including compliant search across 360/Bing/Sogou, reading pages and documents as Markdown, mapping sitemaps, scholarly lookups, and resumable link-by-link browsing with robots checks and rate limiting.
    728 npm
    2
    MIT
  • A
    license
    Not graded
    quality
    D
    maintenance
    Enables web search via DuckDuckGo and web content fetching through the Model Context Protocol, allowing AI assistants to search and retrieve web page content.
    10 npm
    MIT
  • A
    license
    Not graded
    quality
    D
    maintenance
    Enables bounded web research through DuckDuckGo search and retrieval of public HTTPS pages as readable text, Markdown, JSON, or XML, with optional excerpt matching and strict safety validation.
    7 npm
    MIT
  • A
    license
    Not graded
    quality
    C
    maintenance
    Enables MCP clients that lack built-in search — such as Claude Code through Bedrock or local LLM clients — to run web queries against Amazon's operated search index via a Gateway deployed in your own AWS account, with queries never leaving AWS and citation URLs preserved. Supports IAM/SigV4, Cognito, and API key authentication, per-gateway rate limits, IP and domain restrictions, and result filtering by domain and publication date.
    MIT
  • A
    license
    Not graded
    quality
    C
    maintenance
    A layered research server that exposes three tools for searching the web with quality signals and domain diversity, fetching clean page text with automatic backend fallback, and running server-side multi-step research that returns cited answers. It handles reranking, filtering, deduplication, and degradation chains internally so callers never choose between backends or guess whether to search or fetch first.
    MIT
  • A
    license
    Not graded
    quality
    C
    maintenance
    Enables local web search through a SearXNG instance, returning up to eight result titles, URLs, and snippets, with optional fetching of previously returned pages under strict sandboxing and URL restrictions.
    MIT
  • A
    license
    Not graded
    quality
    F
    maintenance
    Enables AI agents to search DuckDuckGo and fetch web content with human-assisted CAPTCHA handling, designed for local use where humans can intervene when bot detection occurs.
    MIT
  • A
    license
    Not graded
    quality
    B
    maintenance
    Provides MCP tools to search and read social discussions from Reddit and X, and fetch pages blocked by bot protection, using a private Cloudflare Worker.
    MIT
  • A
    license
    Not graded
    quality
    D
    maintenance
    A self-hosted MCP server that reads web pages and converts them to Markdown, with built-in web search and anti-crawl fallback using Playwright.
    1
    MIT
  • F
    license
    Not graded
    quality
    D
    maintenance
    Enables free web searching using Google search results without the need for API keys or authentication. It returns structured data including titles, URLs, and descriptions with configurable result limits.
    1
    -
  • F
    license
    Not graded
    quality
    D
    maintenance
    Enables AI-powered web searches using DuckDuckGo with automatic summarization via Google's Gemini AI. Supports both summary and detailed analysis modes for search results.
    -
  • F
    license
    A
    quality
    C
    maintenance
    A local MCP server that gives Claude Code web search capabilities using DuckDuckGo, enabling discovery of URLs from natural language queries.
    1
    1
    -
  • A
    license
    A
    quality
    B
    maintenance
    An open-source MCP server providing AI agents with neural web search via Exa and tiered web fetch (Exa, local browser, Firecrawl) as a drop-in replacement for built-in web tools, preserving provenance and guarding against SSRF.
    6
    37 PyPI
    9
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Enables JavaScript-rendered Google searches and readable text extraction from public URLs via a real Chrome instance, along with health and CAPTCHA status monitoring.
    3
    69
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Enables MCP-capable agents to perform reliable web search and content fetching through a single server that automatically fails over across multiple providers. It handles keyed or keyless authentication automatically and returns clean Markdown or text results.
    3
    1
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    Zero-dependency MCP server that wraps OpenAI Codex's standalone search endpoint into codex_web_search and codex_web_research tools for Claude Code, enabling real-time web search and multi-step deep research independent of the underlying model.
    2
    3
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Enables agents to search the live web and fetch URLs as clean Markdown, returning ranked search results and paginated page content through two lightweight tools.
    2
    23 npm
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    Wraps Xiaomi MiMo's web_search API into an MCP tool for Claude Code, enabling real-time web searches with location awareness, automatic retry, and timeout control.
    1
    4
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    Enables lightweight web search discovery and on-demand extraction of cleaned page text from supplied URLs, returning snippets, headings, links, and saved full text for longer pages.
    2
    BSD 3-Clause
  • A
    license
    A
    quality
    C
    maintenance
    Provides local LLMs with web search and page fetching capabilities via MCP, with a focus on OWASP security best practices.
    2
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Provides LLMs with real-time web search and content extraction capabilities, including text/news search, full-text URL reading, and targeted technical documentation search.
    3
    25
    MIT
  • A
    license
    A
    quality
    A
    maintenance
    MCP server for AI-powered web research — search (Google, Brave, Serper, SearXNG), scrape any page, extract PDFs/DOCX/YouTube transcripts, academic & patent search. Single Go binary. Works with Claude, Cursor, Copilot, and any MCP client.
    25
    79
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Enables LLMs to run web searches through a single tool that fuses five providers in a tiered cascade, falling back from free sources to paid ones only when needed and returning the full routing chain. Ships with a one-click installer that detects and wirelessly configures ten AI agent CLIs.
    1
    MIT