Skip to main content
Glama
122,662 servers. Updated

Matching MCP tools:

Matching MCP Connectors:

"Information about web crawlers or related technology" matching MCP servers:

GET /v1/servers – MCP directory API reference
  • A
    license
    A
    quality
    D
    maintenance
    An MCP server that provides information about Utkarsh, including bio, skills, work experience, and portfolio projects, accessible via local stdio or remote HTTP with OAuth.
    6
    MIT
  • F
    license
    A
    quality
    D
    maintenance
    An MCP (Model Context Protocol) server that gives AI agents live, structured ad intelligence across Facebook, Google, and Instagram — data that no base model can produce from training alone. Powered by Apify actors. Works with any MCP-compatible client: Cursor, Claude, etc.
    11
    -
  • A
    license
    A
    quality
    B
    maintenance
    Enables MCP clients to search the web through DuckDuckGo, Google News, and Wikipedia, and to fetch readable text or pretty-printed JSON from web pages without API keys, accounts, or configuration.
    2
    1
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    MCP server that lets AI editors execute JavaScript, read console output, and simulate clicks/input on static web pages. Supports multiple browser pages and can be deployed remotely via HTTP transport.
    13
    19 npm
    1
    Apache 2.0
  • A
    license
    A
    quality
    B
    maintenance
    Enables AI agents to search and fetch high-quality information from multiple sources, including general web APIs, Wikipedia, arXiv, Hacker News, Stack Exchange, and Crossref, with optional pro-mode deep research and clean markdown page extraction.
    10
    MIT
  • F
    license
    A
    quality
    C
    maintenance
    Enables a locally-run LLM to search the web, fetch pages as markdown, make arbitrary HTTP requests, and optionally render pages with headless Chromium.
    3
    -
  • A
    license
    A
    quality
    B
    maintenance
    Gives AI agents local web search and page reading with no API keys, layering a SearXNG-backed search cache with browser-based fallbacks and returning clean page text from HTML, PDF, JSON, and archived snapshots. Fetches run in Docker alongside the search engine with SSRF protection, egress filtering, and untrusted-content marking so agents can safely retrieve live web data.
    2
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    A self-hosted MCP server providing web search and URL fetching tools, running locally without external API keys or accounts.
    2
    388 npm
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Enables live website health checks including TLS, HTTPS, and security headers, returning an A-F grade with specific fixes.
    2
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    A fast web reader for AI assistants, served over MCP. It reads web pages and PDFs and returns only the passages that answer the question, not whole pages. It runs locally and keeps nothing.
    3
    7
    Apache 2.0
  • A
    license
    A
    quality
    D
    maintenance
    Enables Claude and other LLMs to read and parse web content, with smart fallback strategies to bypass access restrictions (e.g., paywalls, Cloudflare) and output Markdown.
    5
    35 npm
    48
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    Enables MCP-capable agents to perform local web research under a declared plan with session budgets, user-approved limit extensions, and guardrails for safe searching, page fetching, content extraction, and audit logging.
    4
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Enables agents to perform compact, cited web research within caller-set token caps, returning direct answers, short verbatim quotes, numbered sources, and noted gaps.
    5
    44 npm
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    Enables agents to perform local metasearch, scholarly and code/model lookups, and fetch rendered web pages or PDFs as paginated markdown, including stealth browsing and arXiv paper overviews.
    11
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    Enables MCP clients to perform web searches and fetch HTTP(S) pages as Markdown through Search and Fetch APIs.
    2
    64 npm
    MIT
  • F
    license
    A
    quality
    D
    maintenance
    Persists web fetch and search results as timestamped JSONL files, indexed for full-text search, enabling users to retrieve and search across archived web pages even after they are removed or changed.
    17
    -
  • A
    license
    A
    quality
    B
    maintenance
    Enables AI coding agents to set up the kit and build pages with it by serving each release's own docs data: searching and describing components, producing install code for a given setup, returning class and content conventions, and checking pages for unknown classes, hooks and missing files. It reads only public docs, with no sign-in or stored data.
    5
    BSD 3-Clause
  • A
    license
    A
    quality
    C
    maintenance
    Comprehensive web research toolkit with 13 tools for searching (via SearXNG), crawling, package discovery, GitHub metrics, error translation, API documentation lookup, data extraction, technology comparison, and service status checking.
    14
    9
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    A local MCP server for semantic search over RSS/Atom feeds, providing tools for ranked search, trending topics, digests, and feed health monitoring without requiring an API key.
    9
    MIT
  • A
    license
    B
    quality
    B
    maintenance
    Enables agents to inspect localhost web applications through Chrome DevTools Protocol by listing Chrome targets, attaching to a page, capturing and querying network, console, navigation, and WebSocket events, and managing ephemeral sessions.
    8
    1
    MIT
  • A
    license
    B
    quality
    D
    maintenance
    A local MCP server providing web search, page extraction, and safe browser automation tools for Hermes, Claude Code, and other MCP clients.
    10
    MIT
  • F
    license
    B
    quality
    C
    maintenance
    Provides web search and page fetch tools for LLM assistants, extracting content and enabling text search within fetched pages.
    3
    -
  • F
    license
    A
    quality
    C
    maintenance
    A local MCP server that gives Claude Code web search capabilities using DuckDuckGo, enabling discovery of URLs from natural language queries.
    1
    1
    -
  • A
    license
    A
    quality
    C
    maintenance
    MCP server that parses web pages into clean markdown via Crawl4AI's HTTP API, exposing parse_page and health-check tools with configurable proxy and timeout.
    2
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    A web-fetch MCP server for LLM agents that fetches pages with an escalation ladder through different engines, raising FetchBlocked instead of returning blocked content.
    2
    3
    Apache 2.0
  • A
    license
    A
    quality
    D
    maintenance
    Fetches a URL and returns the main content as clean Markdown, using plain HTTP when possible and headless Chromium for JavaScript-rendered or bot-protected pages.
    1
    43 PyPI
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    An open-source MCP server providing AI agents with neural web search via Exa and tiered web fetch (Exa, local browser, Firecrawl) as a drop-in replacement for built-in web tools, preserving provenance and guarding against SSRF.
    6
    37 PyPI
    9
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Enables JavaScript-rendered Google searches and readable text extraction from public URLs via a real Chrome instance, along with health and CAPTCHA status monitoring.
    3
    70
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Enables AI assistants to fetch public web pages as readable text or HTML, with caching, live refresh, and parallel job handling.
    3
    17 npm
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Bridges the editing capabilities of an already-open DingTalk document in the browser to any MCP host via standard stdio, forwarding tools to the page's internal MCP server over a local WebSocket. Supports read/write operations through suggested edits, pairing-based security, and zero runtime dependencies.
    5
    37 npm
    MIT
  • A
    license
    A
    quality
    A
    maintenance
    Connect AI assistants to your Gramps Web family tree. Search and edit genealogy records, explore ancestors, descendants, relationships and timelines, and read document scans with vision-capable models. Includes guided research workflows, source citations, read-only mode, and privacy-aware media previews. Install with Docker or a Claude Desktop bundle.
    2
    35
    23
    AGPL 3.0
  • A
    license
    A
    quality
    B
    maintenance
    Enables MCP-capable agents to perform reliable web search and content fetching through a single server that automatically fails over across multiple providers. It handles keyed or keyless authentication automatically and returns clean Markdown or text results.
    3
    1
    MIT
  • A
    license
    A
    quality
    D
    maintenance
    An MCP server for web search, web fetching, and Context7 documentation tools with proxy support, designed for internal network environments.
    4
    35 npm
    4
    MIT
  • A
    license
    A
    quality
    D
    maintenance
    An MCP server that lets an AI agent probe a live URL and confirm whether sensitive files (e.g., .git, .env, source maps) are genuinely served by fetching and validating the content, avoiding false positives.
    2
    16 npm
    1
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    Zero-dependency MCP server that wraps OpenAI Codex's standalone search endpoint into codex_web_search and codex_web_research tools for Claude Code, enabling real-time web search and multi-step deep research independent of the underlying model.
    2
    3
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Enables agents to search the live web and fetch URLs as clean Markdown, returning ranked search results and paginated page content through two lightweight tools.
    2
    23 npm
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    Wraps Xiaomi MiMo's web_search API into an MCP tool for Claude Code, enabling real-time web searches with location awareness, automatic retry, and timeout control.
    1
    4
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    Enables lightweight web search discovery and on-demand extraction of cleaned page text from supplied URLs, returning snippets, headings, links, and saved full text for longer pages.
    2
    BSD 3-Clause
  • A
    license
    A
    quality
    B
    maintenance
    Enables web search and web fetch operations using Ollama's hosted APIs, allowing MCP clients to search the web and retrieve page content.
    2
    34 PyPI
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Enables AI assistants to check room availability, find reservations, and create, update, cancel, or delete bookings through the platform's private web app API, with read-only access by default and preview-and-approval steps for writes.
    4
    Mozilla Public 2.0
  • A
    license
    A
    quality
    D
    maintenance
    Provides local LLMs with web search and page fetching capabilities via MCP, with a focus on OWASP security best practices.
    2
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    Enables reading Slack channels, messages, and threads using the web interface via a persistent browser session, designed for guest users without API access. Does not send messages.
    5
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Provides LLMs with real-time web search and content extraction capabilities, including text/news search, full-text URL reading, and targeted technical documentation search.
    3
    25
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Enables reading web pages and PDFs as clean Markdown, extracting main content and letting agents query for relevant passages, outline sections, search in-page, and list links while respecting robots.txt and blocking private addresses.
    4
    1
    MIT
  • F
    license
    A
    quality
    D
    maintenance
    Enables keyless web search across multiple engines with fallback and relevance ranking, plus anonymous HTTP(S) page fetching, all without API keys or vendor dependencies.
    2
    1
    -
  • A
    license
    A
    quality
    A
    maintenance
    MCP server for AI-powered web research — search (Google, Brave, Serper, SearXNG), scrape any page, extract PDFs/DOCX/YouTube transcripts, academic & patent search. Single Go binary. Works with Claude, Cursor, Copilot, and any MCP client.
    25
    79
    MIT