Skip to main content
Glama
125,311 servers. Updated
Browse by product

Matching MCP tools:

Matching MCP Connectors:

"Information about web crawlers or related technology" matching MCP servers:

GET /v1/servers – MCP directory API reference
  • A
    license
    A
    quality
    B
    maintenance
    MCP server that lets AI editors execute JavaScript, read console output, and simulate clicks/input on static web pages. Supports multiple browser pages and can be deployed remotely via HTTP transport.
    13
    6 npm
    1
    Apache 2.0
  • A
    license
    A
    quality
    B
    maintenance
    Enables live website health checks including TLS, HTTPS, and security headers, returning an A-F grade with specific fixes.
    2
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Enables any MCP client to query DeepSeek's web chat, including its built-in live web search, with no separate search API, provider account, or extra cost. Also supports continuing chat sessions, uploading local files as prompt attachments, and automatic token re-harvesting from a logged-in browser profile.
    7
    Apache 2.0
  • A
    license
    A
    quality
    B
    maintenance
    Enables AI coding agents to set up the kit and build pages with it by serving each release's own docs data: searching and describing components, producing install code for a given setup, returning class and content conventions, and checking pages for unknown classes, hooks and missing files. It reads only public docs, with no sign-in or stored data.
    5
    BSD 3-Clause
  • A
    license
    B
    quality
    B
    maintenance
    Enables agents to fetch web pages as clean Markdown, inspect metadata, extract links, analyze tech stacks, and audit or compare SEO, with per-call billing and automatic refunds for failed fetches.
    8
    159 PyPI
    Business Source 1.1
  • A
    license
    Not graded
    quality
    C
    maintenance
    MCP server for multi-engine web search and web page fetching, supporting parallel search, content extraction, and optional LLM-powered search summarization and deep search.
    6
    MIT
  • A
    license
    Not graded
    quality
    D
    maintenance
    Enables web search via DuckDuckGo and web content fetching through the Model Context Protocol, allowing AI assistants to search and retrieve web page content.
    9 npm
    MIT
  • A
    license
    Not graded
    quality
    C
    maintenance
    Enables AI assistants to automate web interactions such as navigating pages, clicking elements, filling forms, querying the DOM, evaluating JavaScript, and inspecting network/console logs — all from a Termux terminal without Chromium, root, or proot.
    1
    MIT
  • F
    license
    Not graded
    quality
    B
    maintenance
    Enables fetching, crawling, and browsing anti-bot protected web pages with real browser rendering, returning clean JSON or markdown, and solving captchas.
    -
  • A
    license
    A
    quality
    A
    maintenance
    Connect AI assistants to your Gramps Web family tree. Search and edit genealogy records, explore ancestors, descendants, relationships and timelines, and read document scans with vision-capable models. Includes guided research workflows, source citations, read-only mode, and privacy-aware media previews. Install with Docker or a Claude Desktop bundle.
    2
    35
    23
    AGPL 3.0
  • A
    license
    A
    quality
    B
    maintenance
    Enables MCP-capable agents to search the live web, scrape pages as Markdown or structured JSON, run dedicated scrapers, and retrieve long-running or oversized results through a single remote or self-hosted connection.
    7
    73
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Enables AI assistants to check room availability, find reservations, and create, update, cancel, or delete bookings through the platform's private web app API, with read-only access by default and preview-and-approval steps for writes.
    4
    Mozilla Public 2.0
  • A
    license
    A
    quality
    B
    maintenance
    Enables AI agents and autonomous workflows to run Google searches and extract high-density, token-efficient Markdown from webpages using stealth browser automation, with SSRF protection and health monitoring.
    3
    MIT
  • F
    license
    A
    quality
    B
    maintenance
    Enables live-web research by providing stateless browsing, link extraction, and page search capabilities via Playwright, allowing agents to fetch and analyze web content without session management.
    3
    -
  • A
    license
    A
    quality
    F
    maintenance
    MCP server for querying Google Gemini Web from Claude Code and other MCP clients, using cookie-based authentication. Enables creating, continuing, listing, viewing, and deleting Gemini chat conversations with model and thinking mode control.
    6
    AGPL 3.0
  • A
    license
    A
    quality
    C
    maintenance
    Enables AI agents to extract clean, structured web content (articles, tables, links, visual layouts) optimized for LLM token efficiency, with fast response times and optional JavaScript support.
    5
    72 npm
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    Enables any MCP client to browse, triage, search, read, and drive pi coding agent sessions through Pi Web's HTTP API via 25 tools. Supports listing and filtering sessions, reading transcripts, flagging conversations awaiting input, sending messages and waiting for replies, inspecting project diffs, and forking, renaming, or deleting sessions over either stdio or Streamable HTTP.
    25
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Provides an LLM client with self-hosted web scraping capabilities including scraping, crawling, mapping, searching, structured data extraction, browser interaction, and deep research, without reliance on paid proxy or CAPTCHA services.
    4
    GPL 3.0
  • A
    license
    A
    quality
    B
    maintenance
    Enables AI agents to rapidly drive and inspect real web pages through persistent browser sessions, using accessibility-tree snapshots and DevTools-grade diagnostics to identify and diagnose issues.
    26
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    MCP server for web scraping with natural language, enabling site crawling, page fetching, and extraction of emails, phones, links, and social profiles. Returns clean markdown, handles JavaScript rendering, and respects rate limits.
    24
    1
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Self-hostable MCP server providing web search through an operator-configured SearXNG instance, public-page fetching, and HTML-to-Markdown extraction. Search requires SearXNG with JSON output enabled.
    3
    163 npm
    141 PyPI
    MIT
  • A
    license
    B
    quality
    D
    maintenance
    A Node.js-based frontend security audit tool that performs comprehensive dependency security audits for both local projects and remote repositories. Generates detailed Markdown reports with vulnerability detection, risk assessment, and fix recommendations.
    1
    7
    ISC
  • A
    license
    B
    quality
    B
    maintenance
    Enables coding agents to send prompts to Gemini Pro through a logged-in Gemini web session in a Chromium browser, using a Chrome extension bridge instead of an API key. It also supports attaching local files to prompts and downloading images or other generated files back to disk, including on Linux servers.
    1
    1
    MIT
  • A
    license
    B
    quality
    B
    maintenance
    Enables AI agents to load, query, and write RDF Linked Data and execute SPARQL operations through composable MCP tools, including LinkedDataHub-specific resource creation. Supports compiling complex workflows into atomic JSON operation plans for efficient multi-step execution.
    34
    64 PyPI
    49
    Apache 2.0
  • F
    license
    B
    quality
    F
    maintenance
    Enables intelligent web searching using SearXNG with content crawling via Creeper, then summarizes webpage content using LLM to avoid token limit issues. Supports smart filtering with domain blacklist/whitelist and optional LLM-based relevance filtering.
    1
    -
  • A
    license
    B
    quality
    C
    maintenance
    MCP server exposing 17 pay-per-call web, finance, legal and onchain utilities for AI agents: crypto readers and Base deployer intelligence, SEC EDGAR filings, OFAC sanctions checks, insider transactions, 13F holdings, and multi-jurisdiction caselaw and legislation search. Pay per call in USDC on Base via x402 or MPP.
    17
    MIT
  • A
    license
    Not graded
    quality
    B
    maintenance
    Enables agents and analysts to gather public web information through seven MCP tools, including compliant search across 360/Bing/Sogou, reading pages and documents as Markdown, mapping sitemaps, scholarly lookups, and resumable link-by-link browsing with robots checks and rate limiting.
    728 npm
    2
    MIT
  • A
    license
    Not graded
    quality
    B
    maintenance
    Enables MCP clients and a terminal CLI to run web searches through a user's own SearXNG instance, saving every query as a reusable session and optionally generating AI-synthesized answers.
    MIT
  • A
    license
    Not graded
    quality
    D
    maintenance
    A Streamable HTTP MCP server that enables Google search capabilities using agy's OAuth session, deployable locally or on Cloudflare Workers/Vercel Edge.
    MIT
  • A
    license
    Not graded
    quality
    C
    maintenance
    Enables agents to scan web UI screens, follow login and test-case flows, and generate verified XPath locator .properties files with one unique locator per element, including support for iframes, SSO/MFA, proxies, and internal networks.
    MIT
  • A
    license
    Not graded
    quality
    C
    maintenance
    Enables looking up Chrome Web Store listing data — a single extension by its 32-character id, free-text search across extensions, and extensions attributed to a given publisher. Returns details such as name, rating, rating count, user count, version, last-updated date, category, and website.
    51 npm
    MIT
  • A
    license
    Not graded
    quality
    B
    maintenance
    An MCP server for automated interaction with Gemini's web interface using Playwright and LangGraph, enabling task execution, deep research, file uploads, chat management, and dynamic selector verification via MCP tools.
    1
    MIT
  • A
    license
    Not graded
    quality
    B
    maintenance
    Enables web search, page fetching and cleaning, OCR from images, and broken-link checking through MCP tools, with multi-provider aggregation, caching, and anti-detection features.
    35 npm
    MIT
  • A
    license
    Not graded
    quality
    C
    maintenance
    It enables AI agents and developer pipelines to pull structured public web data — clean Markdown, sitemaps, ATS and remote job listings, e-commerce catalogs, domain DNS/contact intelligence, and podcast RSS metadata — through seven token-lean read-only tools over stdio or Streamable HTTP, plus a matching CLI. Every request runs through a defense-in-depth SSRF guard with DNS validation, pinned sockets, and re-validated redirects, so no headless browser, proxy pool, or API key is required.
    MIT
  • A
    license
    Not graded
    quality
    D
    maintenance
    A high-performance search service that converts results from Google, Bing, and DuckDuckGo into structured JSON or Markdown. It features multi-layer depth crawling and uses the Camoufox anti-detection browser for reliable content extraction and fallback search logic.
    70
    MIT
  • A
    license
    Not graded
    quality
    B
    maintenance
    Enables AI agents to search the web, read any page as clean markdown, and query Wikipedia, Hacker News, and GitHub without API keys or per-call credits. It exposes these sources as unified MCP tools and can also be self-hosted over HTTP or used as a library.
    MIT