Skip to main content
Glama
123,470 servers. Updated

Matching MCP tools:

Matching MCP Connectors:

"Information about web crawlers or related technology" matching MCP servers:

GET /v1/servers – MCP directory API reference
  • A
    license
    Not graded
    quality
    C
    maintenance
    Enables AI agents to query OpenRouter model information including prices, ELO rankings, context, and perform comparisons.
    22 npm
    1
    MIT
  • F
    license
    Not graded
    quality
    C
    maintenance
    MCP server that provides OpenRouter model pricing data, enabling price lookups, trending/cheapest lists, and model searches without an API key.
    -
  • F
    license
    A
    quality
    D
    maintenance
    An MCP (Model Context Protocol) server that gives AI agents live, structured ad intelligence across Facebook, Google, and Instagram — data that no base model can produce from training alone. Powered by Apify actors. Works with any MCP-compatible client: Cursor, Claude, etc.
    11
    -
  • A
    license
    Not graded
    quality
    C
    maintenance
    Provides live wait times and office details for all 60 Oregon DMV field offices by scraping the ODOT website, with no authentication required.
    70 npm
    MIT
  • F
    license
    Not graded
    quality
    C
    maintenance
    HandaaS的MCP服务器,提供全域资讯搜索、企业新闻、行业资讯、主题跟踪和企业动态监控能力,帮助用户开展行业研究和舆情分析。
    2
    -
  • A
    license
    A
    quality
    B
    maintenance
    Enables web search and web fetch operations using Ollama's hosted APIs, allowing MCP clients to search the web and retrieve page content.
    2
    34 PyPI
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Enables MCP clients to search the web through DuckDuckGo, Google News, and Wikipedia, and to fetch readable text or pretty-printed JSON from web pages without API keys, accounts, or configuration.
    2
    1
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    MCP server for web page fetching (converting to Markdown/text with automatic fallback between Tavily and Firecrawl) and web search via Tavily.
    2
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Enables AI agents to search and fetch high-quality information from multiple sources, including general web APIs, Wikipedia, arXiv, Hacker News, Stack Exchange, and Crossref, with optional pro-mode deep research and clean markdown page extraction.
    10
    MIT
  • A
    license
    B
    quality
    D
    maintenance
    Enables web searching via DuckDuckGo and extracting readable content from any URL using Mozilla Readability, providing web context similar to Cursor's built-in functionality.
    2
    172 npm
    6
    MIT
  • A
    license
    Not graded
    quality
    B
    maintenance
    Enables web research through multi-provider search, documentation lookup, public code search, and clean Markdown extraction from static or JavaScript-rendered pages via five read-only tools.
    1
    Apache 2.0
  • A
    license
    Not graded
    quality
    C
    maintenance
    Gives any AI agent two web capabilities: ranked search results with titles, URLs, dates and excerpts via Exa, and clean Markdown extraction of a page's main content with navigation, scripts and footers stripped. Responses are structured and schema-declared, and URL fetching is hardened against private addresses, redirects and DNS rebinding, so agents can research and cite sources safely across MCP clients.
    85 npm
    MIT
  • A
    license
    Not graded
    quality
    B
    maintenance
    Enables AI assistants to search and inspect a Calibre-Web library, see recent books, mark books read or unread, manage shelves, and send books to an e-reader.
    MIT
  • A
    license
    Not graded
    quality
    D
    maintenance
    A headless web scraping server that extracts main content from web pages into Markdown, text, or HTML for AI and automation integration. It features per-domain rate limiting and robust error handling using Playwright and BeautifulSoup.
    MIT
  • A
    license
    Not graded
    quality
    D
    maintenance
    Enables bounded web research through DuckDuckGo search and retrieval of public HTTPS pages as readable text, Markdown, JSON, or XML, with optional excerpt matching and strict safety validation.
    14 npm
    MIT
  • A
    license
    Not graded
    quality
    D
    maintenance
    Converts URLs into clean, LLM-ready markdown, respecting robots.txt and never bypassing anti-bot measures or paywalls.
    MIT
  • A
    license
    Not graded
    quality
    C
    maintenance
    Enables MCP clients that lack built-in search — such as Claude Code through Bedrock or local LLM clients — to run web queries against Amazon's operated search index via a Gateway deployed in your own AWS account, with queries never leaving AWS and citation URLs preserved. Supports IAM/SigV4, Cognito, and API key authentication, per-gateway rate limits, IP and domain restrictions, and result filtering by domain and publication date.
    MIT
  • A
    license
    Not graded
    quality
    C
    maintenance
    A layered research server that exposes three tools for searching the web with quality signals and domain diversity, fetching clean page text with automatic backend fallback, and running server-side multi-step research that returns cited answers. It handles reranking, filtering, deduplication, and degradation chains internally so callers never choose between backends or guess whether to search or fetch first.
    MIT
  • A
    license
    Not graded
    quality
    D
    maintenance
    A comprehensive web scraping MCP server with 26 tools for fetching, parsing, extracting, and assisting with web content, returning Markdown-formatted results.
    MIT
  • A
    license
    Not graded
    quality
    C
    maintenance
    Enables extracting clean, structured markdown from any URL—stripping nav, ads, and scripts—for RAG pipelines and AI research agents, with pay-per-call micropayments via x402.
    MIT
  • A
    license
    Not graded
    quality
    B
    maintenance
    Provides MCP tools to search and read social discussions from Reddit and X, and fetch pages blocked by bot protection, using a private Cloudflare Worker.
    MIT
  • F
    license
    Not graded
    quality
    D
    maintenance
    Enables AI-powered web searches using DuckDuckGo with automatic summarization via Google's Gemini AI. Supports both summary and detailed analysis modes for search results.
    -
  • A
    license
    A
    quality
    C
    maintenance
    MCP server that parses web pages into clean markdown via Crawl4AI's HTTP API, exposing parse_page and health-check tools with configurable proxy and timeout.
    2
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    An open-source MCP server providing AI agents with neural web search via Exa and tiered web fetch (Exa, local browser, Firecrawl) as a drop-in replacement for built-in web tools, preserving provenance and guarding against SSRF.
    6
    37 PyPI
    9
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Enables AI assistants to fetch public web pages as readable text or HTML, with caching, live refresh, and parallel job handling.
    3
    17 npm
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Enables MCP-capable agents to perform reliable web search and content fetching through a single server that automatically fails over across multiple providers. It handles keyed or keyless authentication automatically and returns clean Markdown or text results.
    3
    1
    MIT
  • A
    license
    A
    quality
    D
    maintenance
    An MCP server that lets an AI agent probe a live URL and confirm whether sensitive files (e.g., .git, .env, source maps) are genuinely served by fetching and validating the content, avoiding false positives.
    2
    16 npm
    1
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    Zero-dependency MCP server that wraps OpenAI Codex's standalone search endpoint into codex_web_search and codex_web_research tools for Claude Code, enabling real-time web search and multi-step deep research independent of the underlying model.
    2
    3
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Enables agents to search the live web and fetch URLs as clean Markdown, returning ranked search results and paginated page content through two lightweight tools.
    2
    23 npm
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    Wraps Xiaomi MiMo's web_search API into an MCP tool for Claude Code, enabling real-time web searches with location awareness, automatic retry, and timeout control.
    1
    4
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    Enables lightweight web search discovery and on-demand extraction of cleaned page text from supplied URLs, returning snippets, headings, links, and saved full text for longer pages.
    2
    BSD 3-Clause
  • A
    license
    A
    quality
    D
    maintenance
    Provides local LLMs with web search and page fetching capabilities via MCP, with a focus on OWASP security best practices.
    2
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Provides LLMs with real-time web search and content extraction capabilities, including text/news search, full-text URL reading, and targeted technical documentation search.
    3
    25
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Enables reading web pages and PDFs as clean Markdown, extracting main content and letting agents query for relevant passages, outline sections, search in-page, and list links while respecting robots.txt and blocking private addresses.
    4
    1
    MIT
  • A
    license
    A
    quality
    A
    maintenance
    MCP server for AI-powered web research — search (Google, Brave, Serper, SearXNG), scrape any page, extract PDFs/DOCX/YouTube transcripts, academic & patent search. Single Go binary. Works with Claude, Cursor, Copilot, and any MCP client.
    25
    79
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Provides a unified web search tool for AI agents by running multiple search providers concurrently and returning normalized results. It integrates with Claude Code, Codex CLI, OpenCode, and Hermes.
    1
    379 PyPI
    17
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Exposes Ollama's web search API as a web_search tool for Claude Code, enabling web searches (including sites other backends miss) with query and optional count parameters.
    1
    MIT
  • F
    license
    A
    quality
    D
    maintenance
    A focused MCP server that provides a single web_search tool for web searches, integrating Tavily and Brave with automatic fallback and key rotation.
    1
    -
  • A
    license
    A
    quality
    D
    maintenance
    Provides grounded web search and research capabilities using Google's Gemini models and Google Search, with features like normal and research modes, batch searches, and health checks.
    3
    78 npm
    1
    MIT
  • A
    license
    A
    quality
    D
    maintenance
    A TypeScript-based MCP server that enables AI assistants to execute HTTP requests with full control over methods, headers, and body content. It facilitates seamless interaction with web APIs and endpoints through a versatile tool that handles automatic JSON formatting and response truncation.
    1
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    Enables MCP clients to run ranked web searches with DeepSeek's search operators and to retrieve pages as titles and Markdown through DeepSeek's official Search and Fetch APIs, without invoking a chat model. Results are returned as structured content plus matching JSON text, with options for result count, page content, localization, and original-question context.
    2
    28 npm
    4
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    A Model Context Protocol server that provides real-time web search capabilities to AI assistants through pluggable search providers, currently integrated with the Brave Search API.
    5
    34 npm
    16
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    An MCP server that lets agents run free, keyless lead-leak audits on UK local service businesses — detecting form platforms and their outreach implications, checking whether phone numbers are tappable tel: links, comparing phone numbers across a site and free directories, screening website hygiene, and locating a business's own site. It also bundles these into a single full audit that returns a prioritised list of fixable issues alongside top local competitors.
    6
    MIT
  • A
    license
    A
    quality
    D
    maintenance
    Enables AI agents to extract structured content from URLs, search the web via DuckDuckGo, monitor site availability, and convert HTML to markdown without requiring API keys.
    5
    52 npm
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    MCP server that exposes 31 OSINT checks from Lissy93/web-check as tools for website analysis, including SSL, DNS, headers, WHOIS, and security presets. Enables natural-language-driven web recon and health checks.
    8
    MIT