"A server for crawling web pages and finding subpages" matching MCP servers:

MCP server for AI-powered web research — search (Google, Brave, Serper, SearXNG), scrape any page, extract PDFs/DOCX/YouTube transcripts, academic & patent search. Single Go binary. Works with Claude, Cursor, Copilot, and any MCP client.

An MCP server that enables AI assistants to perform web searches on Perplexity.ai using browser automation instead of an official API. It supports persistent authenticated sessions and returns search results along with cited sources directly to the client.

Provides programmatic access to Material Web documentation and components for AI agents, enabling documentation search, template generation, and HTML validation.

Enables MCP clients to search Yellow Pages local businesses by keyword and location and retrieve full listing details such as phone, hours, services, brands, and payment methods.

A Python MCP server for web research that enables fetching web pages, searching, batch-fetching, extracting links, and summarizing content via client-side sampling, with optional local file access.

Enables AI assistants to access real-time web data through search, markdown scraping, and browser automation while bypassing anti-bot protections. It provides tools for web research, e-commerce monitoring, and data extraction from across the globe.

Enables AI assistants to scrape pages, batch-process URLs, and crawl entire websites with AI-powered extraction.

An MCP server that provides AI clients with access to developer documentation via llms.txt files. Exposes tools, resources, and prompts.

Enables AI models to access and search offline Wikipedia and other knowledge bases stored in ZIM format files. Provides intelligent content retrieval, structured browsing, advanced search capabilities, and metadata extraction for comprehensive offline knowledge access.

Enables AI assistants to read, search, and traverse your entire reMarkable library, including handwritten notes via OCR.

A TypeScript-based server that enables programmatic management of pseudo-terminal sessions. It allows users to spawn, control, and interact with terminal processes in real-time through the Model Context Protocol.

Standalone MCP server for Obsidian vaults - hybrid search (FTS5 + vector + cross-encoder reranking), images and PDFs in agent-readable form, Kanban-aware tasks (Tasks-plugin + Dataview formats), structured memory with topic recall, fine-grained read/write tools for optimal token efficiency, and link graph support. Run locally, self-host, or one-click deploy for remote access. OAuth 2.1.

Enables AI assistants to manage WordPress networks through a MainWP Dashboard, including site management, updates, plugin/theme control, and bulk operations via natural language.

Provides AI assistants with direct access to Jamf official documentation, enabling them to answer Jamf-related questions by searching, retrieving articles, and browsing product documentation.

Model Context Protocol (MCP) server for GitLab — exposes 1006 GitLab REST & GraphQL API operations as MCP tools (42 meta-tools / 57 enterprise), 24 resources, 38 prompts, and 17 completion types for AI assistants. Written in Go, single static binary, stdio and HTTP transport.

Enables any MCP-compatible LLM to perform AI-powered web research using Google's AI Mode, returning synthesized and cited answers instead of raw search results.

Enables interaction with Steam: search games, get store details, reviews, prices, discounts, news, and player profiles, libraries, and achievements via the Steam Web API.

Enables local SOC 2 compliance work by scanning Infrastructure-as-Code, mapping findings to SOC 2 Trust Services Criteria, explaining risks in plain English, and drafting audit-ready documents without uploading files.

Enables Yelp business search, place details, and full review feeds as structured JSON through a hosted MCP endpoint, with no Yelp Fusion key required.

Offline-first MCP server for TwitterAPI.io docs (endpoints, pages, blogs) with fast fuzzy search.