"Web scraping and crawling tools" matching MCP servers:

Web search, content extraction, and library docs for AI agents with 5-strategy scraping and runs without API keys.

Enables retrieval and cleaning of official documentation content for popular AI/Python libraries (uv, langchain, openai, llama-index) through web scraping and LLM-powered content extraction. Uses Serper API for search and Groq API to clean HTML into readable text with source attribution.

Enables web page scraping via Jina reader API and searching FastMCP documentation using minsearch. Supports fetching markdown content from URLs and querying indexed documentation files.

Atlas helps AI agents understand and use information from the web without token bloat or hallucinations. It transforms messy web pages, SPAs, and documentation into clean, structured Markdown and JSON, providing powerful tools for deep compilation, fast scraping, multi-page crawling, and domain mapping.

Exposes an internal engineering knowledge base to AI assistants, allowing users to search and retrieve standards, runbooks, and architecture decisions. It supports RAG-enhanced search, document scraping, and specialized prompts for incident investigation and code reviews.

Enables agents to perform full-text search and read Hermes Agent documentation offline from a local cache, without scraping the site.

MCP server providing browser compatibility data for the entire Web Platform.

Provides AI coding assistants with on-demand access to component specs, test scenarios, accessibility requirements, and build guides from the Web UI Component Specification.

MCP server that exposes tools to route natural language queries to typed IDs, describe catalog entries, and list repository verification commands for the m-dev-tools organization.

Provides access to Ant Design component library documentation and information for automated code generation. Enables searching components by category or keyword, retrieving component props, examples, API documentation, and available icons.

An MCP server that provides utility tools for markdown processing, including ADF-to-markdown conversion, table formatting, and table of contents management.

Enables intelligent navigation and extraction of documentation from websites, allowing Amazon Q to automatically discover relevant pages, extract clean content, and retrieve code examples from web documentation.

Enables AI agents to browse and teach the Deep Learning DIY course, providing access to modules, notebooks, transcripts, quizzes, slides, and homework via MCP tools.

Enables inspecting local OpenAPI specification files by listing and retrieving spec details with filters and $ref resolution.

MCP server that provides UI5 Web Components documentation and integration guides for AI assistants.

A local-first MCP server for web search and documentation fetching, providing free DuckDuckGo search, URL-to-markdown conversion, and library docs from npm, PyPI, crates.io, Go, and GitHub with caching.

A Model Context Protocol (MCP) server designed to easily dump your codebase context into Large Language Models (LLMs).

An MCP server for managing pandoc/CSL-YAML bibliographies and verifying citations in documents.

Provides calculator tools for mathematical operations, access to TypeScript SDK documentation, and meeting summary prompt templates through both stdio and SSE transports.

Enables searching documentation from GitHub repositories and web pages via MCP tools, with in-memory indexing and caching for fast retrieval.