"Information about web scraping or crawling" matching MCP servers:

MCP server for semantic search over PDF documents using RAG, pgvector, and OpenAI embeddings. Includes a web app for document upload and management.

An MCP server that implements Retrieval-Augmented Generation to efficiently retrieve and process important information from various sources, providing accurate and contextually relevant responses.

An MCP server that integrates Crawl4AI with Supabase to enable AI agents to crawl websites, store content in a vector database, and perform RAG queries.

MCP server for crawling web documentation and storing it in a Supabase vector database.

Provides AI assistants with long-term semantic memory capabilities through local vector-based storage. Enables storing, recalling, and managing information across sessions with complete privacy using ChromaDB, with no data ever leaving your machine.

A multi-agent Retrieval-Augmented Generation system exposed as an MCP server. Ask a question and a LangGraph pipeline plans the retrieval, pulls evidence from a pgvector knowledge base, optionally augments it with live web research, drafts a cited answer, and then self-critiques it for grounding — revising until the answer is supported by the sources.

An MCP server that provides AI assistants with access to Multi Theft Auto: San Andreas function documentation through vector similarity search and smart keyword expansion. It enables efficient information retrieval with features like deprecation warnings and SQLite caching for technical documentation.

Provides AI agents with persistent, searchable memory using semantic search, auto-linking, and categorization, with zero-config local setup or production-ready external providers.

Enables answering Formula 1 FAQ questions via vector search and web search using Bright Data.

An MCP server that retrieves resume/experience evidence relevant to a job description via vector RAG, and tracks fit-analysis results in a configurable tracking store (Notion or SQLite), with tools like match_job, push_to_tracker, and list_applications.

Enables agents to run semantic search across one or more local project directories by automatically maintaining a LAN-local Qdrant index with Ollama embeddings. Indexing, staleness checks, and incremental updates happen transparently, so users can query code by meaning without managing collections, chunks, or hashes.

An MCP server that enables RAG-powered AI chat integration for websites by crawling content, building local vector stores, and generating embeddable chat widgets. It simplifies the setup of local chat servers with support for various LLM and embedding providers.

An MCP server for semantic search and retrieval of indexed Slack messages stored in Qdrant using Cohere reranking via AWS Bedrock. It enables users to search through Slack history, retrieve full message threads, and access channel or user statistics through natural language.

Turns a tools.yaml contract into typed, tenant-guarded vector database tools that agents can use via Python imports or MCP.

Integrates R2R (Retrieval-Augmented Generation) with Claude Desktop, enabling semantic search across knowledge bases and RAG-based question answering with support for vector, graph, web, and document search.

Enables asking natural language questions about local videos, using Whisper transcription, ChromaDB vector storage, and Groq for timestamped answers via MCP.

A local, fully-offline MCP memory server that enables persistent storage and retrieval of information using SQLite with both keyword and semantic vector search capabilities.

Provides persistent context management for AI agents by storing and querying semantic information using Upstash Vector DB and Google AI embeddings. It enables semantic search, batch operations, and metadata filtering to help agents retrieve relevant stored knowledge.

A fully-local, three-layer memory plugin for Claude Code with Chinese support, offering hybrid FTS5/trigram and HNSW vector search, self-iterating memory management, consolidation, and a web console.

An experimental MCP server that makes YouTube playlist transcripts available for AI assistants, enabling search and conversation about video content.