"Information about web scraping or crawling" matching MCP connectors:
Matching Connector Tools:
For queries a model can't confidently place: resolves or declines. Built to decline, not guess.
**ColdState Knowledge Search MCP Server** https://github.com/daniel-coldstate/coldstate-mcp Semantic search over 64.6M knowledge entries — the structured alternative to web search APIs and web scraping for LLM agents. No crawling, no rate limits, sub-3s responses. Cloud-hosted at services.coldstate.ai
Collaborative, cache-first web search for agents — cited answers from a shared live-web pool.
Diffbot MCP — Knowledge Graph company enrichment + web content extraction (diffbot.com)
Multilingual YouTube → Knowledge Pack engine. Paste a video URL and get a structured pack — summary, key ideas, glossary, quiz, transcript with timestamps — in Spanish, Portuguese, German, or English. Anonymous endpoint plus OAuth-gated tools for library search, RAG Q&A on a single pack, and Anki export.
Semantic search over a 200-chunk ACLM lifestyle medicine knowledge base.
Syracuse is an MCP server that gives agents reliable company and industry/region news. Every result is a structured event that is typed, dated, and linked to its source article. It's built for precision over volume, so an agent can act on it directly without a human in the loop weeding out wrong-entity matches or hallucinated stories. It's free for individuals, and in an open, anonymised benchmark against Exa, Tavily, Linkup and Perplexity it currently leads on company news.
Brave Search MCP — independent web index (no Google/Bing dependency)
Agent Module provides structured, validated knowledge bases engineered for autonomous agent consumption at runtime. Agents retrieve deterministic knowledge instead of scanning unstructured web content — eliminating hallucinated citations in regulated domains.
Knowledge Base von designare.at – Michael Kanda, Web & KI aus Wien. Semantische Suche über RAG.
AI web extraction: send URLs + a JSON Schema, get clean structured data. Pay-per-use via x402.
Real-time web search with answer-ready results for Claude, Cursor and any MCP client. A Tavily alternative: same speed, 20.2% fewer tokens, higher answer quality (60.7% of decided duels won) on a public benchmark. Hosted on mcp.serpdive.com or npx serpdive-mcp.
Connect your AI to any database — PostgreSQL, MySQL, or SQL Server — in seconds.
Persistent memory for AI assistants. Save once; recall from Claude, ChatGPT, or any MCP client.
Web-scale search for AI thats 100x cheaper and 10x faster. https://www.ceramic.ai/
Illumora Craft — evidence-augmented prompt compile for agents via remote MCP (OAuth) or local stdio.
Web search, scraping, RAG answers with citations, and translation as MCP tools.
Enable language models to perform advanced AI-powered web scraping with enterprise-grade reliabili…