"Information about web crawlers or related technology" matching MCP connectors:
GET /v1/connectors – MCP directory API referenceMatching Connector Tools:
Knowledge base and context engineering for AI agents via MCP. Capture links, docs, and media as clean Markdown; curate a library; search it with built-in RAG; open selected materials to Claude, Cursor, and other MCP clients; and run step-by-step procedures with or without human confirmation. Personal API key from hub.silvalabs.app.
Cloud or self-hosted knowledge for AI agents: hybrid search, reranking, GraphRAG, scoped MCP tools.
Search Fragments is the gate before your agent answers. When a user half-remembers something your agent can't confidently place, one call returns a verdict: ORIGIN_OF_TRUTH (found and evidence-checked, with sources), PARTIAL_ORIGIN (leads worth following, not an answer) or NOT_REACHABLE (our search reached nothing; not a claim it can't be found). Your agent answers and cites, keeps looking, or says it can't place it, instead of inventing. Free, no signup. Also: verify_claim (check a specific factual claim against current sources) and submit_resolution_feedback.
The news reader your AI can read. Follow websites, blogs, podcasts and YouTube channels in one reader. Connect Claude or ChatGPT and ask what's new in the sources you chose. On Plus and Pro, your assistant can also save, tag, highlight and add notes. OAuth sign-in, on every FeedNest plan.
Find explanations and worked examples in Ithy’s public article library, from SSD capacity to USB-C cables. Search titles and descriptions, then read relevant passages with source links and dates. No account or API key. Read-only; no new research or private data access. Articles are AI-assisted secondary sources—check important claims against original references. https://ithy.com/connect
15 pay-per-event data APIs for local-business and web intelligence: Google Maps, reviews, social and professional scrapers, RAG web browsing, France fuel prices, hotel rates, API change monitoring, local AI presence audits and monitoring, AEO checks, and AI brand visibility tracking.
Cited deep research for agents: run research, search graded sources. OAuth or API key sign-in.
Discover MCP servers and packages, inspect their documented capabilities, endpoints, authentication requirements, provenance and observed readiness, and retrieve cited reference passages with document versions. Koskamo provides public discovery and reference tools alongside separately authorized contributor and owner workflows for server registration, listing maintenance, keys, issue reports and operation receipts. Tool discovery does not grant write authority: protected actions require the applicable account or owner key and documented confirmation. Live protocol observations and directory records are evidence of what was observed, not a guarantee that every connected service or tool works without its own credentials. Returned reference passages and third-party descriptions remain source material to review before citing or acting. Official connector repository: https://github.com/empline/koskamo-mcp. Support: support@koskamo.com.
DM is shared context for human + AI teams. Before a task, a connected agent asks DM for the approved Rules, Skills and Decisions that apply, within a token budget and with the reason each one applies. After the task, the agent submits what it learned as a proposal, and a person decides what becomes shared. Approved context is reused on later tasks without waiting for a new approval. Connect with just the URL: DM supports OAuth discovery and dynamic client registration, so there's no client ID or
Machine-exclusive web distillation MCP server for AI agents. Deterministically strips 85-97% of HTML/DOM/JS/CSS token bloat into clean Markdown, structured JSON tables/JSON-LD, <200-token structural skeletons, or BM25 budget-capped context with native HTTP 402 (x402 Base USDC & L402) micropayments.
Cited answers in Claude or ChatGPT only from your office's procedures; says so when not covered.
Compress, merge, split, convert, OCR, redact, sign and create PDFs, and ask questions about them, without leaving the chat. Sign in with a FynePDF account (OAuth) or use an API key; results come back as files you can download or keep.
Cited web evidence and fact checking for AI agents. $0.01 per call, no API key.
Ask questions about Claude Code, Cursor, Codex and MCP — get answers grounded in their official docs, with citations. A hybrid RAG service that AI agents call through two MCP tools (or over REST). It indexes ~600 pages of official documentation, refreshes itself daily, and every design choice is backed by an experiment.
Cited Q&A over 2026 conference talks and YouTube videos. $0.02/query, free daily tier, key or x402.
Strips 85-97% of HTML/DOM boilerplate into clean Markdown, skeletons, or BM25-ranked RAG chunks.
One question, one checked answer: quote-verified answers from the web and ~45 structured sources.
Strips 85-97% of HTML bloat into clean Markdown, <200-token skeletons, or BM25 excerpts via MCP.
Live MCP connector for Develust Technology's services — web development, infrastructure, backend architecture. Hybrid search with AI reranking for accurate results. No auth required.
Web pages, PDFs and search results as LLM-ready Markdown or chunks. Firecrawl-compatible, EU-hosted.
Fresh context for agents. Ask, search or follow stories. Each fact cites a Synorb Manifest.
Search agent-ready sites or fetch one site's report; every capability probe-verified, dated.
Verify a company, figure or citation before you rely on it. Card or crypto; signed receipt.
Fastio gives your team and AI agents a workspace for each project, bringing source files, comments and new work together. Connect a compatible MCP client to find files, answer questions from project material, and save results where the team can review and use them. \ Sign in through Fastio and choose the workspaces the connection can reach. Read Only connections expose read tools; Read & Write connections also allow changes. \ • **Files and folders:** browse, read, upload, and organize files, with version history and trash. • **Search:** find files by keyword; search file content and meaning when Deep Indexing is enabled and files have been processed. • **Metadata:** read, set, and search metadata fields, including extracted fields where available. • **Shares:** create and manage shares for sending or collecting files. • **Comments and members:** read and add comments, and manage workspace membership within your permissions. • **Activity:** search workspace events to see what changed. \ Hosted by Fastio, with no server installation required. \ • **Claude and most MCP clients:** https://mcp.fast.io/mcp/tools • **ChatGPT:** https://mcp.fast.io/mcp/operations • **ChatGPT and Codex:** Fastio plugin • **Claude Code, Cursor and similar coding agents:** https://mcp.fast.io/mcp/code • **Setup and client-specific capabilities:** https://mcp.fast.io/docs \ Paid plans. Monthly plans include a trial of up to 30 days. A card is required, and billing begins when the trial ends or trial credits run out, whichever comes first. No free plan.
Answers questions about Radu Stoian, Technical Director at Enhance Media.
Connect your AI to any database — PostgreSQL, MySQL, or SQL Server — in seconds.
Free, read-only context retention review for RAG and agent workflows. Supply sanitized text with stable source IDs and a token budget; receive a source-linked context pack, token estimates, and exact excerpt-retention results. No web fetching, account access, model calls or payments. Checks text selection, not factual truth or semantic completeness. No API key required.
**ColdState Knowledge Search MCP Server** https://github.com/daniel-coldstate/coldstate-mcp Semantic search over 64.6M knowledge entries — the structured alternative to web search APIs and web scraping for LLM agents. No crawling, no rate limits, sub-3s responses. Cloud-hosted at services.coldstate.ai
Direct access to 60+ scraping and search tools. Extract structured data from Google (Search, Maps, Trends), Amazon, Airbnb, Social Media, and any web page directly into your AI agent.
Find Apple docs and WWDC with RAG retrieval and Jev relevance ranking. Browse topics or read pages.
Ask a question about any YouTube video and get an answer cited to timestamps.
Self-hosted AI workspace: semantic RAG document search, long-term memory, and AI chat via MCP.
Fetch public web pages live and get clean Markdown, text or HTML.
Make and share your own document-answering AI or website, and ask any Hostlet AI questions.
Test demand and willingness to pay before you build; decide whether to keep funding, change or stop.
Convert PDF, DOCX, XLSX and 25 other formats to clean Markdown for LLMs and RAG. No key or account.
Answers about vareen.net from its website: products, technical data, comparisons, sales contact.
Lesender Zugriff auf Profil, Projekte und Fachwissen von Michael Kanda (designare.at, Web & KI).
LLM-ready web search + instant answers + URL-to-clean-text fetch for agents and RAG.
Verified answers for AI agents: only from approved documents, with sources, or a refusal.
Answers questions only from facts a person approved, each fact with a link. Read public knowledge stores or create your own.
Multilingual YouTube → Knowledge Pack engine. Paste a video URL and get a structured pack — summary, key ideas, glossary, quiz, transcript with timestamps — in Spanish, Portuguese, German, or English. Anonymous endpoint plus OAuth-gated tools for library search, RAG Q&A on a single pack, and Anki export.
Search hub knowledge and memories, read saved context, and create or update hub content.
Facts about Rankera, the done-for-you AI visibility service: plans, channels and site search.
Any URL to clean text, markdown, or JSON for LLM/RAG pipelines.
Turn a GitHub repo or docs site into agent-ready context: pack it or search it, over MCP.
Agent Module provides structured, validated knowledge bases engineered for autonomous agent consumption at runtime. Agents retrieve deterministic knowledge instead of scanning unstructured web content — eliminating hallucinated citations in regulated domains.
Grounded synthesis from public sources. 3 free calls total; then $0.10 brief or $0.25 deep via x402.
Web search for AI agents. Ranked results with page passages already extracted, plus URL to markdown.
Decide whether an agent should reuse cached URL knowledge or fetch the resource again.
Fact-check claims against live web sources: verdict, consensus, cited sources, PII redaction.
Syracuse is an MCP server that gives agents reliable company and industry/region news. Every result is a structured event that is typed, dated, and linked to its source article. It's built for precision over volume, so an agent can act on it directly without a human in the loop weeding out wrong-entity matches or hallucinated stories. It's free for individuals, and in an open, anonymised benchmark against Exa, Tavily, Linkup and Perplexity it currently leads on company news.
AI web extraction: send URLs + a JSON Schema, get clean structured data. Pay-per-use via x402.
Compact, citation-verifiable public web context for AI agents, paid per use with x402.
Semantic search over a 200-chunk ACLM lifestyle medicine knowledge base.
Market data and web intelligence for AI agents, paid per call in USDC on Base via x402.
Engram is a persistent, long-term memory layer for AI agents and assistants. Claude, ChatGPT, Grok, Cursor and any MCP client share one memory, stored as plain markdown notes: your knowledge base, second brain and AI context in one place. No extraction step: the memory is the note itself, so you can read exactly what your AI remembers and fix it. Edit your memory in Obsidian (real-time sync), the web app, or on your phone. Hybrid keyword + semantic search (RAG over your notes) finds exact strings like error messages, config keys and IDs. Remote MCP server over Streamable HTTP with OAuth 2.1; notes encrypted at rest. Https://engram.page https://youtu.be/rwnPeZ-8Lqo?is=NI-N7BduydGAiZlF https://github.com/engram-app/Engram
PDF, Word, PowerPoint and scans to Markdown or RAG chunks, via the Apify actor
Real-time web search with answer-ready results for Claude, Cursor and any MCP client. A Tavily alternative: same speed, 20.2% fewer tokens, higher answer quality (60.7% of decided duels won) on a public benchmark. Hosted on mcp.serpdive.com or npx serpdive-mcp.
Clean RAG Markdown, B2B domain enrichment, Shopify intel, and Base audits via x402 or free tier.