Skip to main content
Glama
avaazquezz

Qdrant RAG Build

by avaazquezz

Qdrant RAG Build

대화를 통해 완전한 RAG 파이프라인을 구축하는 Qdrant MCP 서버입니다.

비공식, 커뮤니티 제작 — Qdrant와 제휴 관계가 아니며 Qdrant의 보증을 받지 않았습니다.

공식 Qdrant MCP 서버는 2개의 도구(qdrant-store, qdrant-find)를 노출합니다. Qdrant RAG Build는 6개 네임스페이스에 걸쳐 33개의 도구를 노출합니다 — MCP 대화를 통해서만 완전히 관리되는 프로덕션급 RAG 시스템 — 그리고 한 번의 대화로 사용자를 0부터 시작해 문서 없이도 작동하고 잘 구성된 RAG 컬렉션으로 이끄는 대화형 설정 마법사도 제공합니다.

한 줄 소개: "AI를 Qdrant에 연결하고 한 번의 대화로 프로덕션급 RAG를 가동하세요." 또 하나의 Qdrant 래퍼가 아닙니다 — MCP를 통한 RAG-in-a-box.

패키지: qdrant-rag-build-mcp · 라이선스: Apache-2.0 · 상태: 기획 완료, 구현 시작 전.


목차

  1. 비전과 시장 공백

  2. 확정된 결정

  3. 아키텍처

  4. 도구 카탈로그

  5. 대화형 마법사

  6. 수집 파이프라인

  7. 고급 검색

  8. 품질 및 평가

  9. GitHub 권위

  10. 개발 단계

  11. 물려받은 교훈과 리스크

  12. 이름, 라이선스, 첫걸음


Related MCP server: RAG Knowledge Base MCP Server

1. 비전과 시장 공백

명제: 오늘날 MCP를 통해 LLM을 Qdrant에 연결하면 장난감 수준의 시맨틱 메모리만 얻습니다. 컬렉션 관리도, 파일 수집도, 하이브리드 검색도, rerank도, 인용도, 안내 구성도 없습니다. 그런 것들은 모두 주문형 엔터프라이즈 RAG 시스템에 있지만, 누구도 이를 한 번의 명령으로 설치하는 MCP 서버로 패키징하지 못했습니다.

기능

공식 Qdrant MCP

Qdrant RAG Build

---------------------

---------------------------------

-----------------------------------------

도구

2개 (qdrant-store, qdrant-find)

33개(6개 네임스페이스)

컬렉션 관리

암시적 자동 생성만

프리셋, 별칭, 스냅샷, 페이로드 인덱스로 생성

파일 수집

없음 — 원시 텍스트만

PDF, DOCX, XLSX, PPTX, MD, HTML, CSV, TXT, URL, 디렉토리

청크 분할

없음

형식별 구조적 분할, 구성 가능한 프리셋

검색

단순 밀집(dense) 검색

dense + sparse 검색, RRF 융합, 필터, rerank, MMR, 멀티 쿼리

인용

없음

안정적 인용 계약(문서, 페이지/섹션, 점수)

안내 설정

환경 변수

모든 것을 프로비저닝하는 대화형 마법사

클라이언트

stdio(로컬 Claude)

stdio + 원격 HTTP — Claude Code, Claude Desktop, claude.ai(v1); ChatGPT는 v2

2. 확정된 결정

범위. 전체 검색(retrieval) + Qdrant 관리 + 일반적 형식(PDF, DOCX, Excel, PPTX, MD, HTML, CSV, URL)에 대한 매우 높은 품질의 수집. 깨끗하고 RAG에 최적화된 콘텐츠가 이 프로젝트의 시그니처입니다.

대상 클라이언트. v1은 전체 Claude 제품군, 즉 **Claude Code, Claude Desktop, claude.ai(웹)**입니다. Code와 Desktop는 stdio 방식이고, 로컬이며 거의 원클릭 설치입니다(§3). claude.ai는 프로토콜상 원격 HTTP가 반드시 필요합니다(브라우저는 로컬 프로세스를 실행할 수 없기 때문). 하지만 그것은 큰 작업이 아니라 약간의 추가일 뿐입니다. 공식 SDK는 이미 스트리밍 HTTP를 지원하며, v1에는 전체 OAuth 2.1(§3)이 아니라 브토큰과 공개 HTTPS URL에 연결하는 배포 가이드 하나만 필요합니다. ChatGPT는 v1 범위에서 제외합니다. claude.ai와 달리 ChatGPT는 개발자 모드(위험을 명시적으로 수락해야 하는 경우)와 유료 플랜이 필요하며 무료 티어가 전혀 없습니다 — "Claude 우선"에 부합하지 않는 마찰이므로 v2로 연기합니다.

프로젝트 목표. 뛰어난 오픈소스 도구: 포트폴리오의 중심이며 GitHub에서 권위를 인정받는 수단. 문서, CI, 개발자 경험(DX)의 품질은 선택 사항이 아닙니다 — 그것 자체가 제품입니다.

범위 제외(v1). PST/이메일 수집, 대량 OCR, NER/엔티티 추출, 서버 측 LLM 생성(클라이언트가 곧 LLM인 곳) 아닌), 맞춤 UI. 각각의 제외 사유는 §11에 있습니다.

3. 아키텍처

하나의 파이썬 실행 파일, 세 개의 명확한 계층. MCP 서버는 가벼운 파사드일 뿐이며, 모든 로직은 MCP 의존성이 없는 테스트 가능한 코어에 있습니다(따라서 향후 CLI나 SDK를 추가해도 계속 지지하지 않음).

flowchart LR
    subgraph Clients
      CC[Claude Code / Desktop<br/>stdio]
      WEB[claude.ai<br/>HTTPS + bearer token]
    end
    subgraph QRB["Qdrant RAG Build"]
      T[Transport<br/>stdio · streamable HTTP]
      F[MCP facade<br/>33 tools · validation]
      CORE[RAG core<br/>ingestion · retrieval · wizard]
      EMB[Embeddings<br/>local fastembed · external APIs]
    end
    Q[(Qdrant<br/>local · cloud)]
    CC --> T
    WEB --> T
    T --> F --> CORE
    CORE --> EMB
    CORE --> Q

기술 결정

영역

결정

이유

언어

Python 3.12 + uv

성숙한 RAG 생태계; 깊은 도메인 전문성; uvx qdrant-rag-build-mcp 한 줄 설치

MCP 프레임워크

공식 MCP SDK, MCPServer (mcp>=2.1.0)

동일한 코드가 stdio(Code, Desktop)와 스트림 HTTP(claude.ai)를 지원하며, MCP 프로젝트 자체가 유지 관리합니다. SDK는 v2.0.0(2026-07-28)에서 FastMCP→MCPServer로 개명되었으며, 이 프로젝트는 현재 행을 대상으로 합니다. 레거시 제약 없음(ADR 0001 참고)

밀집 임베딩

fastembed를 통한 두 개의 로컬 계층 — paraphrase-multilingual-MiniLM-L12-v2(빠름, 0.22 GB) 및 multilingual-e5-large(품질, 2.24 GB) — 및 구성에 따라 OpenAI / Cohere / Ollama

둘 다 현재 fastembed에서 **네이티브 **로 지원되며, 제로 추가 의존성, 다국어 가능. bge-m3(원래 후보)는 사용 불가: fastembed PR #602가 2026년 2월에 열려 아직 미병합이며, 2026년 8월 기준 아키텍처 논쟁으로 막혀 있음. 병합되면 재검토

희소 임베딩

fastembed를 통한 BM25 / miniCOIL

추가 인프라 없이 하이브리드 검색; Qdrant Query API의 네이티브 융합

Rerank

fastembed를 통한 로컬 크로스 인코더; Cohere Rerank 및 /v1/rerank (llama.cpp)은 선택 사항

운영에서 이미 랭크가 있다고 가정하지 않도록 — 운영에서 얻은 교훈(§11)

파싱

PyMuPDF, python-docx, openpyxl, python-pptx, trafilatura

빠르고 바이너리 필요 없음, 모든 OS에 pip 설치 가능

설정

버전으로 관리되는 YAML 프로필 (~/.qdrant-rag-build/profiles/*.yaml)

마법사는 프로필을 작성하고, 사용자는 편집/버전 관리/공유 가능

배포

PyPI (uvx/uv) + Claude Desktop .mcpb 번들 + Docker 이미지(claude.ai 배포 레시피용) + 로컬 Qdrant용 docker-compose

v1의 실제 설치 경로 세 가지 — Code용 claude mcp add, Desktop용 클릭으로 .mcpb, claude.ai용 터널 또는 상시 호스트 — 그리고 Qdrant 편의를 위한 compose 파일

마법사가 MCP elicitation이 아닌 상태 머신인 이유. Elicitation 지원은 MCP 클라이언트와 SDK 버전, 그리고 Claude 계열 내에서도 다릅니다. 일반적인 도구로 구동되는 단순한 상태 머신은 어디서나 동일하게 작동하며, 특별한 기능이 필요하지 않습니다. v2에서 다른 elicitation을 지원하는 클라이언트가 추가되어도 그대로 적용됩니다. 전송 범위와 무관하게 고정입니다.

v1 인증 결정. MCP에 대한 전체 OAuth 2.1(인가 서버, PKCE, 동적 클라이언트 등록/클라이언트 ID 메타데이터 문서, 발급자 검증, 리프레시 토큰)은 실제로 몇 주가 걸리는 엔지니어링 작업이며, v1 예산 마련 그 밖입니다 — 그리고 claude.ai의 자체 커넥터 설정은 OAuth를 필수가 아니라 선택적 고급 필드로 취급합니다. v1에는 프로필별 정적 Bearer Token을 사용합니다: 마법사가 생성하고, 프로필 YAML에 저장되며, Authorization: Bearer <token>으로 전송됩니다. stdio(Code, Desktop)는 인증이 전혀 필요하지 않습니다 — 로컬 프로세스이며 네트워크에 없기 때문입니다. 전체 OAuth 2.1은 문서화된 v2 업그레이드 항목으로 남아 있으며, 해당 생태계가 더 많이 사용되는 ChatGPT가 (개발 모드와 유료 플랜이 요구되면서) 범위에 포함될 때 재검토합니다.

배포 모델: 사용자 1명, 서버 1대

MCP는 추상적인 "AI"에 서버를 연결하는 것이 아니라, 모델을 호스팅하는 클라이언트 어플리케이션(Claude Desktop, Claude Code, claude.ai)에 연결합니다. 연결을 유지하고, 모델에게 사용 가능한 도구 목록을 전달하며, 모델의 도구 호출 결정을 가로채서 서버에 대해 실행하는 것은 바로 그 클라이언트입니다. 최종 사용자에게는 "Claude와 대화하는데 내 Qdrant를 관리한다"고 읽히며 — 무리한 단순화는 맞습니다 — 실제로 서버에 연결된 것은 모델이 아니라 클라이언트입니다.

v1 범위에는 공유/멀티테넌시 서버가 없습니다. 각 사용자가 자신의 서버를 실행하며, 동일한 로컬 프로세스가 세 가지 v1 클라이언트를 모두 지원합니다:

  • Claude Code / Claude Desktop: 서버는 사용자 자신의 기기에서 로컬 stdio 하위 프로세스로 실행되며, 클라이언트가 자체 설정에서 시작합니다. 허용된 디렉터리로 범위가 제한된 실제 파일시스템 액세스 — 표준 MCP stdio 동작이며 이 프로젝트가 새로 만들 부분이 전혀 없습니다.

  • claude.ai: 동일한 로컬 프로세스를 터널(cloudflared)의 HTTPS를 통해 노출하거나, 같은 Docker 이미지를 실행하는 소형 상시 가동 호스트($5 VPS, Fly.io, Railway)를 통해 노출합니다 — 별도의 클라우드 배포나 공유 서버가 아닙니다. 사용자 자신의 터널링 머신이라면 파일시스템 액세스는 로컬 경우와 완전히 동일합니다. 단지 도달하는 전송 방식만 다를 뿐입니다. Free(커넥터 1개)를 포함한 모든 claude.ai 플랜에서 사용 가능합니다.

  • 결론: /dev/null이 아니라 ingest_directory / ingest_file은 사용자 자신의 서버(그리고 claude.ai의 경우 터널)가 실행 중인 한 세 클라이언트 모두에서 동일하게 동작합니다. 어디서도 파일 업로드 장치가 필요하지 않습니다. 설계상 서버는 항상 직접 디스크에 접근할 수 있기 때문입니다.

  • 설치는 한 번만 합니다:

    • Claude Desktop: .mcpb 파일 하나를 Settings → Extensions로 끌어다 놓습니다. 터미널은 전혀 필요 없습니다.

    • Claude Code: claude mcp add qdrant-rag-build -- uvx qdrant-rag-build-mcp. 한 줄이면 됩니다.

    • claude.ai: Settings → Connectors → Add에서 서버의 HTTPS URL과 bearer 토큰을 붙여넣습니다. 서버(노트북 레시피를 쓴다면 터널)가 이미 실행 중이어야 합니다 — 프로토콜상 필요한 것이며, 이 프로젝트가 선택한 것이 아닙니다. 모든 원격 MCP 커넥터와 동일합니다.

    • 이후에는 위저드가 RAG 설정을 완전히 대화형으로 만듭니다 — 컬렉션 생성, 임베딩 선택, 문서 수집, 검색 — 세 클라이언트 어디서든 추가 기술적 단계 없이 가능합니다.

v2: ChatGPT(의도적으로 아직 범위 밖)

ChatGPT는 claude.ai와 동일한 원격 HTTP 방식이 필요합니다. 기술적으로 새로운 것은 없습니다. v1에서 제외되는 이유는 ChatGPT 자체와 관련된 특수한 제약입니다: Developer Mode를 명시적으로 활성화해야 하며(타사 코드 실행에 대한 경고 문구가 표시됨), 사용자 지정 커넥터는 **유료 플랜(Plus/Pro/Business/Enterprise/Edu)**이 필요합니다. claude.ai가 무료 티어에 커넥터를 포함하는 것과 달리 ChatGPT Free 경로는 전혀 없습니다. 그 어느 것도 "Claude 우선"이라는 원칙에 맞지 않습니다. v2는 ChatGPT 전용 커넥터 가이드를 추가하고, 필요 시 완전한 OAuth 2.1을 재검토합니다(ChatGPT 생태계는 claude.ai보다 더 그쪽을 선호합니다).

4. 도구 목록

프로젝트의 핵심입니다. 여섯 개의 네임스페이스, 예측 가능한 이름, LLM을 위해 작성된 설명(도구가 무엇을 하는지뿐 아니라 언제 사용해야 하는지). 모든 파괴적 도구는 명시적 확인을 요구하며, 전역 read-only 모드가 있습니다.

Collections

Tool

기능

collection_create

프리셋(default, hybrid, multi-tenant)으로 컬렉션을 생성합니다. named vectors와 sparse는 기본적으로 올바르게 설정됩니다.

collection_list

전체 컬렉션 인벤토리

collection_info

상세 정보: 스키마, 크기, 인덱스 설정, 최적화 상태

collection_delete

두 단계 확인 및 삭제(인자에 정확한 이름 필요)

alias_set

무정지 재인덱싱(zero-downtime reindexing)을 위한 별칭(블루/그린 패턴)

payload_index_create

위저드나 사용자가 선언한 필터를 위한 페이로드 인덱스

snapshot_create

컬렉션 백업

snapshot_restore

컬렉션 복원

Ingestion

Tool

기능

ingest_text

메타데이터가 포함된 직접 텍스트 — 공식 MCP의 "semantic memory" 사용 사례를 제대로 구현

ingest_file

단일 파일 (PDF, DOCX, XLSX, PPTX, MD, HTML, CSV, TXT); 수집 품질 보고서를 반환

ingest_directory

glob/제외 패턴을 지원하는 재귀 일괄 처리; 진행을 조회할 수 있는 작업 생성

ingest_url

웹 페이지 → 깨끗한 본문만 추출(trafilatura), 보일러플레이트 없음

job_status

작업 진행률: 완료/실패/건너뜀 파일 수, 재조정된 카운터

document_list

원본 문서별 인벤토리

document_delete

나머지 문서를 건드리지 않고 단일 문서 삭제/재수집

Tool

기능

search

선택적 payload 필터가 있는 Dense 시맨틱 검색

search_hybrid

Dense+sparse, 네이티브 RRF 탄합(Query API with prefetch) — 권장 기본값

search_rerank

상위-N에 하이브리드+cross-encoder 적용; 최대 정밀도

search_multi_query

클라이언드 LLM이 생성한 여러 reformulation을 하나의 랭킹으로 통합

find_similar

주어진 것과 유사한 점 포인트 탐색

recommend

긍정/부정 예시를 사용한 추천(네이티브 Qdrant API)

RAG context

Tool

기능

get_context

핵심 기능: 검색+중복제거+MMR+토큰 예산 → 번호가 매겨진 인용 자료가 있는 포맷된 컨텍스트 블록, 클라이언트 LLM이 바로 답할 준비 완료

expand_context

결과의 이웃 청크(같은 문서의 이전/이후)를 가져와 연속성 유지

get_document

인용 뒤의 원문(또는 페이지/섹션 범위) 전체

Wizard

Tool

기능

setup_start

설정 세션을 시작하고, 옵션과 추천 안이 있는 첫 번째 질문을 반환

setup_answer

답변을 저장·검증(Qdrant에 응답? API 키가 동작?)하고 다음 질문을 반환

setup_apply

합의된 계획 실행: 컬렉션+인덱스+프로필+스모크 테스트; 최종 보고서 반환

profile_list

저장된 프로필 목록

profile_use

저장된 프로필(demo, work, project X…)을 활성화

Admin

Tool

기능

health

Qdrant 연결, 임베딩 모델 로드, 버전, 활성 전송(연결 방식)

stats

포인트, 문서, 디스크 크기, 소스/유형별 분포

estimate

수집 전: 예상 청크 수, 저장 공간, 해당 시 API 비용 임베딩

config_get

활성 프로필의 실제 적용 설정(비밀 마스킹)

5. 대화형 위저드

차별화 요소입니다. 서버 내부의 state machine: 모든 도구 호출은 다음 질문을 옵션과 근거 있는 추천과 함께 돌려줍니다. 클라이언트 LLM이 그 질문을 자연스럽게 사용자에게 전달하고 답변을 넘겨받습니다. 대화를 유도하지도 않고 특정 클라이언트에 의존하지도 않습니다 — 대화 자체가 인터페이스입니다.

stateDiagram-v2
    direction LR
    [*] --> Discover
    Discover --> Validate : setup_answer
    Validate --> Discover : next question
    Validate --> Summary : all answered
    Summary --> Apply : user confirms
    Apply --> SmokeTest
    SmokeTest --> [*] : report + saved profile

질문 스크립트 (고정 순서, 모든 단계에서 추천)

#

질문

무엇을 결정하는가

1

RAG에 무엇을 넣습니까? (내 문서 / 팀 지식 / 기술 문서 / 메모)

청크 크기 프리셋과 payload 스키마

2

Qdrant는 어디에 있습니까? (local docker / Qdrant Cloud / 아직 없음)

연결 방식; "아직 없음"인 경우 원라이너 docker 안내 후 재검증

3

로컬 임베딩 또는 API? (로컬 빠름 / 로컬 품질 / OpenAI / Cohere / Ollama)

DDense 공급자 및 속도/품질 티어; 해당 API 키 즉석 검증

4

문서의 언어는 무엇입니까?

다국어 모델 선택과 sparse analyzer 확인

5

하이브리드 검색? (권장: 예)

컬렉션 스키마의 sparse vector

6

재순위화? (로컬 / API / 없음 )

Cross-encoder와 그 지연 비용, 정직하게 안내

7

어떤 필터를 사용하시겠습니까? (날짜, 작성자, 유형, 폴더…)

기본 생성할 payload index

8

컬렉션/프로필 이름

이름 결정 + 프로필 파일

위저드 성공 정의. Qdrant라는 말조차 처음 듣는 사용자가 10분 미만 대화 끝에, 잘 스키마된 컬렉션, 정상 동작하는 임베딩, 저장된 프로필, 예시 문서 1회 수집, 그리고 인용된 결과를 돌려주는 테스트 검색까지 갖추는 것. 스모크 테스트의 최종 보고서가 증명이고 — 그 대화의 녹화는 README의 커버입니다.

6. Ingenstion 파이프라인

품질의 증거: 깨끗하고 RAG에 최적화된 내용을 형식별로 만들어 내고, 모든 수집에 품질 보고서를 붙입니다. "파서가 뱉어낸 것을 그대로 담는" 일은 결코 없앤니다.

형식

파서

품질 처리

PDF

PyMuPDF

올바른 읽기 순서, 반복되는 헤더/푸터 감지 후 제거, 표를 Markdown으로 변환, 페이지 수락 전 텍스트 품질 사전 점검(유효 문자 비율)

DOCX

python-docx

제목 계층을 메타데이터 브레드크럼으로 유지, 구조화된 목록 및 테이블

XLSX

openpyxl

시트별 처리, 데이터 영역 감지, 행을 해당 헤더와 함께 직렬화("상품: X · 가격: Y") — 원시 CSV 아님

PPTX

python-pptx

슬라이드별: 제목 + 본문 + 발표자 노트

MD / HTML

native / trafilatura

제목 중심으로 청크 분할, 웹 페이지는 본문만 추출(내비게이션·쿠키·푸터 제외)

CSV / TXT

stdlib

CSV는 헤더 지정 행으로, TXT는 토큰 윈도로 단락 단위 처리

공통 규칙

  • 구조 우선, 토큰 다음. 문서 구조(절, 시트, 슬라이드)를 먼저 기준으로 자르고, 한 단위가 토큰 예산을 넘을 때만 겹침을 허용하면서 다시 나눈다. 모든 청크에는 "사용 설명서 › 3장 › 설치" 같은 브레드크럼을 남긴다.

  • 내용 해시로 중복 제거를 청크 수준에서 적용하고, 문서별 멱등성도 보장한다. 파일을 다시 수집하면 업데이트되며 중복 생성되지 않는다.

  • 최소한이며 버전이 있는 인용 계약. 인용 페이로드(문서, 쪽/절, 날짜, 출처)는 닫힌 필드 집합이다. 내부 파이프라인 메타데이터는 LLM 컨텍스트에 절대 전달되지 않는다. 이 프로젝트 전신에서 메타데이터가 실제 소스를 잘라서 피해가 생긴 버그를 두 번 경험했다(§11).

  • 수집 결과는 항상 보고한다. 생성된 청크 수, 품질 문제로 폐기한 페이지와 그 사유, 감지된 중복까지 표시한다. 투명성은 품질의 일부다.

  • 임베딩 전 텍스트 정제(서브로게이트, 제어 문자, 깨진 인코딩)를 한 후 수행한다. 실전 PST 파일에서 고생해서 알게 된 점이다.

7. 고급 검색

  • 기본은 하이브리드 검색: 밀집(다국어 임베딩) + 희소(BM25/miniCOIL) 결합이며, Qdrant Query API(프리페치 + 퓨전)의 네이티브 RRF 퓨전을 사용한다 — 추가 인프라 불허.

  • 선택 재랭크: 상위 50개 → 상위 N개에 크로스 인코더 적용. 로컬 fastembed 옵션 또는 API(Cohere, llama.cpp의 /v1/rerank) 옵션.

  • 다양성용 MMR은 Qdrant가 이미 반환한 벡터 그대로 재사용합니다(with_vectors=true). 검색 중 다시 임베딩하면 안 됩니다. 이 실수로 이전 프로젝트에서 실제 운영 OOM이 났었다.

  • 일류 페이로드 필터: 날짜(경계가 명확하고 lte에서 종료일 포함), 출처, 유형, 작성자 — 위 재주 던지는 위저드가 생성한 인덱스를 대상으로 지원한다.

  • get_context 도구가 핵심: 하이브리드 검색 → 재랭킹 → MMR → 토큰 예산 → 번호 매겨진 인용 [1][2] 형식 블록을 조합한다. 핵심에 사용된 항목만 인용할 수 있다. 기준: 실제 컨텍스트에 들어간 내용만 인용하고, 이적 출처/허상 인용은 하지 않는다.

  • 생성은 클라이언트에 있다. 서버는 LLM을 호출하지 않는다. 서버는 최상의 컨텍스트만 제공하고, 사용자 모델(Claude, GPT)이 답변을 쓴다. 이로써 서버는 저렴하고 빠르고, 필수 제3자 API 키가 없다.

8. 품질과 평가

  • 저장소에 골든 코퍼스 포함: 다양한 문서 15–20종(PDF 표, 실제 스프레드시트, 화질 낮은 웹 페이지) + 약 50문제와 NaN이라는 관련 청크 주석이 달려 있다.

  • CI에서 검색 지표 실행: 골든 코퍼스 기반 recall@k, MRR, nDCG를 기준으로 회귀시 빌드가 실패하도록 임계값을 설정한다. 밀도/하이브리드/하이브리드+재랭킹 비교를 문서에 공개 — 이 숫자가 프로젝트를 보여준다.

  • 계층 테스트: Qdrant가 필요 없이 코어 테스트, 컨테이너(testcontainers)의 Qdrant 통합 테스트, SDK 테스트 클라이언트를 사용한 MCP 프로토콜 장면 e2e 테스트. 형식을 위한 강성 테스트 파일(스캔 PDF, 병합 셀 Excel, 잘못된 HTML) 존재.

  • 각 릴리스마다 호환성 매트릭스 확인: Claude Code/Claude Desktop/claude.ai를 스크린샷으로 문서화 v2에는 ChatGPT 추가.

9. GitHub 신뢰성

포트폴리오 목표에서 저장소는 코드만큼이나 제품 그 자체다. 출시 체크리스트:

  • 설득력 있는 README: 한 번의 대화에서 위저드가 RAG를 만드는 데모 녹화(vhs/asciinema), 3줄짜리 uvx 퀵스타트, 배지(CI, 커버리지, PyPI, 라이선스), 공식 MCP와의 비교 표, 벤치마크 공개.

  • 랜딩 페이지: README나 문서 사이트와 분리된 전용 정적 페이지 — 히어로, 공식 Qdrant MCP와 비교 표, 위저드 데모 영상, 세 가지 v1 클라이언트용 설치 CTA, F5의 벤치마크 수치. 이것이 론칭 포스트와 소셜 링크의 표현 대상이다.

  • 문서화: mkdocs-material 기반 사이트. 각 클라이언트용 가이드(Claude Code, Claude Desktop, claude.ai — bearer-token 커넥터 절차 포함), 쿡북("자체 문서 위에서 RAG", "팀 메모리"), 총 33개 도구 전체 레퍼런스, 공개 ADR 포함.

  • 미세보기 엔지니어링: CI에 ruff + mypy strict + pytest + coverage, release-please 자동 시맨틱 버전, CHANGELOG, issue/PR 템플릿, CONTRIBUTING, 행동 강 Lower, GitHub Discussions 활성화.

  • 배포와 출시: PyPI + Claude Desktop .mcpb 번들 + Docker 이미지 + compose 스택(Qdrant 포함). 공식 MCP 레지스트리, Smithery, Glama, PulseMCP, awesome-mcp-servers에 등록. 출시: 기술 포스트 + Show HN + r/LocalLLaMA + X, 위저드 시연 영상이 도입부 역할.

10. 개발 단계

사이드 프로젝트 페이스(저녁/주말). 모든 단계는 데모 가능한 결과로 끝난다. 단계를 동시에 벌이지 않는다.

단계

초점

기간

완료 기준

F0

명세 및 스켈정독

~1.5주

저장소 + CI + 패키지 구조. 전체 33개 도구 JSON 스키마 완성 및 리뷰 이름**. §3 결정에 관한 ADR. uvx qdrant-rag-build-mcp 실행 가능, health가 Claude Code(stdio)와 claude.ai(HTTP, 터널)에서 응답.

F1

Qdrant 코어

~2주

전체 컬렉션 네임스페이스, ingest_text(text에 따라 약자), 밀집 search, 구성 프로파일, 읽기 전용 모드. Claude Code에서 e2e 데모: 수집, 저장, 검색 하나로. 이미 공식 MCP의 상위 집합.

F2

프로페셔널 인게지션

~3주

8가지 포맷 품질 처리, 구조 청킹, 중복 제거, 작업 진행도, 인수 보고서. 상품문서 100개가 중복은 탁없이, 보고서 정확(카운터 촉급), 멱등 재인수.

F3

고급 검색

~2주

하이브리드 RRF, 재랭크, MMR, 필터, 인용 계약을 갖춘 get_context. 골든코퍼스 평가에서 하이브리드+재랭킹이 밀집 검색 대비 개선되고 인용에 없는 출처가 없음.

F4

위저드

~2주

상태 머신, 모든 응답 실시간 검증, setup_apply 스모크 테스트, 여러 프로파일. 외부 테스트가 10분 만에 대화만으로 RAG 만들기(문서 참고 없음). 데모 녹용.

F5

품질과 셧다운

~1.5주

CI 평가, stats/estimate, 스냅샷, 검증된 클라이언트 호환성 매트릭스. CI 통과 및 차단평가, 수치 문서화.

F6

출시

~2.5주

전체 문서, 정교한 랜딩 페이지, 데모 README, PyPI + .mcpb + Docker, MCP 레지스트, 등록. 3가지 v1 환경에서 한 명령 / 끌어넣기 설치, ≥4 레지스트리 등록, Show HN 제출.

총 기간: 약 14.5주(약 3.5개월), 현실적인 사이드 플젝트 페이스를 유지하면서 2주마다 시연 가능한 마(estones)로 전진해나간다.

5. 물론교훈과 리스크

숨겨진 강점: 이 계획은 테라급 프로덕션 RAG를 다뤄 이미 *비용 지불에 오류들을 그대로 상속한다. 고치는 것이 아니라 처음부터 설계에 담았다.

유료목 감가상각된 교훈

Qdrant RAG Build에 적용되는 방법

MMR가 검색 중 다시 임베딩하여 실제 OOM 원인이 되었다

MMR은 항상 Qdrant가 반환한 벡터를 재사용하고, 검색 경로에 임베딩을 금기시함

내부 메타데이터가 실제 소스를 잘라먹는 페이로드 비대화(두 번에 원인 다름)

닫힌 버전 인용 계약, 파이프라인 메타데이터는 예외없이 LLM 컨텍스트에 못 오게 함

"지역에서 재랭크 된다"고 가정했지만 그렇게 작동했던 일이, 회장에서는(에 이충) 억제/숨어있던

재랭크는 검증 가능 프로바이더에 명시 health로 구성된 재앙커가 실제 응답하는지 확인함

같은 프로세스의 thread + fork가 실제 인입 데드록

동일 모델+ async/worker 프로세스로 두 가지 동시쇄, ThreadPoolExecutor를 fork와 혼용 금지

자식 프로세스 조용로 죽고 작업상태 40%에서 "완료" 표시된 작업

completed는 카운터(expected = processed + justified failures)가 실제 일치해야만 승인

OCR이 45초나 걸린 끝에 문서를 폐기만 할 때가 있다

고비용 작업 전의 저렴한 품질 사전 점검/문서별 시간 계산 보장

NER는 도메인에 따라 무한 굴절질이라 하더라도

NER은 v1 범위 outside적 — 실수(one-of)가 아니라 의사 결정

공개된 잔여 위험

위험

완화 조치

범위 팽창(scope creep) — 엔터프라이즈 RAG 전체를 다시 구축하고 싶은 유혹

§2의 "범위 외(out of scope)" 목록은 계약과 같습니다. 무엇인가 추가하려면 그만큼 다른 항목을 제거하거나 v2의 필요성을 정당화해야 합니다.

claude.ai의 원격 배포의 부담(터널 또는 상시 가동 호스트는 로컬 stdio보다 한 가지 더 많은 동작 부분을 만든다)

로컬 stdio(Code, Desktop) 방식은 기본 경로이면서도 특별한 설정이 전혀 필요 없습니다. claude.ai의 설치는 안내 문서 한 페이지에 불과하며, v1가 필요하는 유일한 원격 클라이언트입니다. ChatGPT처럼 Developer Mode나 유료 요금제의 복잡성을 요구하지 않습니다.

ChatGPT를 배제하면 v1의 대상이 Claude 생태계로만 한정될

의도된 트레이드오프입니다. claude.ai는 무료 플랜을 포함하여 모든 요금제에서 이미 "원격·설치 불필요" 사용자를 커버합니다. ChatGPT의 Developer Mode + 유료 요금제 진입 장벽은 실제 마찰만 늘고 v1의 도달 범위를 크게 넓히지 못합니다. 핵심이 증명된 후 v2에서 다시 검토합니다.

fastembed PR #602(bge-m3 지원)가 무한정 지속될 잠혀 있을 경우

v1은 이에 의존하지 않습니다. multilingual-e5-large를 네이티브로 사용하며, PR이 병합되면 v2 업그레이드로 재검토하거나 해당 PR에 직접 기여하는 방법도 있습니다.

MCP 프로토콜 또는 Qdrant Query API의 변경

항상 최신 공식 SDK를 사용하고 릴리스마다 호환성 매트릭스를 유지합니다. 얇은 퍼사드(facade)로 변경에 노출되는 범위를 최소화합니다.

33개 도구가 클라이언트의 컨텍스트 자원을 포화시킨다

도구 선택(tool-choice)이 간결해지도록 설명문을 최적화하고, 각각 different profile별로 도구 세트(예: 일반 사용시에는 관리 도구 숨기기)를 제공한다.

시간 부족으로 인한 중단(사이드 프로젝트의 위험 #1)

각 단계를 ≤3주 이하로 하고 마지막에는 데모를 준비합니다. 다른 계획이 모두 빗나가더라도 F1만으로도 "official MCP, but better"의 결과는 공개할 수 있습니다.

12. 이름, 라이선스, 첫 구체적 단계

이름: Qdrant RAG Build (패키지 qdrant-rag-build-mcp) — 새로운 브랜드를 만들지 않고 이 리포지토리의 기존 작업 이름을 유지하려고 선택한 이름입니다. 이름느 두 차례의 선정 라운드를 거쳤습니다: Quiver는 관련 없는 "Quiver Quantitative" MCP 네임스페이스(bolshchikov/quiver-mcp, pipeworx-io/mcp-quiver, jsconiers/quiver-quant-mcp)와 충돌하여 제외되었고, Vectorsmith는 중복 검사를 통과했으나 리포지토리와 연결되는 이름을 유지하자는 명확한 요구에 따라 제외되었습니다. 원래 계획에서 지적했던 트레이드오프 — "qdrant" 접두사가 붙은 이름이 공식 Qdrant 프로젝트처럼 보일 수 있다는 점 — 를 받아들이며, README 태그라인과 문서 사이트에 "비공식, 커뮤니티 제작"임을 분명하게 밝혀 완화합니다. 문자 그대로의 slug인 qdrant-rag-mcp는 이미 활성화된 다른 프로젝트(ancoleman/qdrant-rag-mcp)가 사용 중이고, qdrant-rag-build / qdrant-mcp-rag-build는 PyPI와 GitHub에서 중복 없음을 확인했습니다(2026년 8월).

라이선스: Apache-2.0 — Qdrant와 동일하며, 특허 포기를 포함하고, 기업들이 여러분의 프로필을 읽을 때 기대하는 라이선스입니다.

첫 번째 구체적 단계: F0은 서버 코드를 단 일의 줄을 짯도 전에 33개 도구 전체의 JSON 스키마를 작성하는 것에서 시작합니다. §4의 카탈로그가 스펙사양이며, 먼저 그 스펙을 확정함으로써 중간에 설계를 얼지 않게 되고, 1주차부터 공개 가능한 설계 문서를 만들 수 있습니다.


참고 문헌: qdrant/mcp-server-qdrant (공식 서버, 도구 두 가지) · fastembed PR #602 (bge-m3 지원, 오픈 상태) · MCP Bundles(.mcpb) 툴킷 · 원격 MCP 커스텀 커넥터(claude.ai) · v2 권장 자료: ChatGPT Developer Mode, OpenAI의 MCP 및 커넥터

플랜 v1.3 · 2026-08-24 확정 고정 · v1은 전체 Claude 제품군(Code, Desktop, claude.ai — stdio + bearer-token HTTP)을 대상으로 하며, ChatGPT는 별도의 Developer Mode/유료 플랜 제약 때문에 v2에만 적용됩니다(claude.ai와 공유되는 기술 제약이 아닙니다). IA_EmailsContext 엔터프라이즈 RAG 프로젝트에서 얻은 경험을 참고하여 작성했습니다.

Available Tools

33 tools
alias_setA

Points an alias at a collection, enabling zero-downtime blue/green re-indexing — clients keep querying the alias while the underlying collection is swapped out. Use this when republishing a freshly re-indexed collection without downtime.

NameRequiredDescriptionDefault
aliasYes
collectionYes

Output Schema

NameRequiredDescription
aliasYes
updatedYes
collectionYes

TDQS

A4.2/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The description explains the underlying behavior beyond the annotations: clients continue querying the alias while the collection is swapped, which reinforces the non-destructive mutation implied by the annotations. It doesn't mention side effects on the old collection, but still provides meaningful behavioral context.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is two tight sentences with the verb/action and use case front-loaded. There is no redundant phrasing or repetition of the tool name, and every clause adds context.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For two simple string parameters and an existing output schema, the description gives enough context about when and how to use the tool. It could mention whether the alias or collection must already exist, but the core operation, purpose, and invocation context are sufficiently covered.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the description alone must clarify parameters. It conveys that 'alias' is the stable endpoint clients query and 'collection' is the target being pointed to, which adds relationship meaning. Even so, it doesn't specify exact value formats, whether names or IDs are expected, or any option constraints.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description uses a specific action and resource pair ('Points an alias at a collection') and immediately adds the practical goal: zero-downtime blue/green re-indexing. This distinguishes it from general collection creation/deletion tools or search operations and makes the tool's role unambiguous.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

It gives an explicit use case: 'Use this when republishing a freshly re-indexed collection without downtime.' It does not explicitly mention when not to use it or suggest alternatives, so it stops just short of complete routing guidance.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

collection_createA

Creates a new Qdrant collection using a named preset (dense, hybrid, or multitenant), with named vectors and payload indexes configured correctly by default. Use this once per new document set that needs its own collection — not for adding documents to an existing collection (use ingest_* for that).

NameRequiredDescriptionDefault
nameYes
presetYes

Output Schema

NameRequiredDescription
presetYes
createdYes
collectionYes
sparse_enabledYes
dense_vector_sizeYes

TDQS

A4.4/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations indicate this is a write operation but not destructive; the description goes beyond this by explaining what the tool configures by default (named vectors and payload indexes) and that it creates a fresh, standalone collection. It adds useful behavioral context such as the intended one-time usage per document set.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is two sentences, front-loaded with the core action, and every clause adds useful information. There is no filler or repetition of schema details.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given two simple parameters and an output schema, the description covers the core purpose, usage boundary, and default behavior well. A minor gap is the lack of guidance about what differentiates the presets or what happens if a collection with the same name already exists.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the description must compensate, and it partially does by explaining that 'name' is a collection name tied to a new document set and 'preset' selects dense, hybrid, or multitenant. However, it does not explain what each preset actually changes or how the name should be formatted, so the parameter semantics are only partially fleshed out.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states that this tool creates a new Qdrant collection, names the available presets, and says it configures named vectors and payload indexes by default. It also distinguishes this operation from adding documents, making its scope unambiguous.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines5/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description explicitly says to use this tool once per new document set needing its own collection, and explicitly tells the agent not to use it for adding documents to an existing collection, directing it to ingest_* tools instead.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

collection_deleteA
Destructive

Permanently deletes a Qdrant collection and all its data. Destructive — requires confirm_name to exactly match name, and is blocked entirely when the server is in read-only mode. Use only when the user has explicitly confirmed they want a collection gone.

NameRequiredDescriptionDefault
nameYes
confirm_nameYes

Output Schema

NameRequiredDescription
nameYes
deletedYes

TDQS

A4.7/5.0
Behavior5/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Beyond the annotations, the description discloses that deletion is permanent, removes all data, requires confirm_name to exactly match name, and is blocked in read-only server mode. This is strong behavioral context and does not contradict annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Three concise, front-loaded sentences. Every sentence adds useful information: permanent deletion, destruction, confirmation, read-only block, and user-confirmation guard. No redundant text.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a two-parameter destructive tool with annotations and output schema, the description covers all essential behavior, including irreversibility, the guard to prevent accidental deletion, and operating restrictions. The agent can safely invoke this tool without needing further context.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the description must compensate. It clarifies that confirm_name must exactly match name and that name identifies the Qdrant collection. It could list each parameter separately, but the critical confirmation relationship is explicit and sufficient.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description uses a specific verb and resource: 'Permanently deletes a Qdrant collection and all its data'. This clearly distinguishes collection_delete from siblings like collection_create, collection_list, collection_info, and document_delete.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

It explicitly states when to use the tool: only after the user explicitly confirms deletion. It also mentions the read-only mode block and confirmation-match requirement. It does not mention alternative actions like backup or snapshot-restore, but for a destructive delete the main safety guidance is clear.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

collection_infoA
Read-only

Returns full detail on one collection: vector schema, payload indexes, size, and optimization status. Use this to inspect a specific collection's configuration, e.g. before deciding whether hybrid search or a given filter is available.

NameRequiredDescriptionDefault
nameYes

Output Schema

NameRequiredDescription
nameYes
presetYes
points_countYes
sparse_enabledYes
disk_size_bytesYes
payload_indexesYes
optimizer_statusYes
dense_vector_sizeYes

TDQS

A4/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and destructiveHint=false, so no contradiction exists and the read-only nature is known. The description adds detail about the returned fields, which is helpful, but does not disclose additional behavioral traits such as error behavior, required permissions, or rate considerations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is compact: two sentences with no filler. The first sentence states what the tool returns, and the second gives a concrete use-case. Information is front-loaded and every clause earns its place.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple read-only tool with one parameter, an output schema, and clear annotations, the description provides enough for an agent to select and call it correctly. It could mention what happens when the collection does not exist, but this is a minor gap given the output schema exists.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

There is only one required parameter, 'name', and the schema description coverage is 0%. The description clarifies that the name refers to one collection, but does not explain naming constraints, formats, or how the value is used beyond the title already indicating it is a name.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description uses a specific verb and resource: 'Returns full detail on one collection,' and enumerates what is included: vector schema, payload indexes, size, and optimization status. This clearly distinguishes it from sibling tools like collection_list or collection_create.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description explicitly states when to use the tool: to inspect a specific collection's configuration, with a concrete example — deciding whether hybrid search or a given filter is available. It does not explicitly describe when not to use it or name alternatives, but the usage context is clear.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

collection_listA
Read-only

Lists every Qdrant collection managed by this server, with basic size info. Use this to see what RAG collections already exist before creating a new one or picking which to search.

NameRequiredDescriptionDefault

No parameters

Output Schema

NameRequiredDescription
collectionsYes

TDQS

A4.3/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and destructiveHint=false, so the safety profile is covered. The description adds the useful detail that the tool returns basic size info for each collection, but it does not add deeper behavioral context such as pagination or potentially large responses. With annotations covering the core behavior, a 3 is appropriate.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two sentences with no wasted words. The main action is up front, the scope is explicit, and the usage guidance is integrated without bloating the description.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a zero-parameter, read-only listing operation with an output schema present, the description fully covers what the agent needs to decide when to call this tool. Nothing important is missing.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

This tool has zero parameters and the schema covers everything trivially, so the description has little to add. The baseline for a zero-parameter tool is 4, and the description's mention of 'which collection' selection is sensible even though no parameters are needed here.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description uses a specific verb and resource ('Lists every Qdrant collection') and adds scope ('managed by this server') plus a hint of return content ('basic size info'). It effectively distinguishes itself from collection_info (single collection) and collection_create by focusing on enumeration of all collections.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides clear usage context: use it to see existing RAG collections before creating a new one or choosing which to search. It does not explicitly name alternative tools or say when not to use it, but the use-case guidance is strong enough to guide an agent.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

config_getA
Read-only

Returns the effective configuration of the currently active profile, with secrets (API keys, bearer tokens) masked. Use this to confirm what's actually configured without ever exposing credentials.

NameRequiredDescriptionDefault

No parameters

Output Schema

NameRequiredDescription
collectionYes
profile_nameYes
dense_providerYes
rerank_enabledYes
sparse_enabledYes
embedding_api_key_setYes

TDQS

A4.2/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The annotations already declare readOnlyHint=true and destructiveHint=false, and the description adds a valuable behavioral detail: secrets such as API keys and bearer tokens are masked in the output. This goes beyond the annotations and warns the agent that the response has sanitized values.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is concise and front-loaded: it states the main behavioral contract first, then adds the credential-masking guarantee. Every sentence adds value, and there is no redundant or filler content.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a zero-parameter, read-only tool with an output schema available, the description is complete. It identifies what is returned, the intended use, and the critical masking behavior, so an agent has enough information to invoke the tool correctly and interpret expectations.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema has zero parameters, so the description does not need to describe parameter behavior. The description clarifies that no input is required and that the tool operates on the currently active profile, which is sufficient context for a parameterless tool.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool returns the effective configuration of the active profile, which is specific and actionable. It implies a distinction from sibling tools like profile_list and profile_use, but it does not explicitly differentiate itself from them.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description gives a clear intended use: 'confirm what's actually configured without ever exposing credentials.' It does not explicitly state when not to use it or mention alternatives, but the guidance is strong enough for an agent to recognize the appropriate use case.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

document_deleteA
Destructive

Deletes every chunk belonging to one source document from a collection, without touching the rest. Destructive — requires confirm_doc_id to exactly match doc_id, and is blocked in read-only mode. Use only when the user has explicitly confirmed the deletion.

NameRequiredDescriptionDefault
doc_idYes
collectionYes
confirm_doc_idYes

Output Schema

NameRequiredDescription
doc_idYes
collectionYes
chunks_deletedYes

TDQS

A4.9/5.0
Behavior5/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already signal destructive behavior, but the description adds crucial context: the deletion is scoped to one document's chunks, confirmation requires an exact doc_id match, the tool is disabled in read-only mode, and it must only be used after explicit user confirmation. No contradiction with the annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Every sentence earns its place. It front-loads the core action and scope, then adds the safety constraints in a compact and readable way. No redundant filler.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a destructive, three-parameter tool, the description conveys scope, safety guards, preconditions, and when and when not to invoke it. An output schema is present, so not describing the return format is acceptable. The agent has everything needed to safely choose and call this tool.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 0%, so the description must compensate for the bare parameter names. It explains confirm_doc_id's role as a guard requiring an exact match with doc_id, and it clarifies that the deletion acts on chunks of a single document within a collection. It does not elaborate on the collection parameter, but its meaning is recoverable from context and the param name.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

States a specific verb ('Deletes') and resource ('every chunk belonging to one source document from a collection'), and clearly distinguishes this from collection-level deletion. The phrase 'every chunk belonging to one source document' makes the tool's exact scope immediately obvious, and 'without touching the rest' removes ambiguity.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines5/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Explicitly tells the agent when to use the tool: only when the user has explicitly confirmed deletion. It also states when not to use it: in read-only mode, and when confirm_doc_id does not exactly match doc_id. This is strong usage guidance for a destructive operation.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

document_listA
Read-only

Lists ingested source documents in a collection, one entry per original file/text/URL (not per chunk). Use this to see what's already in a collection before ingesting more, or to find a doc_id to pass to document_delete or get_document.

NameRequiredDescriptionDefault
collectionYes

Output Schema

NameRequiredDescription
documentsYes
collectionYes

TDQS

A4.1/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and destructiveHint=false, so the safety profile is covered. The description adds a behavioral detail beyond annotations: the output is at source-document granularity rather than chunk granularity, which is important for interpreting results correctly.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two sentences, each adding distinct value: the first defines the tool's result and granularity, the second gives practical use cases. There is no filler and no redundant repetition of annotations or schema.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple one-parameter, read-only tool with an output schema, the description provides enough context: what is listed, what granularity, and when to call it. The only substantive gap is the collection parameter semantics; safety and output shape are already covered by annotations and the output schema.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The only required parameter, collection, has 0% schema description coverage, but the description only mentions it obliquely as 'in a collection.' It does not clarify whether the value should be a collection ID or name, how to format it, or how to find valid collections, so the description fails to compensate for the schema gap.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description starts with a specific verb and resource: 'Lists ingested source documents in a collection' and immediately clarifies the granularity as one entry per original file/text/URL, not per chunk. This makes it easy to distinguish from chunk-level tools and from collection-level tools.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description gives two concrete use cases: inspecting a collection before ingesting more and finding a doc_id for document_delete or get_document. It does not explicitly state when not to use the tool or contrast it with tools like collection_info or search, so it misses the explicit exclusion needed for a 5.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

estimateA
Read-only

Before ingesting, estimates how many chunks a file or directory will produce, the storage it will use, and the embedding API cost if a paid provider is configured. Use this to preview a large ingest before committing to it.

NameRequiredDescriptionDefault
pathYes

Output Schema

NameRequiredDescription
estimated_chunksYes
estimated_api_cost_usdYes
estimated_storage_bytesYes

TDQS

A4.4/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare this read-only and non-destructive, and the description adds useful behavioral context: it does not ingest content, it produces an estimate, and cost is only included if a paid provider is configured. This complements rather than contradicts the annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence that front-loads the purpose, lists the key outputs, mentions the cost dependency, and ends with a practical use case. Every clause is relevant and there is no filler.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With an output schema present, the description need not explain the return structure. It covers the what, when, and why of usage, and is complemented by read-only annotations. A small omission is whether directory paths are processed recursively, but this is minor for a preview/estimate tool.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The schema's only parameter is a bare 'path' with 0% schema description coverage. The description compensates by clarifying that the path refers to a file or directory, which resolves the main ambiguity. More detail about path format or resolution would help, but this is sufficient for a single-parameter tool.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The lead verb 'estimates' identifies a specific analysis action on a file or directory, and the description defines exactly what is estimated: chunk count, storage, and embedding cost. Framing it as 'Before ingesting' clearly distinguishes it from ingest_* siblings.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description explicitly states when to use the tool: 'before a large ingest, preview before committing.' It does not explicitly list exclusions or name alternatives, but the context is clear and actionable.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

expand_contextA
Read-only

Fetches the chunks immediately before and after a given result within the same document, for continuity. Use this when get_context's answer references a chunk that seems to be cut off mid-thought.

NameRequiredDescriptionDefault
doc_idYes
windowNo
collectionYes
chunk_indexYes

Output Schema

NameRequiredDescription
chunksYes

TDQS

A3.8/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and destructiveHint=false, so the description does not need to establish that this is a safe read operation. The description adds useful behavioral context about fetching neighboring chunks within the same document, but it does not disclose output shape, boundary behavior, or what happens for invalid chunk indexes.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is two sentences with no filler: the first sentence states what the tool does, and the second explains when to use it. It is front-loaded and every word contributes.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The description is adequate for a simple, read-only tool with an output schema and annotations, but it relies on the agent inferring parameter meaning from names. The missing documentation of 'window' and of how chunk_index is sourced from get_context leaves a noticeable gap.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the description must compensate, but it only indirectly covers doc_id/collection through 'same document' and chunk_index via 'given result.' The window parameter, which controls how many chunks are fetched, is never explained, and collection/chunk_index formats are left undefined.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description uses a specific verb and resource: 'Fetches the chunks immediately before and after a given result within the same document, for continuity.' It also distinguishes the tool from get_context by naming it and describing the exact situation it addresses, so an agent can tell them apart.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description gives an explicit trigger condition: 'Use this when get_context's answer references a chunk that seems to be cut off mid-thought.' This is clear context, but it does not state when not to use the tool or list other alternatives beyond get_context.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

find_similarA
Read-only

Finds points similar to a given point by ID, using Qdrant's native similarity API. Use this to explore 'more like this' starting from a specific chunk the user is looking at.

NameRequiredDescriptionDefault
limitNo
point_idYes
collectionYes

Output Schema

NameRequiredDescription
resultsYes

TDQS

A3.6/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare the tool as read-only and non-destructive. The description reinforces this with 'Finds' and mentions the native similarity API, but adds little new behavioral context beyond what annotations provide, such as pagination, limits behavior, or response characteristics.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is two sentences, front-loads the core action, and then gives the intended use case. Every part earn its place with no unnecessary detail.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The tool is simple, has a clear output schema, and annotations already cover safety. The description sufficiently explains why the agent would call it, though it may still wish for a bit more detail on required parameters given the 0% schema description coverage.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the description must compensate. It only clarifies the intent behind 'point_id' ('given point', 'specific chunk') but provides no explanation for 'collection' or 'limit', leaving those parameters underspecified for the agent.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description uses a specific verb and resource: 'Finds points similar to a given point by ID.' This makes the operation clear. However, it does not explicitly distinguish itself from the similarly vector-based sibling tools like 'recommend' or 'search' beyond the mention of point ID.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides clear usage context: 'Use this to explore more like this starting from a specific chunk the user is looking at.' This tells the agent when to select this tool, but it does not explicitly name alternatives or state when not to use it.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get_contextA
Read-only

The flagship retrieval tool: runs hybrid search, reranks, applies MMR for diversity, trims to a token budget, and returns a formatted context block with numbered citations — ready for the calling LLM to answer from directly. Prefer this over raw search_* tools whenever the goal is to answer a question, not just to inspect search results.

NameRequiredDescriptionDefault
queryYes
filtersNo
collectionYes
token_budgetNo

Output Schema

NameRequiredDescription
chunksYes
citationsYes
token_countYes
formatted_contextYes

TDQS

A4.6/5.0
Behavior5/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Even though readOnlyHint and destructiveHint already communicate safety, the description adds valuable behavioral detail beyond annotations: it performs hybrid search, reranks, applies MMR, enforces a token budget, and structures output for direct LLM answering.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is dense but efficient: the first sentence describes behavior and output, and the second provides actionable selection guidance. No filler is present.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Combined with the output schema and read-only annotations, the description gives the agent enough understanding of the tool's purpose, behavior, and usage context. There is little risk of selecting the wrong retrieval tool.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the description needed to compensate, but it only meaningfully explains the token budget and implicitly the query. Filters and collection are left to name inference, which is not enough for fully reliable invocations.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description names a concrete operation (hybrid retrieval with reranking and MMR) and a clear deliverable (a formatted context block with numbered citations), making it easy to distinguish get_context from the raw search_* siblings.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines5/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description explicitly says to prefer this tool over raw search_* tools when the goal is to answer a question rather than inspect search results, giving both a clear when and a clear when-not signal.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get_documentA
Read-only

Retrieves the full original source document behind a citation, or a specific page/section range of it. Use this when the user wants more context than a single cited chunk provides.

NameRequiredDescriptionDefault
doc_idYes
page_endNo
collectionYes
page_startNo

Output Schema

NameRequiredDescription
doc_idYes
contentYes
source_pathYes
source_typeYes

TDQS

A4/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and destructiveHint=false, so the safety profile is known. The description goes beyond the input schema by clarifying the behavior of retrieving both the full document and partial page/section ranges, setting expectations about scope and output. It does not contradict the annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two sentences carry complete functional intent with no redundancy. The main retrieval behavior is front-loaded, and the usage context is at the end, making it easy to scan and process.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The tool has an output schema, so return values do not need to be explained. However, with an input schema that has zero property descriptions, the tool description does not fully compensate: it does not clarify what 'collection' refers to or how the agent obtains a valid doc_id. For a simple retrieval tool with read-only annotations this is acceptable but still leaves a clear gap.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so all parameter meaning should come from the description. It does explain the page_start/page_end semantics through 'page/section range,' but it leaves collection and doc_id entirely intuitive, with no explanation of how they relate to a citation or where the necessary values come from. This is inadequate with four parameters.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states a precise verb ('Retrieves'), a clear resource ('full original source document behind a citation', or a page/section range), and frames the tool in relation to citation context. This makes it easy for an agent to tell it apart from sibling retrieval tools like get_context or expand_context.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description explicitly says when to use it: 'when the user wants more context than a single cited chunk provides.' It does not explicitly name an alternative tool or describe when not to use it, but the referenced use case gives solid guidance without requiring further inference.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

healthA
Read-only

Reports Qdrant connectivity, which embedding model is loaded, the reranker's live status, server version, and the active transport. Use this first when something seems broken, or to confirm the server is reachable and correctly configured.

NameRequiredDescriptionDefault

No parameters

Output Schema

NameRequiredDescription
versionYes
transportYes
embedding_modelYes
reranker_statusYes
qdrant_connectedYes

TDQS

A4.5/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The description adds behavioral context beyond the read-only/destructive annotations by explaining that this is a diagnostics-only tool reporting status and configuration states. It does not state any side effects or requirements, but with readOnlyHint=true and no parameters, nothing more is strictly necessary.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is compact, front-loaded with the tool's purpose, and wastes no words. The first sentence enumerates specific status items, and the second sentence gives a clean usage directive.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a zero-parameter read-only health check with a provided output schema, the description provides everything needed: the exact data points reported and the situations in which to call it. No important context is missing.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The tool has zero parameters, so there is no schema burden at all. The description does not need to explain parameter semantics, and the baseline for zero-parameter tools is appropriately met.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states a specific verb ('Reports') and defines the resource scope: Qdrant connectivity, embedding model, reranker status, server version, and active transport. This makes it clear what the tool does and how it differs from other health-adjacent tools in the sibling list.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description explicitly says when to use the tool: first when something seems broken, or to confirm the server is reachable and correctly configured. It does not explicitly name alternatives or exclusion conditions, but the usage context is clear enough for an agent.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

ingest_directoryA

Recursively ingests every supported file under a local directory, with optional glob include/exclude patterns, as a background-trackable job. Use this for bulk ingestion of a folder; poll job_status for progress.

NameRequiredDescriptionDefault
pathYes
collectionYes
exclude_globNo
include_globNo

Output Schema

NameRequiredDescription
job_idYes
statusYes
collectionYes

TDQS

A4.2/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations only indicate readOnly=false and destructive=false, so the description carries the behavioral burden. It adds useful context by stating that ingestion is a background-trackable job and that progress should be polled via job_status, which is not visible from the annotations or schema alone. It does not detail duplicate handling or error cases, but it covers the key async behavior.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is two sentences and contains no filler. The core operation is front-loaded, and the follow-up guidance about polling job_status is placed at the end. Every sentence either clarifies behavior or directs the agent to the correct follow-up tool.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For this tool's complexity, the description gives enough to confidently invoke it: it identifies the target resource, optional filters, and the asynchronous tracking mechanism. An output schema exists, so return-value details need not be explained. The only notable gap is that 'collection' is a required parameter and receives no explanation beyond its name.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The schema has no descriptions for parameters; the description partially compensates by mentioning local directory, optional glob include/exclude patterns, and bulk ingestion. However, it does not explain the semantics of the required 'collection' parameter beyond the tool's general intent, and it does not specify glob syntax. It adds value but does not fully compensate for the 0% schema description coverage.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states a specific verb ('recursively ingests'), a concrete resource ('every supported file under a local directory'), and a clear distinguishing scope: bulk directory ingestion. Given sibling tools like ingest_text, ingest_file, and ingest_url, this description makes the directory-based focus immediately obvious.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description explicitly tells the agent when to use it: 'Use this for bulk ingestion of a folder; poll job_status for progress.' This provides a clear usage context. It does not explicitly name or exclude the sibling ingest tools, but the bulk-vs-single distinction is strongly implied.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

ingest_fileA

Ingests a single local file (PDF, DOCX, XLSX, PPTX, MD, HTML, CSV, or TXT) into a collection, with format-specific quality processing. Use this for one file at a time; use ingest_directory for a whole folder.

NameRequiredDescriptionDefault
pathYes
collectionYes

Output Schema

NameRequiredDescription
doc_idYes
collectionYes
source_pathYes
chunks_createdYes
discard_reasonsYes
pages_discardedYes
duplicates_foundYes

TDQS

A4/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The annotations already signal that this is a write operation that is not destructive. The description adds that ingestion involves format-specific quality processing, but it does not explain what this processing does, whether the collection must already exist, or whether an existing document is replaced or duplicated. The added context is modest rather than rich.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two tight, front-loaded sentences: the main action and supported formats come first, and the single-file restriction is placed before the alternative tool. No redundant or filler wording is present.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The core information for calling the tool is present: file type scope, one-file usage, and the destination collection. The output schema covers return expectations. It would be even better if it specified file path constraints, collection preconditions, or the nature of the quality processing, but the definition is not missing the critical invocation information.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

With 0% schema coverage, the description needs to define the parameters. It implicitly maps 'path' to a local file path and 'collection' to the destination collection, which helps, but it omits operational details such as whether the path must be absolute, whether the collection must exist, or how collection names are specified.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Clearly states the verb 'ingests' and the exact resource: a single local file from an explicit list of formats into a collection. The scope is narrowed to one-at-a-time ingestion, which also differentiates it from ingest_directory even though other sibling ingest tools are not named.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Gives an explicit usage boundary: 'Use this for one file at a time' and names the folder-level alternative ingest_directory. It does not explicitly mention ingest_text or ingest_url as alternatives for non-file inputs, but the enumerated file formats plus 'local file' make the intended use reasonably clear.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

ingest_textA

Ingests a piece of raw text directly, with optional metadata, without needing a source file. Use this for notes, pasted content, or anything the user dictates in chat rather than pointing at a file — the 'semantic memory' use case, done properly.

NameRequiredDescriptionDefault
textYes
metadataNo
collectionYes
source_labelNo

Output Schema

NameRequiredDescription
doc_idYes
collectionYes
chunks_createdYes

TDQS

A3.9/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The description accurately characterizes a writing, non-destructive ingestion and adds behavioral context: raw text goes into the semantic memory path, no source file is required, and metadata is optional. ReadOnlyHint=false and destructiveHint=false are respected, with no contradiction. It could disclose what happens if the target collection does not exist, but the annotations already cover the basic safety profile.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is short, front-loaded, and easy to scan. The only minor waste is the conceptual repetition of not needing a source file and 'rather than pointing at a file' in the same sentence, which makes it slightly less lean than it could be.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

It is complete enough for a fairly simple ingestion task, especially because the tool appears in a family of related tools and has an output schema. However, it lacks guidance about collection preconditions and the 'source_label' parameter, which leaves an agent to guess a necessary part of the request when it is not optional and another when it is.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the description must compensate entirely for parameter meaning, but it only mentions raw text and optional metadata. The required 'collection' parameter is not explained (e.g., must it already exist?), and 'source_label' receives no semantic explanation at all. This is a real gap for a tool with 4 parameters.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly identifies the action: ingesting raw text directly with optional metadata, and distinguishes itself from file-based ingestion by emphasizing 'without needing a source file.' It also names the key use case ('semantic memory') so an agent can separate it from sibling ingest tools without inspecting schemas.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

It explicitly tells the agent when to use it — for notes, pasted content, or text dictated in chat — and contrasts it with pointing at a file. It does not name the sibling tools that handle files, but the line 'rather than pointing at a file' sufficiently routes the agent toward ingest_file or ingest_directory as alternatives.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

ingest_urlA

Fetches a web page and ingests its main content, stripped of navigation/cookie-banners/footers. Use this for documentation pages, articles, or any URL-addressable content the user wants in the RAG.

NameRequiredDescriptionDefault
urlYes
collectionYes

Output Schema

NameRequiredDescription
doc_idYes
collectionYes
source_pathYes
chunks_createdYes

TDQS

A4/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The description adds useful behavioral context beyond annotations: the tool makes an external network fetch and 'strips navigation/cookie-banners/footers' from the ingest content. Annotations only indicate it is not read-only and not destructive, so this extra detail about enrichment behavior is valuable. It doesn't mention potential network limits or external-access caveats, but what is disclosed is accurate.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is concise: two sentences front-load the primary capability, then immediately follow with concrete use cases. No extra filler or redundant restatements of the tool name.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a two-parameter tool, the description is mostly complete, and the output schema covers return-value details. However, the 'collection' parameter is never explained, which is a real completeness gap since collection is required. The behavioral caveats about fetching external URLs are also minimal, but the simplicity of the tool keeps this from being a worse score.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0% for the two required parameters, so the description needed to compensate. It explains url semantically via 'Fetches a web page' but never explains the collection parameter—what it refers to, its format, or how it's related to the RAG. This leaves a required argument underdefined.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states a specific action (fetches a web page), resource (URL-addressable content), and outcome (ingests main content into the RAG). It also effectively distinguishes itself from sibling tools like ingest_text, ingest_file, and ingest_directory by focusing exclusively on URL sources.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description gives clear applicability: 'Use this for documentation pages, articles, or any URL-addressable content the user wants in the RAG.' It doesn't explicitly name alternatives or exclusions, like 'prefer ingest_file for local files', but the URL-addressable scope makes the appropriate use case clear.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

job_statusA
Read-only

Checks the progress of a background ingestion job started by ingest_directory. Use this to poll a long-running bulk ingest rather than assuming it finished — a job is only 'completed' once its processed/failed counters reconcile with what was expected.

NameRequiredDescriptionDefault
job_idYes

Output Schema

NameRequiredDescription
failedYes
job_idYes
statusYes
skippedYes
expectedYes
processedYes

TDQS

A4.3/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and destructiveHint=false, so the safety profile is covered. The description adds meaningful behavioral context beyond annotations: this is a polling operation, and 'completed' only means counters reconcile with expectations. That is valuable for an agent deciding when to stop polling.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two sentences, no wasted words. The core purpose is front-loaded, and the second sentence adds essential polling behavior without redundancy.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given a single parameter, read-only annotations, and an existing output schema, this description is complete for an agent to call the tool. It explains the polling use case and the definition of completion, leaving no critical gap.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The schema offers no description for job_id, so the description carries the burden. It establishes that job_id refers to a background ingestion job started by ingest_directory, which is useful, but it does not explicitly say how to obtain or format the ID. It is adequate for a single obvious parameter but not fully explicit.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states a specific verb ('checks') and resource ('progress of a background ingestion job started by ingest_directory'). This clearly identifies what the tool does and naturally distinguishes it from ingestion and search siblings.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description explicitly says to use this for polling a long-running bulk ingest rather than assuming completion, and explains the completion condition. It does not list explicit alternative tools, but the 'started by ingest_directory' framing gives clear contextual guidance.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

payload_index_createA

Creates a payload index on a collection field so it can be used as a fast search filter (e.g. date, author, type). Use this when the wizard's filter question or a user request names a field that needs to be filterable.

NameRequiredDescriptionDefault
fieldYes
collectionYes
field_typeYes

Output Schema

NameRequiredDescription
fieldYes
createdYes
collectionYes
field_typeYes

TDQS

A3.8/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The annotations already communicate non-read-only and non-destructive behavior. The description additionally clarifies that creating an index enables fast filtering, but it does not disclose what happens if the index already exists or whether this affects existing data. This is adequate but not rich.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is two sentences, front-loads the core action, includes examples, and adds a practical usage condition. There is no fluff or repetition of schema details.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The tool is a moderately simple three-parameter mutation and the description conveys its purpose and why to use it. However, because schema description coverage is 0%, the description should have provided more direct guidance on the value domains and how to populate the parameters correctly.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the description carries the burden of explaining the parameters. It broadly refers to a field such as date, author, or type, but it does not explain the exact meaning of collection, how field_type should be chosen, or how the parameter values relate to each other.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states a specific verb and resource: 'Creates a payload index on a collection field' and gives the intended purpose ('fast search filter'). It does not just restate the tool name and it is clearly distinguished from collection creation and search tools.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description gives an explicit trigger: use this when the wizard's filter question or a user request names a field that needs to be filterable. It provides clear context, though it does not explicitly say when not to use it or name an alternative tool.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

profile_listA
Read-only

Lists saved configuration profiles (e.g. demo, work, project X). Use this to see what profiles already exist before creating a new one or switching.

NameRequiredDescriptionDefault

No parameters

Output Schema

NameRequiredDescription
profilesYes

TDQS

A4.3/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and destructiveHint=false, so the description does not need to restate safety. It adds contextual value about saved profiles but discloses no extra behavioral traits such as rate limits or ordering. The description does not contradict the annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two short, focused sentences. The main action is front-loaded, examples are included for clarity, and there is no redundant filler.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The tool is a simple list with no parameters and the output schema is already available, so the description fully covers what an agent needs: why to call it, what it returns, and when to use it.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The tool has zero parameters and no schema properties. With 0 params the baseline is 4; the description reinforces that the tool lists existing profiles but adds no specific parameter details, which is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description uses a specific verb and resource combination: "Lists saved configuration profiles," and adds concrete examples (demo, work, project X). It distinguishes itself from switching tools by stating its role as discovering what exists before creating or switching, which separates it from the sibling profile_use.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description explicitly says to use it before creating a new profile or switching profiles. This provides clear context, though it does not name the alternative tool (e.g., profile_use) by name, so it gets a 4 rather than a 5.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

profile_useA

Activates a saved profile, switching which collection and embedding configuration subsequent tool calls use. Use this to switch between separate RAG setups, e.g. from 'demo' to 'work'.

NameRequiredDescriptionDefault
nameYes

Output Schema

NameRequiredDescription
nameYes
activatedYes

TDQS

A4.1/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The description adds useful behavioral context beyond the annotations: this is a stateful action that changes which collection and embedding configuration all subsequent tool calls will use. It does not contradict readOnlyHint=false or destructiveHint=false. It could disclose more about failures (e.g., unknown profile name) or reversibility, but the core behavior is clearly conveyed.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is two sentences with no filler. The primary behavior is front-loaded, and the example follows naturally to clarify intended use.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a one-parameter, stateful switching tool, this description is complete enough. It explains the effect, the use case, and provides an example; with an output schema present, no return-style documentation is needed.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the description must compensate. It implies the single `name` parameter is the identifier of a saved profile and provides real examples like 'demo' and 'work'. However, it never explicitly maps `name` to the parameter or states constraints such as whether the profile must pre-exist.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description uses a specific verb and resource: it activates a saved profile and explains the effect is switching the active collection and embedding configuration for subsequent tool calls. It is clearly distinct from listing profiles or creating collections, though it does not explicitly name a sibling it should be distinguished from.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

It clearly tells the user when to use it: to switch between separate RAG setups, with a concrete 'demo' to 'work' example. It does not state when not to use it or name alternatives, but the intended usage context is unambiguous.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

recommendA
Read-only

Recommends points using positive and negative example point IDs, via Qdrant's native recommendation API. Use this when the user can point at examples of what they want more or less of, rather than phrasing a text query.

NameRequiredDescriptionDefault
limitNo
negativeNo
positiveYes
collectionYes

Output Schema

NameRequiredDescription
resultsYes

TDQS

A3.9/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate a safe read-only and non-destructive operation, so the description does not need to restate that. It usefully adds that the tool invokes Qdrant's native recommendation API and explains the positive/negative example semantics. More behavioral detail such as pagination or ordering is not described, but that is acceptable given the annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is only two sentences: one states exactly what the tool does, and the second provides the main selection condition for when to use it. It is lean and front-loaded, with only a slight redundancy between 'recommends points' and 'point at examples'.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a 4-parameter read-only tool with an output schema and safe annotations, the description provides sufficient context: it names the mechanism, the expected input style, and the core positive/negative semantics. It stops short of exhaustively covering edge cases or alternative sibling routing, but the main operating context is fully represented.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the description has to carry meaning for the parameters. It gives good semantics for 'positive' as examples of what the user wants more of and 'negative' as what they want less of, and it establishes that these are point IDs. However, it does not explain the 'limit' or the 'collection' parameter, relying on the schema titles and defaults for those.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool Recommends points using positive and negative example point IDs via Qdrant's native recommendation API. It distinguishes this from text-query search by explicitly noting the trigger intent is pointing at examples, not phrasing a query.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description gives a clear when-to-use condition: 'Use this when the user can point at examples of what they want more or less of.' It also implies when not to use it by saying 'rather than phrasing a text query', but it does not name sibling alternatives explicitly.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

search_hybridA
Read-only

Dense + sparse hybrid search with native RRF fusion — the recommended default search tool for most queries, since it handles both semantic meaning and exact keyword/ID matches well.

NameRequiredDescriptionDefault
limitNo
queryYes
filtersNo
collectionYes

Output Schema

NameRequiredDescription
resultsYes

TDQS

A3.8/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already establish this as a read-only, non-destructive operation. The description adds useful ranking behavior context, such as RRF fusion and support for semantic plus exact/ID matches, but does not mention pagination, result behavior, or how filters interact with the search.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

One focused, front-loaded sentence communicates the core algorithm, the tool's default status, and the key use case. Every phrase earns its place with no repetition or filler.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a read-only tool with an output schema, the description captures purpose, algorithm, and default routing—enough for a basic invocation. However, with many search siblings and unclear param semantics, the description is not fully complete for choosing between search, rerank, multi-query, or find_similar in edge cases.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, and the description does not explain 'collection', 'filters', or 'limit' semantics. It indirectly clarifies that 'query' is interpreted both semantically and as exact keyword/ID matches, which is useful but not enough to fully compensate for the 4 undocumented parameters.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly names the operation ('search'), the mechanism ('Dense + sparse hybrid search with native RRF fusion'), and positions it as the recommended default search tool. This distinguishes it from sibling search tools even without naming them.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description gives clear usage context: use it as the default for most queries because it covers both semantic and exact keyword/ID matching. It does not explicitly spell out when not to use it or which alternative to pick, so it stops short of a 5.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

search_multi_queryA
Read-only

Runs several query reformulations (supplied by the calling LLM) and fuses their hybrid results into one ranking. Use this when a single query phrasing might miss relevant chunks — e.g. ambiguous or broad questions.

NameRequiredDescriptionDefault
limitNo
filtersNo
queriesYes
collectionYes

Output Schema

NameRequiredDescription
resultsYes

TDQS

A4.1/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The annotations already declare readOnlyHint=true and destructiveHint=false, and the description adds meaningful behavioral nuance: the caller supplies the reformulations, several queries are executed, and hybrid results are fused into a single ranking. This goes beyond purely restating the operation.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two sentences with no filler. The first sentence states how it behaves, the second gives a concrete use case with examples. Everything earned its place.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With an output schema present, read-only annotations, and the core parameter (queries) explained, the description is mostly complete for an agent deciding to invoke it. The main gap is around filters and how they interact with the multiple query variants, but the overall tool usage is understandable.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the description carries the burden of explaining parameters. It usefully clarifies the 'queries' parameter as LLM-supplied reformulations and shows a combined result, but it does not explain 'collection', 'limit' scope, or 'filters'/format semantics or how filters apply across multiple queries at any extension.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states a specific operation: run multiple query reformulations and fuse their hybrid results into one ranking. This clearly differentiates it from single-query sibling tools like search and search_hybrid.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Explicitly gives a selection rationale: 'Use this when a single query phrasing might miss relevant chunks — e.g. ambiguous or broad questions.' It lacks an explicit list of when-not-to-use or naming of alternative tools, so it does not reach the full 5.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

search_rerankA
Read-only

Hybrid search followed by cross-encoder reranking over the top results, for maximum precision at the cost of extra latency. Use this when result quality matters more than speed, e.g. for a final answer rather than an exploratory search.

NameRequiredDescriptionDefault
limitNo
queryYes
filtersNo
collectionYes
rerank_top_nNo

Output Schema

NameRequiredDescription
resultsYes

TDQS

A4.3/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already establish that this is read-only and non-destructive, so the description does not need to restate that. It adds useful behavioral context by naming the pipeline two stages and a key price/latency. This goes beyond the structured annotations and helps an agent understand operational trade-offs.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is concise: two sentences, no filler, no repetition of schema or annotations. The mechanism is described first, then the usage policy, so the most identifying information is front-loaded.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a read-only search tool with an output schema, this is mostly complete: the agent knows what happens and when to use it, and the output returns is already covered by the schema. It loses a point because the description does not clarify the precise meanings of several parameters, meaning an agent might still guess on limit versus rerank_top_n.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the description is expected to compensate for the parameter semantics. It only gives a general sense of 'top results', which loosely hints at the role of limit and rerank_top_n, but does not clarify how filters, collection, limit, or rerank_top_n individually behave. The meaning of rerank_top_n, in particular, remains ambiguous.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states a specific operation: hybrid search followed by cross-encoder reranking. It also communicates the value proposition, maximum precision at extra latency, making it easy to distinguish from sibling tools.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines5/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description explicitly provides an when-to-use rule: use it when result quality matters more than speed. It also gives a counterexample ('exploratory search') to discourage misuse, making the selection criteria clear even without naming specific alternatives.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

setup_answerA
Read-only

Records the user's answer to the current wizard question, validates it live (e.g. can Qdrant be reached, does an API key work), and returns either the next question or a null next step once all 8 questions are answered.

NameRequiredDescriptionDefault
answerYes
session_idYes

Output Schema

NameRequiredDescription
progressYes
validationYes
next_questionYes

TDQS

A3.5/5.0
Behavior1/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotation contradiction: the description says 'Records the user's answer' which indicates a write/side-effect, while annotations declare readOnlyHint=true. That creates direct conflicting signals about whether this tool mutates session or wizard state. The description also shares validation behavior and returning a next step, but the contradiction dominates.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two concise sentences front-load the core action and return behavior while giving relevant validation examples. No filler or redundant restating of the tool name or schema.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Describes the flow (record, validate, return next question/null), mentions the 8-question limit, and indicates failure conditions via live validation. Because there is an output schema, return types need not be fully spelled out; a small gap is the missing detail on error behavior when riddances validation fails.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%. The description adds meaning only for one parameter: 'answer' picks the answer for the current wizard question. It does not explain session_id at all, its structure, or how it controls the wizard state. The description does not compensate for the total lack of schema descriptions.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Describes a specific action (records the user's answer), a clear resource (the current wizard question), and the follow-up behavior (returns next question or null after all 8). This distinguishes it from sibling setup tools like setup_start or setup_apply, even without naming them.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description clearly scopes use to an interactive 8-question wizard: call it when the user answers the current question, validate, then continue until the final answer is reached. It does not explicitly compare against alternatives like setup_start or setup_apply, so no exclusions are given.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

setup_applyA

Executes the fully agreed wizard plan: creates the collection, indexes, and profile, ingests one example document, and runs a smoke-test search. Use this only after setup_answer has returned all 8 questions answered — never before the session is complete.

NameRequiredDescriptionDefault
session_idYes

Output Schema

NameRequiredDescription
reportYes
collectionYes
smoke_testYes
profile_nameYes
indexes_createdYes
example_doc_ingestedYes

TDQS

A4.4/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The description discloses the exact mutation surface: creating resources, ingesting a document, and running a smoke-test search, which aligns with readOnlyHint=false and destructiveHint=false. It does not state behavior on rerun or failure (e.g., whether resources already exist), but for a created resources this is a minor gap rather than a contradiction.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two sentences with no filler: the first lists the action plan, the second gives an unambiguous usage precondition. Every clause contributes to correct invocation, and the description is front-loaded with the operational effect.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With an output schema present, the description doesn't need to explain return values, and it already covers what the plan does and when to run it. It could be more explicit about what identifies the session in parameters, but the description provides the key context an agent needs to avoid mis-use.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 0%, so the description must compensate, but it never explicitly documents the 'session_id' parameter semantics. However, the mention of 'setup_answer' and 'session is complete' strongly implies session_id identifies the in-progress setup wizard, providing enough inference for a single self-descriptive parameter.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states a specific verb ('Executes'), a specific resource ('fully agreed wizard plan'), and enumerates the concrete side effects: creates collection, indexes, profile, ingests an example document, and runs a smoke-test search. This clearly distinguishes setup_apply from sibling tools like setup_start and setup_answer by positioning it as the final plan-execution step.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines5/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description gives explicit conditional usage: 'Use this only after setup_answer has returned all 8 questions answered — never before the session is complete.' It names the prerequisite sibling and provides an exclusion condition, leaving no ambiguity about when the tool should be called.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

setup_startA
Read-only

Starts a new conversational setup session and returns the first question, with options and a recommended default. Use this once, at the very beginning of guiding a user through configuring a new RAG — never mid-conversation once a session is already in progress.

NameRequiredDescriptionDefault

No parameters

Output Schema

NameRequiredDescription
questionYes
session_idYes

TDQS

A4.7/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already communicate readOnlyHint=true and destructiveHint=false, so the safety burden is minimal. The description adds useful behavioral context: it is a one-time opener, returns the first question rather than an answer, and implies that later steps go through sibling tools. There is no contradiction with annotations because the 'session' is conversational, not a persistent data write.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two sentences with no wasted words. The first sentence delivers the core action and return value; the second provides the placement rule. The most decision-relevant information is fully front-loaded.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a zero-parameter tool with an output schema and non-destructive annotations, the description is complete. It captures purpose, result, and sequencing constraints; nothing needed to call this tool correctly is missing.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema declares no parameters, so there is nothing for the description to add at the parameter level. The zero-parameter baseline of 4 applies, and the description correctly focuses on behavior instead.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states it 'Starts a new conversational setup session' and specifies the concrete return value: 'the first question, with options and a recommended default.' This clearly disambiguates it from later-step siblings like setup_answer and setup_apply.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines5/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Usage is explicitly scoped: 'Use this once, at the very beginning' and a strong when-not condition: 'never mid-conversation once a session is already in progress.' The agent knows exactly when this tool belongs in the flow.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

snapshot_createA

Creates a point-in-time backup (snapshot) of a collection. Use this before a risky operation (bulk re-ingest, schema change) or on a routine backup cadence.

NameRequiredDescriptionDefault
collectionYes

Output Schema

NameRequiredDescription
collectionYes
created_atYes
snapshot_nameYes

TDQS

A3.9/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate the operation is not read-only and not destructive, and the description adds the useful context that the operation creates a safe point-in-time state. However, it does not disclose additional behaviors beyond the annotations, such as storage implications, performance impact, or whether the snapshot is immediate.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two sentences: the first clearly defines the operation, and the second provides actionable context. There is no filler or redundancy.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple one-parameter tool with an output schema, the description is largely complete: it names the operation, target, and typical scenarios. It does not mention how to later restore a snapshot or whether the snapshot id is returned, but those are covered by snapshot_restore and the output schema respectively.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

There is one required parameter, collection, with 0% schema description coverage, so the description should compensate with parameter guidance. The description only says the snapshot is 'of a collection', which adds almost nothing beyond the parameter name itself.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states the exact operation (creates a point-in-time backup/snapshot) and the target resource (collection). It is clearly distinguishable from the related sibling snapshot_restore because it explicitly describes creation rather than restoration.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description gives explicit when-to-use guidance: before risky operations like bulk re-ingest or schema changes, or as part of routine backup cadence. It does not state when not to use the tool or list alternative snapshot-related tools, which keeps it just shy of a 5.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

snapshot_restoreA
Destructive

Restores a collection from a previously created snapshot, overwriting its current contents. Destructive — requires confirm_name to exactly match collection, and is blocked in read-only mode. Use only when the user has explicitly confirmed the overwrite.

NameRequiredDescriptionDefault
collectionYes
confirm_nameYes
snapshot_nameYes

Output Schema

NameRequiredDescription
restoredYes
collectionYes
snapshot_nameYes

TDQS

A4.7/5.0
Behavior5/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The annotations already mark the tool as destructive and non-read-only, but the description adds valuable safety behavior: overwriting current contents, requiring an exact confirm_name match, being blocked in read-only mode, and requiring explicit user confirmation. This is strong behavioral disclosure beyond annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Three crisp sentences with no filler. The destructive warning and confirmation condition are foregrounded, and each sentence adds meaningful information.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With an output schema available and annotations covering read-only and destructive hints, the description supplies the remaining operational context: overwrite behavior, confirmation requirement, and read-only blocking. An agent has enough to invoke this safely.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the description must carry the parameter semantics burden. It explains confirm_name's exact-match requirement and the collection target, and snapshot_name is implied as the previously created snapshot. All three required parameters are inferable, though not formally parameter-by-parameter documented.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Clearly states the action: restore a collection from a previously created snapshot and overwrite current contents. It is distinct from snapshot_create and collection_delete based on this description alone.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

States a clear guardrail: only use when the user has explicitly confirmed the overwrite. It also says read-only mode blocks the operation. It does not name contrasting use cases such as when snapshot_create or collection_delete would be more appropriate, so it falls just short of full explicit alternative guidance.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

statsA
Read-only

Reports usage stats across all collections (or one, if named): point counts, document counts, disk size, and distribution by source type. Use this to answer 'how much do I have in my RAG' style questions.

NameRequiredDescriptionDefault
collectionNo

Output Schema

NameRequiredDescription
collectionsYes

TDQS

A4.5/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already establish readOnlyHint=true and destructiveHint=false, so the safety profile is covered. The description adds meaningful behavioral context beyond that: it is an aggregate reporting operation, scoped to all or one collection, and lists what the stats include. No unexpected side effects or hidden mutation behavior are implied.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is two tight sentences: the first gives scope, behavior, and outputs; the second gives the canonical use case. There is no filler, repetition, or unnecessary detail.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool is simple (one optional parameter), read-only, and has an output schema, the description is complete enough for an agent to select and invoke it correctly. It covers the scoping behavior, the metrics, and the intended question type; no additional context is missing.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema only describes 'collection' as string/null with a default of null and provides no property description. The description compensates by supplying the essential semantics: omit it to get stats across all collections, or name one to restrict to a single collection. It leaves out name-format details, but for a single optional string parameter this is sufficient.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description uses a specific verb ('reports') and resource ('usage stats across all collections'), lists concrete outputs (point counts, document counts, disk size, distribution by source type), and notes the optional single-collection scope. This clearly differentiates it from sibling tools like collection_list or collection_info, which are about listing or inspecting collections rather than aggregating usage.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description gives a clear, actionable use case: answer 'how much do I have in my RAG' style questions. It also clarifies the all-versus-one-collection behavior for the optional parameter. However, it does not explicitly mention when not to use it or name alternative tools for related needs.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Tool Schema Changelog

Recent tool additions, removals, and schema changes observed during successful MCP inspections.

  1. 33 tool updatesv0.1.0
    • First observedalias_set
    • First observedcollection_create
    • First observedcollection_delete
    • First observedcollection_info
    • First observedcollection_list
    • First observedconfig_get
    • First observeddocument_delete
    • First observeddocument_list
    • First observedestimate
    • First observedexpand_context
    • First observedfind_similar
    • First observedget_context
    • First observedget_document
    • First observedhealth
    • First observedingest_directory
    • First observedingest_file
    • First observedingest_text
    • First observedingest_url
    • First observedjob_status
    • First observedpayload_index_create
    • First observedprofile_list
    • First observedprofile_use
    • First observedrecommend
    • First observedsearch
    • First observedsearch_hybrid
    • First observedsearch_multi_query
    • First observedsearch_rerank
    • First observedsetup_answer
    • First observedsetup_apply
    • First observedsetup_start
    • First observedsnapshot_create
    • First observedsnapshot_restore
    • First observedstats

TDQS

A3.7/5.0

Scored across 33 tools

Disambiguation4/5

Most tools have clearly distinct roles, and the descriptions carefully separate collection lifecycle, ingestion, retrieval, and setup wizard operations. The search family is the main risk area: search, search_hybrid, search_rerank, search_multi_query, and get_context all overlap semantically, though their descriptions are precise enough to disambiguate with careful reading.

Naming Consistency3/5

The server uses readable lowercase snake_case throughout, but there is no single naming convention: object-first names like collection_list and document_list coexist with verb-first names like get_context and ingest_text, plus bare nouns such as health, stats, and job_status. Subfamilies are internally consistent, but the overall pattern is mixed.

Tool Count2/5

33 tools for a RAG build server is well past the 25+ 'too many' threshold. The tool count is inflated by an 8-tool search/retrieval family plus a setup wizard, profile system, and collection management layer, making the surface feel heavier than the core RAG job really requires.

Completeness4/5

The server covers the RAG lifecycle well: collection creation, ingestion from multiple sources, document management, snapshots, search, context assembly, setup wizardry, profiles, and health/stats. Minor gaps like no alias_delete or payload_index_delete are awkward but can be worked around without dead-ending an agent.

Maintenance

ActivityMaintained
ResponsivenessSyncing

Related MCP Connectors

Related MCP Servers

  • A
    license
    Not graded
    quality
    D
    maintenance
    Enables RAG (Retrieval-Augmented Generation) capabilities with document processing, vector storage, and intelligent Q\&A using OpenAI embeddings and semantic search.
    MIT
  • A
    license
    Not graded
    quality
    D
    maintenance
    Automated RAG pipeline optimization and serving. It interviews users, builds and evaluates candidate configurations on their data, and registers the best ones as a fleet queryable via MCP.
    MIT