weekly-verify
위클리-검증 (weekly-verify-mcp)
El informe de trabajo semanal redactado (.docx) se contrasta con los datos originales (.xlsx) para encontrar valores incorrectos · elementos faltantes · descripciones que contradicen los datos y devolverlos a la persona. Es un servidor MCP personal.
No corrige. Solo señala. La corrección la hace la persona.
El diseño completo está en docs/검증프로세스.md.
Estado actual — P0~P5 completados · registrado en Codex
Etapa | Contenido | Estado |
P0 | Esqueleto + conjunto de datos contaminados | ✅ |
P1 | Calificador ( | ✅ |
P2 | Parser de datos originales + motor de 5 tipos de juicio + omisión L3 | ✅ |
P3 | Extracción de afirmaciones + contraste de valores (L1·L2) + contradicción de descripción (L4) | ✅ |
P4 | Envoltorio de 10 herramientas MCP + smoke | ✅ |
P5 | Registro en Codex + verificación de arranque | ✅ |
Related MCP server: phionyx-pipeline-mcp
4 capas de verificación
Todo el diseño de esta herramienta surge de esta tabla.
Capa | Pregunta | Juicio | Severidad |
L1 Existencia | ¿Este valor existe en el original? | Código |
|
L2 Coherencia | ¿Coincide con ese campo de esa tarea? | Código |
|
L3 Omisión | ¿Falta un juicio que debería aparecer según el original? | Código |
|
L4 Interpretación | El valor es correcto pero la descripción contradice | Persona |
|
Solo con L1 no basta. Si se traslada el valor de
L-18a la fila deL-19, ambos valores existen en el original, por lo que L1 pasa. Solo L2, que verifica también el código de tarea, lo detecta.L3 es la razón de existir de esta herramienta. Lo que la gente suele equivocar en el informe semanal no son los números, sino los elementos que no escribió. Un número equivocado salta a la vista, pero una fila que falta no se ve.
L4 estructuralmente no puede ser
error.harness.Findinglo impone ytests/test_harness.pylo bloquea. Si se da poder de bloqueo a una comprobación de la que no se está seguro, los informes normales quedan bloqueados y la persona acaba apagando el verificador.
6 tipos de puerta
Lo que evals/weekly-verify.yaml exige al motor. Se califica con uv run python scripts/run_eval.py.
ID | Requisito | Bloqueo |
G1 Tasa de detección | No dejar pasar ni una contaminación de grado error de C01~C07 | ✅ |
G2 Falso positivo | No emitir error en el informe normal (C10) | ✅ |
G3 Severidad | No emitir error en C08·C09 | ✅ |
G4 Velocidad | Un informe en menos de 60 segundos | ✅ |
G5 Evidencia | Todo error completa las coordenadas obligatorias por capa | ✅ |
G6 Precisión de capa | Clasificar las observaciones encontradas en la capa correcta | ⬜ Solo observación |
El requisito de coordenadas difiere por capa (G5)
Capa | Ubicación en informe | Ubicación en original | Razón |
L1 | ✅ | — | Es un valor que no existe en el original, no hay celda que señalar |
L2 | ✅ | ✅ | Existe en ambos lados |
L3 | — | ✅ | Es un elemento que no está en el informe, no hay ubicación que señalar |
L4 | ✅ | — |
Si se rellenan a la fuerza coordenadas que no se pueden completar, la persona abrirá un lugar equivocado y creerá que lo ha verificado.
N/A no es un aprobado
Las puertas del tipo "no hagas cosas malas" (G2·G3·G5) se satisfacen solas si el motor no produce nada. Si se registran como PASS, un motor sin ninguna funcionalidad parecería haber aprobado 5 de 6. Por eso, cuando no hay base para evaluar, se registra N/A, y N/A no cuenta como aprobado.
Resultado de calificación actual (en el momento de P3 — todo aprobado)
C01 수치 조작 [OK] 1/1 C05 지연 누락 [OK] 3/3 C09 반올림 [OK] 0/0
C02 날짜 오기 [OK] 1/1 C06 미제출 은폐 [OK] 3/3 C10 정상 [OK] 오탐 0
C03 값 오배치 [OK] 1/1 C07 역행 무시 [OK] 1/1
C04 없는 과제 [OK] 1/1 C08 서술 상충 [OK] 0/0
[PASS] G1_검출률 11/11 (100%) [PASS] G4_속도 최장 0.1초 / 제한 60초
[PASS] G2_오탐 error 0건 [PASS] G5_근거 좌표 누락 0건 / error 12건
[PASS] G3_심각도 위반 0건 [PASS] G6_계층정확성 11/11 (100%)G5 examinó 12 casos de error, pero se esperaban 11. Es porque la contaminación de C01 cambió celdas de dos tablas respectivamente, y como hay que corregir ambos lugares, no es una duplicación.
Carpetas
weekly-verify-mcp/
├─ docs/검증프로세스.md 설계 문서 (13개 절)
├─ src/weekly_verify/
│ ├─ harness.py 도구 응답 규약 · Finding · 두 좌표계
│ ├─ sources.py 원본 xlsx 파서 + DATA_ROOT 가드
│ ├─ findings.py 판정 5종 (원본만 보고 계산)
│ ├─ report.py 보고서 docx 파서
│ ├─ claims.py 주장 추출 (규칙 기반, LLM 미사용)
│ ├─ values.py L1 존재 · L2 정합 + 억제 규칙 3종
│ ├─ completeness.py L3 누락 검사
│ ├─ narrative.py L4 서술 상충 (warning 고정)
│ ├─ verify.py 진입점 — 네 계층 조립 + 계층 간 중복 제거
│ ├─ record.py 검증 결과 문서 생성·저장 + 승인 토큰
│ └─ server.py MCP 도구 10개 · 리소스 2 · 프롬프트 1
├─ scripts/
│ ├─ make_fixtures.py 오염 시나리오 10종 생성
│ ├─ check_fixtures.py 픽스처 자기검증 (30개 검사)
│ ├─ run_eval.py 채점기 (게이트 6종)
│ ├─ smoke_stdio.py stdio 기동 + 하네스 검사 15종
│ └─ verify_registration.py 설정 파일의 절대경로로 기동 확인
├─ tests/
│ ├─ test_harness.py 하네스 규약 잠금 (16개)
│ ├─ test_eval_contract.py 채점기 검증 — 가짜 엔진 7종 (20개)
│ ├─ test_findings.py 판정 엔진 ↔ 정답지 1건씩 대조 (27개)
│ ├─ test_completeness.py L3 누락 검사 (31개)
│ ├─ test_values.py L1·L2 + 억제 규칙 (53개)
│ ├─ test_narrative.py L4 서술 상충 (43개)
│ └─ test_server_contract.py docstring ↔ 실제 규칙 잠금 (63개)
├─ data/
│ ├─ 원본/ ← 서버가 읽는 유일한 곳
│ │ ├─ 마스터_주간보고_누적.xlsx
│ │ └─ 제출_2026-W35/ (담당자 6명)
│ ├─ 보고서/ C01~C10.docx 검증 대상
│ └─ 출력/ 검증 결과 기록 (저장 산출물)
├─ config/ 등록 설정 + README
├─ templates/ 검증 결과 문서 템플릿
└─ evals/ 🚫 서버 접근 금지 — evals/README.md 참조
├─ 정답지_2026-W35.xlsx
├─ fixtures_manifest.json 픽스처가 담고 있는 사실
└─ weekly-verify.yaml 엔진에게 요구하는 정책La razón de separar manifest y suite es que sus intereses son distintos — el primero es un hecho creado por el generador, así que cambia junto con el docx; el segundo es una política definida por la persona, independiente del docx. Si se fusionan en un solo archivo, los valores esperados aparecen en dos lugares y se produce deriva.
10 tipos de escenario de contaminación
data/보고서/C01~C10.docx. La detección esperada de cada archivo está en evals/fixtures_manifest.json.
Código | Tipo | Contenido sembrado | Esperado |
C01 | Manipulación numérica | L-01 progreso de esta semana 80 → 90 |
|
C02 | Fecha incorrecta | L-08 fecha de finalización planificada retrasada un día |
|
C03 | Valor mal ubicado | El 60 de L-18 en la fila de L-19 (respuesta correcta 40) |
|
C04 | Tarea inexistente | Fila L-31 añadida |
|
C05 | Omisión de retraso | Retrasos 6→3, recuento del resumen también ajustado |
|
C06 | Ocultación de no presentado | Tabla de no presentados eliminada + rellenada con valores de la semana anterior |
|
C07 | Regresión ignorada | 1 caso de regresión sin mencionar |
|
C08 | Contradicción de descripción | 64 días de retraso descritos como "avanzando sin problemas" |
|
C09 | Redondeo | 62.2% → 62% |
|
C10 | Normal | Sin contaminación |
|
C05 · C06 · C07 son el núcleo
Estos tres mantienen la coherencia interna del informe contaminado. Al eliminar los 3 retrasos, también ajustaron el recuento de la tabla resumen de 6→3. Por eso, leyendo solo el informe no hay ninguna contradicción; solo se revela al contrastar con el original. Los eliminados L-02 · L-08 · L-19 son precisamente los 3 casos en los que el responsable dejó vacía la casilla 이슈리스크.
C09 · C10 son igual de importantes
Son pruebas de prevención de falsos positivos. Nadie usa un verificador que emite error en informes normales.
Reglas de supresión — un solo error se reporta como un solo caso
Aunque la contaminación cambie solo un lugar, los valores derivados se equivocan en cadena. C02 solo retrasó un día la 계획완료일, pero también se equivocó el 경과일; C03 solo cambió el 금주진척률, pero también se equivocó el 증감. Si se señala todo tal cual, un solo error de escritura se convierte en dos observaciones, y la persona tiene que ir a buscar en dos lugares y no puede calibrar la gravedad por el número de observaciones.
# | Regla | Casos que no se suprimen |
1 | Si la tarea no existe en el original, no se contrastan los demás valores de esa fila | — (termina con 1 observación L1) |
2 | No se contrastan los valores de esta semana de tareas no presentadas | Los valores de la semana anterior sí se contrastan |
3 | Los valores derivados se omiten si el material ya fue señalado | Si el material es correcto, se señala el error del valor derivado |
4 | Se suprime la observación del recuento agregado de la categoría que ya cubrió L3 | Si el elemento es correcto y solo el recuento está mal, se señala |
La supresión no es incondicional. Cada regla se probó en pareja: el lado que se suprime y el lado que no se suprime — las reglas de supresión se derrumban silenciosamente justo en el momento en que uno piensa "esto también estaría bien que lo señalara".
Las columnas que no se verifican se declaran
En claims.미검증_열 se registraron 5 tipos con su razón (상태 es una etiqueta de juicio, así que es competencia de L3; la forma O (완료 2026-08-20) de la tabla de regresiones es formato libre, por lo que el contraste es inestable, etc.). Si se omiten en silencio, se lee como "todo verificado", pero hay columnas que en realidad no se miran.
Ejecución
uv sync --extra devuv run python scripts/make_fixtures.pyuv run python scripts/check_fixtures.pyuv run python scripts/run_eval.pyuv run python -m pytest -quv run python scripts/smoke_stdio.pyuv run python scripts/verify_registration.py10 herramientas MCP
# | Herramienta | Etapa | Escritura |
1 |
| DISCOVER | |
2 |
| SOURCE | |
3 |
| BASELINE | |
4 |
| REPORT | |
5 |
| CLAIM | |
6 |
| VERIFY (L1·L2) | |
7 |
| COMPLETE (L3) | |
8 |
| NARRATE (L4) | |
9 |
| PREVIEW | |
10 |
| SAVED | ✅ |
Ruta rápida: con solo la 9 se ejecutan las cuatro capas. Las herramientas intermedias se usan para mostrar a la persona "por qué se juzgó así".
Recursos template://verification · report://{보고서}, prompt verify_weekly_report.
Guardar es un 'registro de observaciones' — el error no lo bloquea
En el borrador del diseño estaba escrito "si hay al menos un error, se rechaza el guardado", pero era una regla equivocada. Guardar es registrar las observaciones, y es precisamente cuando hay errores cuando más se necesita el registro. Si se bloquea en ese momento, la herramienta se vuelve inútil.
Lo que había que bloquear era otra cosa.
# | Condición de rechazo | Razón |
1 | El token de aprobación no coincide con el contenido actual de las observaciones | Evita que quede en el archivo contenido que la persona no ha verificado |
2 | Hay | No es un registro, es una falsedad |
La conclusión es una de 통과 · 보류 · 반송. Como el token de aprobación se calcula a partir del contenido de las observaciones, si cambia aunque sea una observación, el token deja de coincidir y se rechaza el guardado.
Estas dos condiciones están especificadas en la descripción de la herramienta save_approved_verification, y tests/test_server_contract.py contrasta la descripción con el código real y lo bloquea — el modelo no lee el código, así que una regla que no esté en la descripción no existe para el modelo.
Registro (P5)
Registro en Codex completado — en ~/.codex/config.toml está [mcp_servers.weekly-verify] (copia de seguridad: config.toml.bak-2026-08-26). Al reiniciar Codex, aparecen las herramientas.
Claude Desktop tiene %APPDATA%\Claude como ruta parcialmente bloqueada, por lo que la herramienta no puede escribirlo. Debe fusionar manualmente el contenido de config/claude_desktop_config.example.json — es un bloqueo intencionado y no se sortea.
command debe ser obligatoriamente una ruta absoluta. La aplicación de escritorio no hereda el PATH del shell de inicio de sesión, así que si solo se escribe uv, funciona en la terminal pero el servidor no arranca en la aplicación.
uv run python scripts/verify_registration.pySe verifican 3 configuraciones: los 2 ejemplos y la configuración en vivo realmente registrada. Aunque los ejemplos sean correctos, si el registro real está mal, no aparecerá en la aplicación.
Sobre los datos
Todos los datos de data/ son datos ficticios (inventados) para práctica. Los nombres de responsables son personajes de novelas clásicas, y las tareas son temas de automatización logística que no existen en la realidad. No se incluye ningún dato real de la empresa ni información personal, y no coloque archivos reales de la empresa en esta carpeta.
Los datos originales provienen de mx-agentic-ai-day1-prd.
Available Tools
10 toolscheck_completenessARead-onlyIdempotent
원본에서 나와야 할 판정이 보고서에 빠졌는지 봅니다 (L3).
이 검사가 이 도구의 존재 이유입니다. 사람이 주간보고에서 틀리는 것은 대개 숫자가 아니라 안 쓴 항목입니다. 틀린 숫자는 눈에 띄지만 없는 줄은 눈에 띄지 않습니다.
언급 여부를 두 수준에서 봅니다. 상세 표가 있으면 표에 없는 과제코드가 누락이고, 집계만 했으면 건수가 원본과 맞는지 봅니다 — 집계만 하고 개별 항목을 나열하지 않는 것은 정상적인 보고 방식이기 때문입니다.
Returns: 지적응답: L3 지적 목록. 보고서에 없는 항목이므로 보고서 좌표는 비어 있고 원본 좌표만 채워집니다.
Examples: - 사용: "빠뜨린 지연 과제가 있나요?" - 사용하지 않음: 적힌 값이 맞는지 보려면 → verify_claims
| Name | Required | Description | Default |
|---|---|---|---|
| 보고서 | Yes | 검증 대상 .docx 파일명 또는 경로 | |
| 전주차 | No | 대조 기준 직전 주차 | 2026-W34 |
| 기준주차 | No | 검증 대상 주차 | 2026-W35 |
| 원본디렉터리 | No | 원본 엑셀 디렉터리 | data/원본 |
Output Schema
| Name | Required | Description |
|---|---|---|
| info | Yes | |
| error | Yes | |
| stage | Yes | 검증 워크플로에서 지금 위치한 단계 |
| status | Yes | 이 호출의 결과 상태 |
| 계층 | Yes | 이 호출이 검사한 계층 |
| 지적 | Yes | |
| warning | Yes | |
| next_actions | No | 이어서 호출하면 좋은 도구 목록 |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Annotations already declare readOnly and idempotent behavior, and the description adds meaningful context: the two-level comparison logic, the treatment of aggregation as normal, and the response shape (L3 finding list with empty report coordinates and populated source coordinates). There is no contradiction with the annotations.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The purpose is front-loaded in the first sentence, and each section—rationale, methodology, return shape, and examples—serves a clear function. The motivational paragraph is slightly longer than strictly necessary but still earns its place by explaining why this tool matters.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a read-only comparison tool with annotated safety, complete schema descriptions, defaults, and an output schema, the description covers selection, invocation, interpretation, and return format. Nothing needed to call or interpret the tool is missing.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, so the schema already documents the roles of 보고서, 전주차, 기준주차, and 원본디렉터리. The description confirms the report-vs-source comparison but adds little parameter-level detail beyond what the schema provides, so the baseline 3 applies.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The first sentence states a specific action: checking whether judgments that should appear from the source are missing from the report, and labels the level (L3). The examples and the explicit pointer to verify_claims distinguish this from the nearest sibling, so an agent can identify it as the omission-checking tool.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description gives an explicit use case ('빠뜨린 지연 과제가 있나요?') and an explicit exclusion: if checking whether written values are correct, use verify_claims. It also explains that aggregated reporting without individual items is normal, which clarifies when this tool should and should not flag an omission.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
compute_baseline_findingsARead-onlyIdempotent
원본 데이터만으로 판정 5종(신규완료·지연·일정변경·역행·미제출)을 계산합니다.
이 도구는 보고서를 입력으로 받지 않습니다. 그것이 핵심입니다. 보고서를 보고 판정을 계산하면 보고서에 이끌려, 보고서에서 빠진 항목을 영영 찾지 못합니다.
판정은 날짜·완료여부 계산으로만 합니다. 담당자가 적은 이슈리스크 텍스트는
판정에 쓰지 않습니다 — 이슈를 적지 않은 지연 과제를 잡아내는 것이 이 도구의
존재 이유입니다.
Returns: 판정응답: 구분별 건수와 판정 목록. 각 판정은 원본 좌표를 갖습니다.
Examples: - 사용: "이번 주에 보고되어야 할 변동이 뭔가요?" - 사용하지 않음: 보고서와 대조하려면 → check_completeness / verify_claims
| Name | Required | Description | Default |
|---|---|---|---|
| 구분 | No | 특정 판정만 보려면 지정. 신규완료·지연·일정변경·역행·미제출 중 하나 | |
| 전주차 | No | 대조 기준 직전 주차 | 2026-W34 |
| 기준주차 | No | 검증 대상 주차 | 2026-W35 |
| 원본디렉터리 | No | 원본 엑셀 디렉터리 | data/원본 |
Output Schema
| Name | Required | Description |
|---|---|---|
| stage | Yes | 검증 워크플로에서 지금 위치한 단계 |
| status | Yes | 이 호출의 결과 상태 |
| 구분별 | Yes | 판정 구분별 과제/단계 기준 건수 |
| 기준일 | Yes | 지연 판정의 기준일 (기준주차의 월요일) |
| 총판정 | Yes | |
| next_actions | No | 이어서 호출하면 좋은 도구 목록 |
| 판정목록 | Yes |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Annotations already declare readOnlyHint, idempotentHint, and destructiveHint, but the description adds crucial non-obvious behavior: it ignores the '이슈리스크' text and computes only from date/completion fields. It also explains the strategic rationale—catching delayed tasks that failed to write an issue—which is valuable beyond the annotations.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is front-loaded with the key constraint in bold and uses short bullets and examples. It is slightly more verbose than strictly necessary due to rhetorical rationale ('그것이 핵심입니다'), but every substantive part earns its place by preventing misuse.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the output schema exists, all parameters are optional with defaults, annotations cover safety, and the description covers purpose, non-usage, return summary, and examples, nothing essential is missing for an agent to select and invoke the tool correctly.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, with each parameter already documented including defaults and allowed values for '구분'. The description reinforces the original-data theme but does not add meaningful parameter-level detail beyond the schema, so the baseline of 3 is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description opens with a specific verb and resource: '원본 데이터만으로 판정 5종(신규완료·지연·일정변경·역행·미제출)을 계산합니다.' It explicitly distinguishes itself from report-based tools by stating it does not take reports as input, making sibling differentiation clear.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides explicit when-to-use guidance ('이번 주에 보고되어야 할 변동이 뭔가요?') and when-not-to-use guidance with named alternatives: '보고서와 대조하려면 → check_completeness / verify_claims.' It also stresses that the tool should be used for original-data-only determination, not report comparison.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
extract_report_claimsARead-onlyIdempotent
보고서에서 원본과 대조 가능한 주장을 뽑습니다.
값은 원문 문자열 그대로 담습니다. 숫자로 바꾸거나 정규화하지 않습니다 —
62 를 62.0 으로 바꿔 놓으면 반올림 오류를 반올림 오류로 지적할 수 없습니다.
표 기반 보고서는 열 이름 → 필드 매핑으로 결정적으로 뽑힙니다. 추측이 개입하지 않으므로 같은 보고서는 항상 같은 주장을 냅니다.
미검증열 에는 의도적으로 검증하지 않는 열과 그 이유가 담깁니다. 조용히
건너뛰면 "전부 검증했다"로 읽히기 때문입니다.
Returns: 주장응답: 총 주장 수, 필드별 개수, 주장 목록(잘릴 수 있음).
Examples: - 사용: "보고서가 L-08 계획완료일을 뭐라고 적었나요?" (필드="계획완료일") - 사용하지 않음: 맞는지 틀리는지 판정하려면 → verify_claims
| Name | Required | Description | Default |
|---|---|---|---|
| 필드 | No | 특정 필드만 보려면 지정. 예 금주진척률 · 계획완료일 | |
| 보고서 | Yes | 검증 대상 .docx 파일명 또는 경로 |
Output Schema
| Name | Required | Description |
|---|---|---|
| stage | Yes | 검증 워크플로에서 지금 위치한 단계 |
| status | Yes | 이 호출의 결과 상태 |
| 잘림 | Yes | True면 주장 목록이 잘렸습니다. 필드 인자로 좁혀 보세요 |
| 주장 | Yes | |
| 총주장 | Yes | |
| 필드별 | Yes | |
| next_actions | No | 이어서 호출하면 좋은 도구 목록 |
| 미검증열 | Yes | 의도적으로 검증하지 않는 열과 그 이유. 조용히 건너뛰지 않는다 |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Annotations already declare readOnlyHint=true and idempotentHint=true. The description adds substantial behavioral context: values are kept as raw strings to avoid masking rounding errors, extraction is deterministic for table-based reports, and '미검증열' explicitly discloses unverified columns with reasons. This goes well beyond the annotations.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is front-loaded with the core purpose, then gives behavioral guarantees, return summary, and examples. The '62 vs 62.0' rationale and the '미검증열' explanation are dense but purposeful; every sentence earns its place without redundancy.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the output schema and annotations, the description is complete: parameters are covered, return contents are summarized including truncation, examples show how to phrase queries, and the sibling alternative is named. Nothing needed for correct invocation appears to be missing.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100%, so the schema already documents both parameters. The description adds a concrete example of 필드 ('L-08 계획완료일') and clarifies that extracted values remain raw strings, but it does not meaningfully elaborate on the 보고서 parameter beyond the schema. This is slightly above the baseline.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description states a clear verb and resource: extracting ('뽑습니다') claims that can be checked against the original source ('원본과 대조 가능한 주장'). It also differentiates itself from verify_claims in the example, so an agent can distinguish extraction from verification without opening other tools.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description explicitly gives a '사용' vs '사용하지 않음' example: use this tool to ask what the report says, and use verify_claims instead when the task is to judge correctness. It also notes deterministic table-based extraction, which helps the agent decide when this tool is appropriate.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
flag_narrative_risksARead-onlyIdempotent
값은 맞지만 서술이 데이터와 어긋나는 후보를 표시합니다 (L4).
64일 지연된 과제를 "순조롭게 진행 중"이라고 쓴 보고서는 숫자가 전부 정확합니다. L1·L2·L3 어디에도 걸리지 않는데, 읽는 사람은 완전히 잘못된 인상을 받습니다.
이 검사는 판단하지 않고 표시만 합니다. 그 서술이 부적절한지는 문맥에 달렸고
기계는 그 차이를 모릅니다. 그래서 결과는 항상 warning 이며 저장을 막지
않습니다. 확신하지 못하는 검사에 차단 권한을 주면 정상 보고서가 막히고, 사람이
검사기를 꺼 버립니다.
표는 보지 않습니다. 표의 칸은 값이고 값의 정합은 L2 소관입니다.
Returns:
지적응답: L4 후보 목록. error 는 구조적으로 나올 수 없습니다.
Examples: - 사용: "지연된 과제를 괜찮다고 써 놓은 데가 있나요?" - 사용하지 않음: 숫자 대조 → verify_claims
| Name | Required | Description | Default |
|---|---|---|---|
| 보고서 | Yes | 검증 대상 .docx 파일명 또는 경로 | |
| 전주차 | No | 대조 기준 직전 주차 | 2026-W34 |
| 기준주차 | No | 검증 대상 주차 | 2026-W35 |
| 원본디렉터리 | No | 원본 엑셀 디렉터리 | data/원본 |
Output Schema
| Name | Required | Description |
|---|---|---|
| info | Yes | |
| error | Yes | |
| stage | Yes | 검증 워크플로에서 지금 위치한 단계 |
| status | Yes | 이 호출의 결과 상태 |
| 계층 | Yes | 이 호출이 검사한 계층 |
| 지적 | Yes | |
| warning | Yes | |
| next_actions | No | 이어서 호출하면 좋은 도구 목록 |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Beyond the annotations (readOnlyHint, idempotentHint, destructiveHint), the description adds crucial behavioral context: results are always `warning`, the tool never blocks saving, it intentionally avoids judging narrative appropriateness, and it excludes table values. This explains the tool's limitations and design rationale clearly.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is well-structured and front-loaded: the purpose is stated first, followed by an illustrative example, explicit behavioral boundaries, and usage examples. Every section earns its place, and the bold key point makes the tool's non-blocking behavior immediately visible.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the annotations, output schema, and sibling tools, the description is fully sufficient. It explains what the tool does, when to use it, when not to use it, what it returns, and why it behaves conservatively. No important operational detail is missing.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100%, so the baseline is 3. The description adds extra meaning by clarifying that the '보고서' parameter refers to the narrative text, not tables, and by illustrating the kind of mismatch it detects. It does not deeply elaborate the week or directory parameters, but the schema already documents those adequately.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool's specific function: flag candidates where values are correct but the narrative conflicts with the data (L4). It explicitly distinguishes this from L1/L2/L3 checks and gives a concrete example, so an agent can identify the exact resource and behavior.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides both a use case ('지연된 과제를 괜찮다고 써 놓은 데가 있나요?') and a non-use case with a named alternative ('숫자 대조 → verify_claims'). It also clarifies that this tool only flags, does not judge, and does not look at tables, which prevents misuse.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
list_verification_targetsARead-onlyIdempotent
검증할 수 있는 보고서와 대조 기준이 되는 원본 파일 목록을 조회합니다.
검증 작업의 출발점입니다. 여기서 얻은 파일명을 다른 도구에 넘깁니다.
Returns:
대상목록응답: 원본 엑셀 목록과 .docx 보고서 목록.
Examples: - 사용: "검증할 수 있는 보고서가 뭐가 있나요?" - 사용하지 않음: 이미 파일명을 알고 바로 검증할 때 → preview_verification_report
| Name | Required | Description | Default |
|---|---|---|---|
| 원본디렉터리 | No | 원본 엑셀이 있는 디렉터리. 기본값 data/원본 | data/원본 |
| 보고서디렉터리 | No | 검증 대상 .docx 가 있는 디렉터리. 기본값 data/보고서 | data/보고서 |
Output Schema
| Name | Required | Description |
|---|---|---|
| stage | Yes | 검증 워크플로에서 지금 위치한 단계 |
| status | Yes | 이 호출의 결과 상태 |
| 보고서 | Yes | 검증할 수 있는 .docx 목록 |
| next_actions | No | 이어서 호출하면 좋은 도구 목록 |
| 원본파일 | Yes | 마스터 파일과 제출본 목록 |
| 원본디렉터리 | Yes |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Annotations already declare readOnlyHint=true and idempotentHint=true, which covers the safety profile. The description adds context about returning two lists (original Excel and .docx reports), but this is also covered by the output schema. No contradiction with annotations, but little incremental behavioral disclosure beyond what structured fields provide.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is reasonably concise with the main purpose front-loaded. The 'Returns' section and example are useful but slightly redundant with the output schema. Overall efficient and easy to scan quickly.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a simple read-only list tool, the description is complete: annotations cover safety, output schema covers return format, and the description covers workflow position, usage examples, and exclusions. An agent has everything needed to invoke it correctly without guessing.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100% – both parameters (원본디렉터리 and 보고서디렉터리) have descriptive text in the schema. The description does not add any parameter-specific information, so it stays at the baseline of 3.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description explicitly states it queries the list of verifiable reports and original files for comparison, and includes a concrete example query. It also differentiates from the sibling tool preview_verification_report by specifying when not to use it, making the purpose unambiguous.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description clearly identifies this as the starting point of verification work, instructs the agent to pass the obtained filenames to other tools, and provides both when-to-use ('검증할 수 있는 보고서가 뭐가 있나요?') and when-not-to-use examples with an explicit alternative (preview_verification_report).
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
preview_verification_reportARead-onlyIdempotent
네 계층을 모두 돌려 지적 목록과 저장 대상, 승인 요청 문장을 돌려줍니다.
이 도구 하나로 L1·L2·L3·L4 전부를 검사합니다. 중간 도구들은 "왜 그렇게 판정했는지"를 사람에게 보여줄 때 씁니다.
승인토큰 은 지적 내용에서 계산됩니다. 지적이 하나라도 달라지면 토큰이 달라지므로,
사용자가 확인한 내용과 저장될 내용이 같다는 것을 보장할 수 있습니다.
approval_request 문장을 사용자에게 그대로 보여 주고, 명시적으로 승인받은
뒤에만 save_approved_verification 을 호출하십시오.
Returns: 미리보기응답: 지적 목록, 저장 경로, 승인토큰, 지금 쓸 수 있는 결론 후보.
Examples: - 사용: "이 보고서 검증해 주세요" - 사용하지 않음: 사용자 승인 없이 저장 → 절대 금지
| Name | Required | Description | Default |
|---|---|---|---|
| 보고서 | Yes | 검증 대상 .docx 파일명 또는 경로 | |
| 전주차 | No | 대조 기준 직전 주차 | 2026-W34 |
| 기준주차 | No | 검증 대상 주차 | 2026-W35 |
| 원본디렉터리 | No | 원본 엑셀 디렉터리 | data/원본 |
Output Schema
| Name | Required | Description |
|---|---|---|
| info | Yes | |
| error | Yes | |
| stage | Yes | 검증 워크플로에서 지금 위치한 단계 |
| status | Yes | 이 호출의 결과 상태 |
| 지적 | Yes | |
| warning | Yes | |
| 보고서 | Yes | |
| next_actions | No | 이어서 호출하면 좋은 도구 목록 |
| 결론후보 | Yes | 지금 지적 상태에서 쓸 수 있는 결론 |
| 기준주차 | Yes | |
| 승인토큰 | Yes | save_approved_verification 에 그대로 넘길 값 |
| 저장경로 | Yes | |
| approval_request | Yes | 사용자에게 그대로 보여 줄 승인 요청 문장 |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Annotations already declare readOnlyHint, idempotentHint, and destructiveHint, so the safety profile is covered. The description adds valuable non-obvious behavior: the approval token is computed from finding content so any change alters it, and the approval request must be displayed verbatim. This gives the agent the workflow-level transparency that annotations cannot express.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The core purpose is front-loaded, and the approval workflow is prominently placed near the top. There is minor redundancy between the first sentence and the explicit 'L1·L2·L3·L4 전부를 검사합니다' repetition, but the overall structure is compact and useful.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the annotations, full parameter coverage, and an output schema, the description supplies the missing operational context: token integrity, verbatim approval display, and the save-after-approval gate. An agent has enough information to select and invoke this tool correctly without ambiguity.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, and each parameter already has a clear description: report path, previous week, target week, and source directory. The description adds no additional parameter-specific detail, so the baseline of 3 is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description opens with a specific verb and resource: it runs all four verification layers and returns the finding list, storage target, and approval request sentence. It also distinguishes itself from sibling intermediate tools by stating it covers L1·L2·L3·L4 in one call.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description explicitly says intermediate tools are for showing humans why a judgment was made, implying this consolidated tool is for the full preview. It also gives a clear workflow rule: show `approval_request` verbatim and only call `save_approved_verification` after explicit user approval.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
read_reportARead-onlyIdempotent
검증 대상 보고서(.docx)의 구조를 표와 문단으로 읽습니다.
각 표에 직전 제목을 붙여 돌려줍니다. "이 표가 무엇에 대한 표인가"를 알아야 지연 표에서 빠진 과제를 찾을 수 있기 때문입니다.
Returns: 보고서응답: 표별 제목·헤더·행수와 보고서에 등장한 과제코드 목록.
Examples: - 사용: "이 보고서에 어떤 표가 들어 있나요?" - 사용하지 않음: 값을 대조하려면 → extract_report_claims → verify_claims
| Name | Required | Description | Default |
|---|---|---|---|
| 보고서 | Yes | 검증 대상 .docx 파일명 또는 경로. 예 C05.docx |
Output Schema
| Name | Required | Description |
|---|---|---|
| 표 | Yes | |
| stage | Yes | 검증 워크플로에서 지금 위치한 단계 |
| status | Yes | 이 호출의 결과 상태 |
| 파일 | Yes | |
| 표수 | Yes | |
| 문단수 | Yes | |
| next_actions | No | 이어서 호출하면 좋은 도구 목록 |
| 과제코드 | Yes | 보고서 전체에서 발견된 과제코드 |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Annotations already mark the tool as readOnly, idempotent, and non-destructive. The description adds meaningful behavioral context beyond those annotations: each table is returned with its immediately preceding heading, and the rationale for this design is explained. It also summarizes the return shape.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is compact and front-loaded, stating the core operation in the first sentence, followed by a brief behavioral rule, return summary, and short usage examples. Every sentence earns its place; the rationale for heading attachment is useful rather than filler.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a read-only single-parameter tool with an existing output schema, the description covers what the tool does, what it returns, and when not to use it. The non-obvious behavior of attaching preceding headings is explicitly stated, so an agent can invoke the tool correctly without surprises.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The single parameter is fully documented in the schema with type, title, and description including an example file name. Schema coverage is 100%, so the description need not add much; the example C05.docx provides a small extra hint but does not carry a heavy semantic burden.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
Clearly identifies the operation: reading the structure of a verification .docx report, attaching preceding headings to each table, and returning table-level metadata plus task codes. The 'not use' example explicitly contrasts with extract_report_claims and verify_claims, helping an agent distinguish it from siblings.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
Provides explicit guidance on when to use this tool (asking what tables exist in the report) and when not to use it (comparing values, in which case extract_report_claims → verify_claims is the path). This gives the agent a clear routing decision.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
read_source_dataARead-onlyIdempotent
원본 엑셀을 읽어 정규화 사실표로 만들고 그 규모를 돌려줍니다.
제출본에는 주차 열이 없으므로 기준주차를 스탬프로 찍어 적재합니다. 모든 행은 자기 좌표(파일·시트·행)를 들고 다니며, 그것이 나중에 지적의 근거가 됩니다.
Returns: 원본데이터응답: 행 수, 주차별 과제 수, 미제출 과제코드 목록.
Examples: - 사용: "원본에 몇 개 과제가 들어와 있나요?" / "누가 안 냈나요?" - 사용하지 않음: 판정 5종이 필요할 때 → compute_baseline_findings
| Name | Required | Description | Default |
|---|---|---|---|
| 전주차 | No | 대조 기준 직전 주차 | 2026-W34 |
| 기준주차 | No | 검증 대상 주차. 예 2026-W35 | 2026-W35 |
| 원본디렉터리 | No | 원본 엑셀 디렉터리 | data/원본 |
Output Schema
| Name | Required | Description |
|---|---|---|
| stage | Yes | 검증 워크플로에서 지금 위치한 단계 |
| status | Yes | 이 호출의 결과 상태 |
| 전주차 | Yes | |
| next_actions | No | 이어서 호출하면 좋은 도구 목록 |
| 기준주차 | Yes | |
| 단계행수 | Yes | |
| 요약행수 | Yes | |
| 금주과제수 | Yes | |
| 미제출과제 | Yes | 전주에 있으나 금주 제출본에 없는 과제코드 |
| 전주과제수 | Yes |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Even with readOnlyHint=true, idempotentHint=true, and destructiveHint=false in annotations, the description adds meaningful behavioral context: it stamps the baseline week onto rows, and every row carries file/sheet/row coordinates to support later issue pointing. It also discloses the output contents (row counts, per-week task counts, unsubmitted task codes), going well beyond what the annotations alone convey.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is well-structured with clear sections (main description, Returns, Examples) and front-loads the core purpose. There is slight redundancy between '그 규모를 돌려줍니다' in the first line and the 'Returns' details, but overall every section earns its place and no unnecessary content is present.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the rich input schema, full parameter documentation, annotations, output schema, and explicit use/not-use examples, the description is complete for an agent to select and invoke the tool correctly. Nothing essential about purpose, behavior, or when to use it is missing.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, so the input schema already documents all three parameters (전주차, 기준주차, 원본디렉터리) with defaults and explanations. The description does not add additional parameter-level meaning, so the baseline score of 3 is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description opens with a specific verb+resource statement: '원본 엑셀을 읽어 정규화 사실표로 만들고 그 규모를 돌려줍니다' (reads the original Excel, builds a normalized fact table, and returns its scale). It also distinguishes itself from sibling tools with the explicit not-used example routing to compute_baseline_findings, so an agent can tell it apart even without checking the schema.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The 'Examples' section explicitly states when to use the tool ('원본에 몇 개 과제가 들어와 있나요?' / '누가 안 냈나요?') and explicitly states when not to use it ('판정 5종이 필요할 때 → compute_baseline_findings'). This gives clear usage guidance and a named alternative, satisfying the highest bar for this dimension.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
save_approved_verificationAIdempotent
사용자가 승인한 검증 결과를 파일로 저장합니다. 유일한 쓰기 도구입니다.
사용자가 명시적으로 승인한 뒤에만 호출하십시오. 승인 없이 호출하지 마십시오.
저장하는 것은 지적 기록입니다. 보고서를 고치지 않습니다. 그래서 error 가
있다는 이유만으로 저장을 막지는 않습니다 — 오히려 error 가 있을 때 기록이 가장
필요합니다.
두 경우에만 거부합니다.
승인토큰이 현재 지적 내용과 맞지 않을 때. 사람이 확인하지 않은 내용이 파일로 남는 것을 막습니다. preview_verification_report 를 다시 호출하십시오.
error가 있는데 결론을 '통과' 로 적으려 할 때. 그것은 기록이 아니라 거짓입니다. '보류' 또는 '반송' 을 쓰십시오.
Returns: 저장응답: 저장 경로와 기록된 결론.
Examples: - 사용: 사용자가 "보류로 저장해 주세요"라고 승인한 뒤 - 사용하지 않음: 미리보기를 보여 주기 전 / 승인 문구가 없을 때
| Name | Required | Description | Default |
|---|---|---|---|
| 결론 | Yes | 통과 · 보류 · 반송 중 하나. error 가 있으면 '통과' 불가 | |
| 보고서 | Yes | 검증 대상 .docx 파일명 또는 경로 | |
| 전주차 | No | 대조 기준 직전 주차 | 2026-W34 |
| 기준주차 | No | 검증 대상 주차 | 2026-W35 |
| 승인토큰 | Yes | preview_verification_report 응답의 승인토큰 값 | |
| 원본디렉터리 | No | 원본 엑셀 디렉터리 | data/원본 |
Output Schema
| Name | Required | Description |
|---|---|---|
| info | Yes | |
| error | Yes | |
| stage | Yes | 검증 워크플로에서 지금 위치한 단계 |
| status | Yes | 이 호출의 결과 상태 |
| 결론 | Yes | |
| warning | Yes | |
| next_actions | No | 이어서 호출하면 좋은 도구 목록 |
| 저장경로 | Yes |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Beyond the annotations, the description explains that saving writes an intellectual record rather than modifying the report, that errors are not a reason to refuse saving, and that the tool rejects only when the approval token mismatches current findings or when an error is paired with a 'pass' conclusion. This substantially enriches the agent's understanding of the tool's behavior and failure modes.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is longer than average, but every section earns its place: safety condition, behavioral nuance, explicit rejection rules, return value, and usage examples. Critical approval guidance is front-loaded, and the structure makes the information easy to parse.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a write tool with 6 parameters, annotations, and an output schema, the description covers the critical operational context: when to call, what the token is, what causes rejection, and what the response contains. The optional file/path parameters are sufficiently documented in the schema, so nothing essential is missing.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, so the schema already documents all parameters. The description adds valuable context around 승인토큰 and 결론 constraints, but these largely reinforce schema descriptions rather than introducing new parameter-level meaning.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description opens with a clear verb and resource: saving user-approved verification results to a file, and explicitly states this is the only write tool, which distinguishes it from the sibling read/analysis tools. It immediately signals the tool's unique role in the workflow.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description gives explicit when-to-use and when-not-to-use guidance: call only after explicit user approval, never before showing the preview, and never without the approval phrase. It also names preview_verification_report as the source of the approval token and lists the two rejection conditions, providing an agent with concrete gating logic.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
verify_claimsARead-onlyIdempotent
보고서의 값을 원본과 대조합니다. L1(원본에 없음) · L2(원본과 다름).
L1 만으로는 부족합니다. L-18 의 값을 L-19 행에 옮겨 적으면 두 값 다 원본에
존재하므로 L1 은 통과합니다. 과제코드까지 맞춰 보는 L2 만이 잡습니다.
한 번의 실수가 여러 값을 틀리게 만들므로 억제 규칙이 있습니다 — 원본에 없는
과제는 그 행의 다른 값을 대조하지 않고, 미제출 과제의 금주 값은 대조하지 않으며,
파생 값(증감·경과일)은 재료가 이미 지적되면 건너뜁니다. 한 번 잘못 적은 것을
두 건으로 보고하지 않기 위한 것입니다.
반올림(0.5 이내) 차이는 error 가 아니라 warning 입니다.
Returns: 지적응답: L1·L2 지적 목록. 각 지적은 보고서 좌표와 원본 좌표를 갖습니다.
Examples: - 사용: "보고서 숫자가 원본과 맞나요?" - 사용하지 않음: 빠진 항목을 찾으려면 → check_completeness
| Name | Required | Description | Default |
|---|---|---|---|
| 보고서 | Yes | 검증 대상 .docx 파일명 또는 경로 | |
| 전주차 | No | 대조 기준 직전 주차 | 2026-W34 |
| 기준주차 | No | 검증 대상 주차 | 2026-W35 |
| 원본디렉터리 | No | 원본 엑셀 디렉터리 | data/원본 |
Output Schema
| Name | Required | Description |
|---|---|---|
| info | Yes | |
| error | Yes | |
| stage | Yes | 검증 워크플로에서 지금 위치한 단계 |
| status | Yes | 이 호출의 결과 상태 |
| 계층 | Yes | 이 호출이 검사한 계층 |
| 지적 | Yes | |
| warning | Yes | |
| next_actions | No | 이어서 호출하면 좋은 도구 목록 |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Annotations declare readOnlyHint, idempotentHint, and destructiveHint, but the description adds substantial behavioral context beyond that: L2 checks task codes, suppression rules prevent duplicate findings, derived values are skipped when their source is already flagged, and rounding tolerance maps to warning rather than error. No contradiction with annotations.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is detailed but every section earns its place: purpose, L1-vs-L2 rationale, suppression rules, rounding policy, return shape, and usage examples. The key purpose is front-loaded and the examples are compact and useful. Length is justified by the tool's non-obvious verification logic.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
The description explains the tool's core evaluation logic, edge cases, suppression behavior, rounding tolerance, and return shape. With an output schema present and full schema coverage, nothing an agent needs to invoke this tool correctly is missing. It handles a moderately complex verification task comprehensively.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, so the schema already documents all four parameters with names, defaults, and descriptions. The description adds general context about what 'verification' means and how findings are produced, but it does not add per-parameter meaning beyond the schema. Baseline 3 is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description opens with a specific verb and resource: '보고서의 값을 원본과 대조합니다' (compares report values against the original), then defines the two finding levels L1 and L2. It distinguishes itself from siblings by explicitly naming check_completeness as the tool for missing items, so an agent can select correctly.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description gives an explicit positive use case ('보고서 숫자가 원본과 맞나요?') and a negative case (missing items → check_completeness). It also documents important behavioral conditions such as suppression rules and when rounding differences become warnings, which helps the agent decide when and how to invoke the tool.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
10 tool updates
v0.1.0- First observed
check_completeness - First observed
compute_baseline_findings - First observed
extract_report_claims - First observed
flag_narrative_risks - First observed
list_verification_targets - First observed
preview_verification_report - First observed
read_report - First observed
read_source_data - First observed
save_approved_verification - First observed
verify_claims
TDQS
Scored across 10 tools
Each tool owns a distinct stage or verification level (L1/L2 vs L3 vs L4), and the descriptions explicitly cross-reference when another tool should be used instead. The aggregate preview tool is clearly positioned as a convenience wrapper over the intermediate tools, so there is no real ambiguity.
All tool names follow a consistent snake_case verb_noun pattern with specific, informative verbs: list, read, compute, extract, verify, check, flag, preview, save. The naming style is uniform and each name accurately predicts the tool's operation.
Ten tools map cleanly onto the stages of the verification pipeline: discover targets, load source, compute expected findings, parse report, extract claims, verify values, check completeness, flag narrative risks, preview, and save. The count is well-scoped and every tool has a clear purpose.
The set covers the full verification lifecycle from target discovery through source normalization, report parsing, claim extraction, multi-level checks, all-level preview, and an approval-gated save. There are no obvious dead ends: the only write tool is intentionally gated, and every intermediate tool feeds into the preview/save flow.
Maintenance
Related MCP Connectors
Verifies AI agent work end to end: real artifacts and outcomes checked, not self-reported success.
Agent completion verification with defects, corrections, and evidence receipts.
PDF, photo, email, and file comparison evidence checks with plain-language reports.
Check work from photos: read results, write checks in plain words, send photos for a verdict.
Related MCP Servers
- FlicenseNot gradedqualityDmaintenanceThis MCP server verifies that an agent’s claimed tool output matches the actual response returned by a tool to prevent invented or distorted results. It flags mismatches, omissions, and invented fields to ensure downstream logic only processes verified tool data.-
- AlicenseAqualityCmaintenanceEnables verification of AI coding agent self-reports against git diff truth and a deterministic gate, producing pass/regenerate/reject directives to ensure claimed work matches actual changes.6AGPL 3.0
- AlicenseNot gradedqualityCmaintenanceDeterministic verification for AI-generated analysis. Reconciliation, consistency and Excel-integrity checks that stop the line when the numbers don't add up.1MIT
- AlicenseNot gradedqualityAmaintenanceEnables deliverable conformance and evidence-chain checks by turning requirements into executable specs, validating numbers against a provenance ledger, and auditing PDF/OOXML metadata and archive manifests.29 npm1MIT