weekly-verify
Click on "Deploy Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@weekly-verifyverify this week's report against the original data"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
위클리-검증 (weekly-verify-mcp)
Compares the written weekly work report (.docx) against the source data (.xlsx) to find wrong values, missing items, and descriptions that contradict the data, then returns them to a human. A personal MCP server.
It does not fix. It only points out. Fixing is done by a human.
See docs/검증프로세스.md for the full design.
Current Status — P0~P5 Complete · Registered with Codex
Step | Content | Status |
P0 | Skeleton + contaminated dataset | ✅ |
P1 | Scorer ( | ✅ |
P2 | Source parser + 5-type judgment engine + L3 missing | ✅ |
P3 | Claim extraction + value comparison (L1·L2) + narrative conflict (L4) | ✅ |
P4 | Wrapping 10 MCP tools + smoke | ✅ |
P5 | Codex registration + startup check | ✅ |
Related MCP server: phionyx-pipeline-mcp
The 4 Verification Layers
The entire design of this tool comes from this table.
Layer | What it asks | Judgment | Severity |
L1 Existence | Does this value exist in the source? | Code |
|
L2 Consistency | Does it match that task's that field? | Code |
|
L3 Missing | Is a judgment that should appear from the source missing? | Code |
|
L4 Interpretation | The value is right but the description is off | Human |
|
L1 alone is not enough. If you copy the value of
L-18into theL-19row, both values exist in the source, so L1 passes. Only L2, which also checks the task code, catches it.L3 is the reason this tool exists. What people usually get wrong in weekly reports is not numbers but items they did not write. A wrong number is visible, but a missing row is not.
L4 structurally cannot be an
error.harness.Findingenforces this, andtests/test_harness.pylocks it in. Giving blocking authority to a check you are not sure about would block normal reports, and people would turn the checker off.
The 6 Gates
What evals/weekly-verify.yaml requires of the engine. Scored with uv run python scripts/run_eval.py.
ID | Requirement | Blocking |
G1 Detection rate | Does not miss a single C01~C07 error-grade contamination | ✅ |
G2 False positives | Does not raise an error on a normal report (C10) | ✅ |
G3 Severity | Does not raise an error on C08·C09 | ✅ |
G4 Speed | One report within 60 seconds | ✅ |
G5 Evidence | Every error fills the required coordinates per layer | ✅ |
G6 Layer accuracy | Classifies the findings into the correct layer | ⬜ Observational |
Coordinate requirements differ per layer (G5)
Layer | Report location | Source location | Reason |
L1 | ✅ | — | The value does not exist in the source, so there is no cell to point to |
L2 | ✅ | ✅ | It exists on both sides |
L3 | — | ✅ | The item does not exist in the report, so there is no location to point to |
L4 | ✅ | — |
If you force-fill coordinates that cannot be filled, a person will open the wrong place and believe they have verified it.
N/A is not a pass
Gates of the "don't do bad things" kind (G2·G3·G5) are satisfied automatically if the engine produces nothing. If you mark that as PASS, an engine with no features at all would look like it passed 5 out of 6. So when there is no basis to evaluate, mark it N/A, and N/A does not count as a pass.
Current scoring results (as of P3 — all passed)
C01 수치 조작 [OK] 1/1 C05 지연 누락 [OK] 3/3 C09 반올림 [OK] 0/0
C02 날짜 오기 [OK] 1/1 C06 미제출 은폐 [OK] 3/3 C10 정상 [OK] 오탐 0
C03 값 오배치 [OK] 1/1 C07 역행 무시 [OK] 1/1
C04 없는 과제 [OK] 1/1 C08 서술 상충 [OK] 0/0
[PASS] G1_검출률 11/11 (100%) [PASS] G4_속도 최장 0.1초 / 제한 60초
[PASS] G2_오탐 error 0건 [PASS] G5_근거 좌표 누락 0건 / error 12건
[PASS] G3_심각도 위반 0건 [PASS] G6_계층정확성 11/11 (100%)G5 examined 12 errors, but the expectation is 11. This is because C01's contamination changed one cell in each of two tables, and both must be fixed, so it is not a duplicate.
Folders
weekly-verify-mcp/
├─ docs/검증프로세스.md 설계 문서 (13개 절)
├─ src/weekly_verify/
│ ├─ harness.py 도구 응답 규약 · Finding · 두 좌표계
│ ├─ sources.py 원본 xlsx 파서 + DATA_ROOT 가드
│ ├─ findings.py 판정 5종 (원본만 보고 계산)
│ ├─ report.py 보고서 docx 파서
│ ├─ claims.py 주장 추출 (규칙 기반, LLM 미사용)
│ ├─ values.py L1 존재 · L2 정합 + 억제 규칙 3종
│ ├─ completeness.py L3 누락 검사
│ ├─ narrative.py L4 서술 상충 (warning 고정)
│ ├─ verify.py 진입점 — 네 계층 조립 + 계층 간 중복 제거
│ ├─ record.py 검증 결과 문서 생성·저장 + 승인 토큰
│ └─ server.py MCP 도구 10개 · 리소스 2 · 프롬프트 1
├─ scripts/
│ ├─ make_fixtures.py 오염 시나리오 10종 생성
│ ├─ check_fixtures.py 픽스처 자기검증 (30개 검사)
│ ├─ run_eval.py 채점기 (게이트 6종)
│ ├─ smoke_stdio.py stdio 기동 + 하네스 검사 15종
│ └─ verify_registration.py 설정 파일의 절대경로로 기동 확인
├─ tests/
│ ├─ test_harness.py 하네스 규약 잠금 (16개)
│ ├─ test_eval_contract.py 채점기 검증 — 가짜 엔진 7종 (20개)
│ ├─ test_findings.py 판정 엔진 ↔ 정답지 1건씩 대조 (27개)
│ ├─ test_completeness.py L3 누락 검사 (31개)
│ ├─ test_values.py L1·L2 + 억제 규칙 (53개)
│ ├─ test_narrative.py L4 서술 상충 (43개)
│ └─ test_server_contract.py docstring ↔ 실제 규칙 잠금 (63개)
├─ data/
│ ├─ 원본/ ← 서버가 읽는 유일한 곳
│ │ ├─ 마스터_주간보고_누적.xlsx
│ │ └─ 제출_2026-W35/ (담당자 6명)
│ ├─ 보고서/ C01~C10.docx 검증 대상
│ └─ 출력/ 검증 결과 기록 (저장 산출물)
├─ config/ 등록 설정 + README
├─ templates/ 검증 결과 문서 템플릿
└─ evals/ 🚫 서버 접근 금지 — evals/README.md 참조
├─ 정답지_2026-W35.xlsx
├─ fixtures_manifest.json 픽스처가 담고 있는 사실
└─ weekly-verify.yaml 엔진에게 요구하는 정책The reason manifest and suite are separated is that their concerns differ — the former is a fact created by the generator, so it changes together with the docx, while the latter is a policy set by a human, so it is unrelated to the docx. If merged into one file, expectations would appear in two places and drift.
The 10 Contamination Scenarios
data/보고서/C01~C10.docx. The expected detection for each file is in evals/fixtures_manifest.json.
Code | Type | What is planted | Expected |
C01 | Numeric manipulation | L-01 this week's progress 80 → 90 |
|
C02 | Wrong date | L-08 planned completion date pushed back one day |
|
C03 | Misplaced value | L-18's 60 into the L-19 row (correct answer 40) |
|
C04 | Nonexistent task | L-31 row added |
|
C05 | Missing delay | Delays 6→3, summary count adjusted together |
|
C06 | Concealed non-submission | Deleted non-submission table + filled with last week's values |
|
C07 | Ignored regression | 1 regression not mentioned |
|
C08 | Narrative conflict | 64-day delay described as "proceeding smoothly" |
|
C09 | Rounding | 62.2% → 62% |
|
C10 | Normal | No contamination |
|
C05 · C06 · C07 are the core
These three maintain internal consistency within the contaminated report. While deleting the 3 delayed items, the summary table count was also changed from 6 to 3. So reading only the report shows no contradiction — it only becomes visible when compared against the source. The deleted L-02 · L-08 · L-19 are exactly the 3 items whose owners left the 이슈리스크 (issue/risk) field blank.
C09 · C10 are just as important
They are false-positive prevention tests. No one uses a checker that raises error on a normal report.
Suppression Rules — report one mistake as one finding
Even if contamination changes only one place, derived values cascade into errors. C02 only pushed 계획완료일 (planned completion date) back one day, but 경과일 (elapsed days) also became wrong; C03 only changed 금주진척률 (this week's progress rate), but 증감 (change) also became wrong. If you point those out as-is, one miswritten value becomes two findings, forcing a person to search two places and making it impossible to gauge severity by the number of findings.
# | Rule | Cases not suppressed |
1 | If the task is not in the source, do not compare other values in that row | — (ends with 1 L1 finding) |
2 | Do not compare this week's value for non-submitted tasks | Last week's value is still compared |
3 | Skip derived values whose ingredients were already flagged | If the ingredients are correct, flag the derived value error |
4 | Suppress aggregate count findings for categories covered by L3 | If the items are correct and only the count is wrong, flag it |
Suppression is not unconditional. Each rule is tested as a pair — the suppressed side and the non-suppressed side. Suppression rules quietly collapse the moment you think "it would be nice if this were flagged too."
Columns not verified are declared
5 types are listed in claims.미검증_열 (unverified columns) with reasons (상태 (status) is a judgment label so it belongs to L3; the O (완료 2026-08-20) form in the regression table is free-form so comparison is unstable, etc.). Silently skipping would read as "everything was verified," but there are columns that were actually not examined.
Running
uv sync --extra devuv run python scripts/make_fixtures.pyuv run python scripts/check_fixtures.pyuv run python scripts/run_eval.pyuv run python -m pytest -quv run python scripts/smoke_stdio.pyuv run python scripts/verify_registration.pyThe 10 MCP Tools
# | Tool | Step | Write |
1 |
| DISCOVER | |
2 |
| SOURCE | |
3 |
| BASELINE | |
4 |
| REPORT | |
5 |
| CLAIM | |
6 |
| VERIFY (L1·L2) | |
7 |
| COMPLETE (L3) | |
8 |
| NARRATE (L4) | |
9 |
| PREVIEW | |
10 |
| SAVED | ✅ |
Fast path: tool 9 alone runs all four layers. The intermediate tools are used to show a person "why it was judged that way."
Resources template://verification · report://{보고서}, prompt verify_weekly_report.
Saving is a 'finding record' — error does not block it
The design draft said "refuse to save if there is even one error," but that was a wrong rule. What you save is a record of findings, and the time you most need a record is when there are errors. Blocking then would make the tool useless.
What should be blocked is something else.
# | Rejection condition | Reason |
1 | Approval token does not match the current findings | Prevents content the person has not reviewed from being written to a file |
2 | There is an | It becomes a falsehood, not a record |
The conclusion is one of 통과 · 보류 · 반송 (pass · hold · return). The approval token is computed from the findings, so if even one finding changes, the token mismatches and saving is rejected.
These two conditions are stated in the tool description of save_approved_verification, and tests/test_server_contract.py compares the description against the actual code to lock it in — since the model does not read code, a rule not in the description does not exist for the model.
Registration (P5)
Codex registration complete — [mcp_servers.weekly-verify] is in ~/.codex/config.toml (backup: config.toml.bak-2026-08-26). Restart Codex and the tools will appear.
Claude Desktop has %APPDATA%\Claude as a partially blocked path, so the tool cannot write into it. Merge the contents of config/claude_desktop_config.example.json manually — this is an intentional block and is not bypassed.
command must be an absolute path. Desktop apps do not inherit the login shell's PATH, so if you write only uv, it works in the terminal but the server will not start in the app.
uv run python scripts/verify_registration.pyIt checks 3 things: 2 example configs and the actually registered live config. Even if the examples are correct, if the actual registration is wrong, the tools will not appear in the app.
About the data
All data in data/ is practice-purpose fictional (fabricated) data. The assignee names are characters from classical novels, and the tasks are non-existent logistics automation topics. It contains no real internal data or personal information whatsoever, and do not put real internal files in this folder.
The source data was taken from mx-agentic-ai-day1-prd.
Available Tools
10 toolscheck_completenessARead-onlyIdempotent
원본에서 나와야 할 판정이 보고서에 빠졌는지 봅니다 (L3).
이 검사가 이 도구의 존재 이유입니다. 사람이 주간보고에서 틀리는 것은 대개 숫자가 아니라 안 쓴 항목입니다. 틀린 숫자는 눈에 띄지만 없는 줄은 눈에 띄지 않습니다.
언급 여부를 두 수준에서 봅니다. 상세 표가 있으면 표에 없는 과제코드가 누락이고, 집계만 했으면 건수가 원본과 맞는지 봅니다 — 집계만 하고 개별 항목을 나열하지 않는 것은 정상적인 보고 방식이기 때문입니다.
Returns: 지적응답: L3 지적 목록. 보고서에 없는 항목이므로 보고서 좌표는 비어 있고 원본 좌표만 채워집니다.
Examples: - 사용: "빠뜨린 지연 과제가 있나요?" - 사용하지 않음: 적힌 값이 맞는지 보려면 → verify_claims
| Name | Required | Description | Default |
|---|---|---|---|
| 보고서 | Yes | 검증 대상 .docx 파일명 또는 경로 | |
| 전주차 | No | 대조 기준 직전 주차 | 2026-W34 |
| 기준주차 | No | 검증 대상 주차 | 2026-W35 |
| 원본디렉터리 | No | 원본 엑셀 디렉터리 | data/원본 |
Output Schema
| Name | Required | Description |
|---|---|---|
| info | Yes | |
| error | Yes | |
| stage | Yes | 검증 워크플로에서 지금 위치한 단계 |
| status | Yes | 이 호출의 결과 상태 |
| 계층 | Yes | 이 호출이 검사한 계층 |
| 지적 | Yes | |
| warning | Yes | |
| next_actions | No | 이어서 호출하면 좋은 도구 목록 |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Annotations already declare readOnly and idempotent behavior, and the description adds meaningful context: the two-level comparison logic, the treatment of aggregation as normal, and the response shape (L3 finding list with empty report coordinates and populated source coordinates). There is no contradiction with the annotations.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The purpose is front-loaded in the first sentence, and each section—rationale, methodology, return shape, and examples—serves a clear function. The motivational paragraph is slightly longer than strictly necessary but still earns its place by explaining why this tool matters.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a read-only comparison tool with annotated safety, complete schema descriptions, defaults, and an output schema, the description covers selection, invocation, interpretation, and return format. Nothing needed to call or interpret the tool is missing.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, so the schema already documents the roles of 보고서, 전주차, 기준주차, and 원본디렉터리. The description confirms the report-vs-source comparison but adds little parameter-level detail beyond what the schema provides, so the baseline 3 applies.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The first sentence states a specific action: checking whether judgments that should appear from the source are missing from the report, and labels the level (L3). The examples and the explicit pointer to verify_claims distinguish this from the nearest sibling, so an agent can identify it as the omission-checking tool.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description gives an explicit use case ('빠뜨린 지연 과제가 있나요?') and an explicit exclusion: if checking whether written values are correct, use verify_claims. It also explains that aggregated reporting without individual items is normal, which clarifies when this tool should and should not flag an omission.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
compute_baseline_findingsARead-onlyIdempotent
원본 데이터만으로 판정 5종(신규완료·지연·일정변경·역행·미제출)을 계산합니다.
이 도구는 보고서를 입력으로 받지 않습니다. 그것이 핵심입니다. 보고서를 보고 판정을 계산하면 보고서에 이끌려, 보고서에서 빠진 항목을 영영 찾지 못합니다.
판정은 날짜·완료여부 계산으로만 합니다. 담당자가 적은 이슈리스크 텍스트는
판정에 쓰지 않습니다 — 이슈를 적지 않은 지연 과제를 잡아내는 것이 이 도구의
존재 이유입니다.
Returns: 판정응답: 구분별 건수와 판정 목록. 각 판정은 원본 좌표를 갖습니다.
Examples: - 사용: "이번 주에 보고되어야 할 변동이 뭔가요?" - 사용하지 않음: 보고서와 대조하려면 → check_completeness / verify_claims
| Name | Required | Description | Default |
|---|---|---|---|
| 구분 | No | 특정 판정만 보려면 지정. 신규완료·지연·일정변경·역행·미제출 중 하나 | |
| 전주차 | No | 대조 기준 직전 주차 | 2026-W34 |
| 기준주차 | No | 검증 대상 주차 | 2026-W35 |
| 원본디렉터리 | No | 원본 엑셀 디렉터리 | data/원본 |
Output Schema
| Name | Required | Description |
|---|---|---|
| stage | Yes | 검증 워크플로에서 지금 위치한 단계 |
| status | Yes | 이 호출의 결과 상태 |
| 구분별 | Yes | 판정 구분별 과제/단계 기준 건수 |
| 기준일 | Yes | 지연 판정의 기준일 (기준주차의 월요일) |
| 총판정 | Yes | |
| next_actions | No | 이어서 호출하면 좋은 도구 목록 |
| 판정목록 | Yes |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Annotations already declare readOnlyHint, idempotentHint, and destructiveHint, but the description adds crucial non-obvious behavior: it ignores the '이슈리스크' text and computes only from date/completion fields. It also explains the strategic rationale—catching delayed tasks that failed to write an issue—which is valuable beyond the annotations.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is front-loaded with the key constraint in bold and uses short bullets and examples. It is slightly more verbose than strictly necessary due to rhetorical rationale ('그것이 핵심입니다'), but every substantive part earns its place by preventing misuse.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the output schema exists, all parameters are optional with defaults, annotations cover safety, and the description covers purpose, non-usage, return summary, and examples, nothing essential is missing for an agent to select and invoke the tool correctly.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, with each parameter already documented including defaults and allowed values for '구분'. The description reinforces the original-data theme but does not add meaningful parameter-level detail beyond the schema, so the baseline of 3 is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description opens with a specific verb and resource: '원본 데이터만으로 판정 5종(신규완료·지연·일정변경·역행·미제출)을 계산합니다.' It explicitly distinguishes itself from report-based tools by stating it does not take reports as input, making sibling differentiation clear.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides explicit when-to-use guidance ('이번 주에 보고되어야 할 변동이 뭔가요?') and when-not-to-use guidance with named alternatives: '보고서와 대조하려면 → check_completeness / verify_claims.' It also stresses that the tool should be used for original-data-only determination, not report comparison.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
extract_report_claimsARead-onlyIdempotent
보고서에서 원본과 대조 가능한 주장을 뽑습니다.
값은 원문 문자열 그대로 담습니다. 숫자로 바꾸거나 정규화하지 않습니다 —
62 를 62.0 으로 바꿔 놓으면 반올림 오류를 반올림 오류로 지적할 수 없습니다.
표 기반 보고서는 열 이름 → 필드 매핑으로 결정적으로 뽑힙니다. 추측이 개입하지 않으므로 같은 보고서는 항상 같은 주장을 냅니다.
미검증열 에는 의도적으로 검증하지 않는 열과 그 이유가 담깁니다. 조용히
건너뛰면 "전부 검증했다"로 읽히기 때문입니다.
Returns: 주장응답: 총 주장 수, 필드별 개수, 주장 목록(잘릴 수 있음).
Examples: - 사용: "보고서가 L-08 계획완료일을 뭐라고 적었나요?" (필드="계획완료일") - 사용하지 않음: 맞는지 틀리는지 판정하려면 → verify_claims
| Name | Required | Description | Default |
|---|---|---|---|
| 필드 | No | 특정 필드만 보려면 지정. 예 금주진척률 · 계획완료일 | |
| 보고서 | Yes | 검증 대상 .docx 파일명 또는 경로 |
Output Schema
| Name | Required | Description |
|---|---|---|
| stage | Yes | 검증 워크플로에서 지금 위치한 단계 |
| status | Yes | 이 호출의 결과 상태 |
| 잘림 | Yes | True면 주장 목록이 잘렸습니다. 필드 인자로 좁혀 보세요 |
| 주장 | Yes | |
| 총주장 | Yes | |
| 필드별 | Yes | |
| next_actions | No | 이어서 호출하면 좋은 도구 목록 |
| 미검증열 | Yes | 의도적으로 검증하지 않는 열과 그 이유. 조용히 건너뛰지 않는다 |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Annotations already declare readOnlyHint=true and idempotentHint=true. The description adds substantial behavioral context: values are kept as raw strings to avoid masking rounding errors, extraction is deterministic for table-based reports, and '미검증열' explicitly discloses unverified columns with reasons. This goes well beyond the annotations.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is front-loaded with the core purpose, then gives behavioral guarantees, return summary, and examples. The '62 vs 62.0' rationale and the '미검증열' explanation are dense but purposeful; every sentence earns its place without redundancy.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the output schema and annotations, the description is complete: parameters are covered, return contents are summarized including truncation, examples show how to phrase queries, and the sibling alternative is named. Nothing needed for correct invocation appears to be missing.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100%, so the schema already documents both parameters. The description adds a concrete example of 필드 ('L-08 계획완료일') and clarifies that extracted values remain raw strings, but it does not meaningfully elaborate on the 보고서 parameter beyond the schema. This is slightly above the baseline.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description states a clear verb and resource: extracting ('뽑습니다') claims that can be checked against the original source ('원본과 대조 가능한 주장'). It also differentiates itself from verify_claims in the example, so an agent can distinguish extraction from verification without opening other tools.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description explicitly gives a '사용' vs '사용하지 않음' example: use this tool to ask what the report says, and use verify_claims instead when the task is to judge correctness. It also notes deterministic table-based extraction, which helps the agent decide when this tool is appropriate.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
flag_narrative_risksARead-onlyIdempotent
값은 맞지만 서술이 데이터와 어긋나는 후보를 표시합니다 (L4).
64일 지연된 과제를 "순조롭게 진행 중"이라고 쓴 보고서는 숫자가 전부 정확합니다. L1·L2·L3 어디에도 걸리지 않는데, 읽는 사람은 완전히 잘못된 인상을 받습니다.
이 검사는 판단하지 않고 표시만 합니다. 그 서술이 부적절한지는 문맥에 달렸고
기계는 그 차이를 모릅니다. 그래서 결과는 항상 warning 이며 저장을 막지
않습니다. 확신하지 못하는 검사에 차단 권한을 주면 정상 보고서가 막히고, 사람이
검사기를 꺼 버립니다.
표는 보지 않습니다. 표의 칸은 값이고 값의 정합은 L2 소관입니다.
Returns:
지적응답: L4 후보 목록. error 는 구조적으로 나올 수 없습니다.
Examples: - 사용: "지연된 과제를 괜찮다고 써 놓은 데가 있나요?" - 사용하지 않음: 숫자 대조 → verify_claims
| Name | Required | Description | Default |
|---|---|---|---|
| 보고서 | Yes | 검증 대상 .docx 파일명 또는 경로 | |
| 전주차 | No | 대조 기준 직전 주차 | 2026-W34 |
| 기준주차 | No | 검증 대상 주차 | 2026-W35 |
| 원본디렉터리 | No | 원본 엑셀 디렉터리 | data/원본 |
Output Schema
| Name | Required | Description |
|---|---|---|
| info | Yes | |
| error | Yes | |
| stage | Yes | 검증 워크플로에서 지금 위치한 단계 |
| status | Yes | 이 호출의 결과 상태 |
| 계층 | Yes | 이 호출이 검사한 계층 |
| 지적 | Yes | |
| warning | Yes | |
| next_actions | No | 이어서 호출하면 좋은 도구 목록 |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Beyond the annotations (readOnlyHint, idempotentHint, destructiveHint), the description adds crucial behavioral context: results are always `warning`, the tool never blocks saving, it intentionally avoids judging narrative appropriateness, and it excludes table values. This explains the tool's limitations and design rationale clearly.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is well-structured and front-loaded: the purpose is stated first, followed by an illustrative example, explicit behavioral boundaries, and usage examples. Every section earns its place, and the bold key point makes the tool's non-blocking behavior immediately visible.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the annotations, output schema, and sibling tools, the description is fully sufficient. It explains what the tool does, when to use it, when not to use it, what it returns, and why it behaves conservatively. No important operational detail is missing.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100%, so the baseline is 3. The description adds extra meaning by clarifying that the '보고서' parameter refers to the narrative text, not tables, and by illustrating the kind of mismatch it detects. It does not deeply elaborate the week or directory parameters, but the schema already documents those adequately.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool's specific function: flag candidates where values are correct but the narrative conflicts with the data (L4). It explicitly distinguishes this from L1/L2/L3 checks and gives a concrete example, so an agent can identify the exact resource and behavior.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides both a use case ('지연된 과제를 괜찮다고 써 놓은 데가 있나요?') and a non-use case with a named alternative ('숫자 대조 → verify_claims'). It also clarifies that this tool only flags, does not judge, and does not look at tables, which prevents misuse.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
list_verification_targetsARead-onlyIdempotent
검증할 수 있는 보고서와 대조 기준이 되는 원본 파일 목록을 조회합니다.
검증 작업의 출발점입니다. 여기서 얻은 파일명을 다른 도구에 넘깁니다.
Returns:
대상목록응답: 원본 엑셀 목록과 .docx 보고서 목록.
Examples: - 사용: "검증할 수 있는 보고서가 뭐가 있나요?" - 사용하지 않음: 이미 파일명을 알고 바로 검증할 때 → preview_verification_report
| Name | Required | Description | Default |
|---|---|---|---|
| 원본디렉터리 | No | 원본 엑셀이 있는 디렉터리. 기본값 data/원본 | data/원본 |
| 보고서디렉터리 | No | 검증 대상 .docx 가 있는 디렉터리. 기본값 data/보고서 | data/보고서 |
Output Schema
| Name | Required | Description |
|---|---|---|
| stage | Yes | 검증 워크플로에서 지금 위치한 단계 |
| status | Yes | 이 호출의 결과 상태 |
| 보고서 | Yes | 검증할 수 있는 .docx 목록 |
| next_actions | No | 이어서 호출하면 좋은 도구 목록 |
| 원본파일 | Yes | 마스터 파일과 제출본 목록 |
| 원본디렉터리 | Yes |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Annotations already declare readOnlyHint=true and idempotentHint=true, which covers the safety profile. The description adds context about returning two lists (original Excel and .docx reports), but this is also covered by the output schema. No contradiction with annotations, but little incremental behavioral disclosure beyond what structured fields provide.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is reasonably concise with the main purpose front-loaded. The 'Returns' section and example are useful but slightly redundant with the output schema. Overall efficient and easy to scan quickly.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a simple read-only list tool, the description is complete: annotations cover safety, output schema covers return format, and the description covers workflow position, usage examples, and exclusions. An agent has everything needed to invoke it correctly without guessing.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100% – both parameters (원본디렉터리 and 보고서디렉터리) have descriptive text in the schema. The description does not add any parameter-specific information, so it stays at the baseline of 3.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description explicitly states it queries the list of verifiable reports and original files for comparison, and includes a concrete example query. It also differentiates from the sibling tool preview_verification_report by specifying when not to use it, making the purpose unambiguous.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description clearly identifies this as the starting point of verification work, instructs the agent to pass the obtained filenames to other tools, and provides both when-to-use ('검증할 수 있는 보고서가 뭐가 있나요?') and when-not-to-use examples with an explicit alternative (preview_verification_report).
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
preview_verification_reportARead-onlyIdempotent
네 계층을 모두 돌려 지적 목록과 저장 대상, 승인 요청 문장을 돌려줍니다.
이 도구 하나로 L1·L2·L3·L4 전부를 검사합니다. 중간 도구들은 "왜 그렇게 판정했는지"를 사람에게 보여줄 때 씁니다.
승인토큰 은 지적 내용에서 계산됩니다. 지적이 하나라도 달라지면 토큰이 달라지므로,
사용자가 확인한 내용과 저장될 내용이 같다는 것을 보장할 수 있습니다.
approval_request 문장을 사용자에게 그대로 보여 주고, 명시적으로 승인받은
뒤에만 save_approved_verification 을 호출하십시오.
Returns: 미리보기응답: 지적 목록, 저장 경로, 승인토큰, 지금 쓸 수 있는 결론 후보.
Examples: - 사용: "이 보고서 검증해 주세요" - 사용하지 않음: 사용자 승인 없이 저장 → 절대 금지
| Name | Required | Description | Default |
|---|---|---|---|
| 보고서 | Yes | 검증 대상 .docx 파일명 또는 경로 | |
| 전주차 | No | 대조 기준 직전 주차 | 2026-W34 |
| 기준주차 | No | 검증 대상 주차 | 2026-W35 |
| 원본디렉터리 | No | 원본 엑셀 디렉터리 | data/원본 |
Output Schema
| Name | Required | Description |
|---|---|---|
| info | Yes | |
| error | Yes | |
| stage | Yes | 검증 워크플로에서 지금 위치한 단계 |
| status | Yes | 이 호출의 결과 상태 |
| 지적 | Yes | |
| warning | Yes | |
| 보고서 | Yes | |
| next_actions | No | 이어서 호출하면 좋은 도구 목록 |
| 결론후보 | Yes | 지금 지적 상태에서 쓸 수 있는 결론 |
| 기준주차 | Yes | |
| 승인토큰 | Yes | save_approved_verification 에 그대로 넘길 값 |
| 저장경로 | Yes | |
| approval_request | Yes | 사용자에게 그대로 보여 줄 승인 요청 문장 |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Annotations already declare readOnlyHint, idempotentHint, and destructiveHint, so the safety profile is covered. The description adds valuable non-obvious behavior: the approval token is computed from finding content so any change alters it, and the approval request must be displayed verbatim. This gives the agent the workflow-level transparency that annotations cannot express.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The core purpose is front-loaded, and the approval workflow is prominently placed near the top. There is minor redundancy between the first sentence and the explicit 'L1·L2·L3·L4 전부를 검사합니다' repetition, but the overall structure is compact and useful.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the annotations, full parameter coverage, and an output schema, the description supplies the missing operational context: token integrity, verbatim approval display, and the save-after-approval gate. An agent has enough information to select and invoke this tool correctly without ambiguity.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, and each parameter already has a clear description: report path, previous week, target week, and source directory. The description adds no additional parameter-specific detail, so the baseline of 3 is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description opens with a specific verb and resource: it runs all four verification layers and returns the finding list, storage target, and approval request sentence. It also distinguishes itself from sibling intermediate tools by stating it covers L1·L2·L3·L4 in one call.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description explicitly says intermediate tools are for showing humans why a judgment was made, implying this consolidated tool is for the full preview. It also gives a clear workflow rule: show `approval_request` verbatim and only call `save_approved_verification` after explicit user approval.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
read_reportARead-onlyIdempotent
검증 대상 보고서(.docx)의 구조를 표와 문단으로 읽습니다.
각 표에 직전 제목을 붙여 돌려줍니다. "이 표가 무엇에 대한 표인가"를 알아야 지연 표에서 빠진 과제를 찾을 수 있기 때문입니다.
Returns: 보고서응답: 표별 제목·헤더·행수와 보고서에 등장한 과제코드 목록.
Examples: - 사용: "이 보고서에 어떤 표가 들어 있나요?" - 사용하지 않음: 값을 대조하려면 → extract_report_claims → verify_claims
| Name | Required | Description | Default |
|---|---|---|---|
| 보고서 | Yes | 검증 대상 .docx 파일명 또는 경로. 예 C05.docx |
Output Schema
| Name | Required | Description |
|---|---|---|
| 표 | Yes | |
| stage | Yes | 검증 워크플로에서 지금 위치한 단계 |
| status | Yes | 이 호출의 결과 상태 |
| 파일 | Yes | |
| 표수 | Yes | |
| 문단수 | Yes | |
| next_actions | No | 이어서 호출하면 좋은 도구 목록 |
| 과제코드 | Yes | 보고서 전체에서 발견된 과제코드 |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Annotations already mark the tool as readOnly, idempotent, and non-destructive. The description adds meaningful behavioral context beyond those annotations: each table is returned with its immediately preceding heading, and the rationale for this design is explained. It also summarizes the return shape.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is compact and front-loaded, stating the core operation in the first sentence, followed by a brief behavioral rule, return summary, and short usage examples. Every sentence earns its place; the rationale for heading attachment is useful rather than filler.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a read-only single-parameter tool with an existing output schema, the description covers what the tool does, what it returns, and when not to use it. The non-obvious behavior of attaching preceding headings is explicitly stated, so an agent can invoke the tool correctly without surprises.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The single parameter is fully documented in the schema with type, title, and description including an example file name. Schema coverage is 100%, so the description need not add much; the example C05.docx provides a small extra hint but does not carry a heavy semantic burden.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
Clearly identifies the operation: reading the structure of a verification .docx report, attaching preceding headings to each table, and returning table-level metadata plus task codes. The 'not use' example explicitly contrasts with extract_report_claims and verify_claims, helping an agent distinguish it from siblings.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
Provides explicit guidance on when to use this tool (asking what tables exist in the report) and when not to use it (comparing values, in which case extract_report_claims → verify_claims is the path). This gives the agent a clear routing decision.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
read_source_dataARead-onlyIdempotent
원본 엑셀을 읽어 정규화 사실표로 만들고 그 규모를 돌려줍니다.
제출본에는 주차 열이 없으므로 기준주차를 스탬프로 찍어 적재합니다. 모든 행은 자기 좌표(파일·시트·행)를 들고 다니며, 그것이 나중에 지적의 근거가 됩니다.
Returns: 원본데이터응답: 행 수, 주차별 과제 수, 미제출 과제코드 목록.
Examples: - 사용: "원본에 몇 개 과제가 들어와 있나요?" / "누가 안 냈나요?" - 사용하지 않음: 판정 5종이 필요할 때 → compute_baseline_findings
| Name | Required | Description | Default |
|---|---|---|---|
| 전주차 | No | 대조 기준 직전 주차 | 2026-W34 |
| 기준주차 | No | 검증 대상 주차. 예 2026-W35 | 2026-W35 |
| 원본디렉터리 | No | 원본 엑셀 디렉터리 | data/원본 |
Output Schema
| Name | Required | Description |
|---|---|---|
| stage | Yes | 검증 워크플로에서 지금 위치한 단계 |
| status | Yes | 이 호출의 결과 상태 |
| 전주차 | Yes | |
| next_actions | No | 이어서 호출하면 좋은 도구 목록 |
| 기준주차 | Yes | |
| 단계행수 | Yes | |
| 요약행수 | Yes | |
| 금주과제수 | Yes | |
| 미제출과제 | Yes | 전주에 있으나 금주 제출본에 없는 과제코드 |
| 전주과제수 | Yes |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Even with readOnlyHint=true, idempotentHint=true, and destructiveHint=false in annotations, the description adds meaningful behavioral context: it stamps the baseline week onto rows, and every row carries file/sheet/row coordinates to support later issue pointing. It also discloses the output contents (row counts, per-week task counts, unsubmitted task codes), going well beyond what the annotations alone convey.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is well-structured with clear sections (main description, Returns, Examples) and front-loads the core purpose. There is slight redundancy between '그 규모를 돌려줍니다' in the first line and the 'Returns' details, but overall every section earns its place and no unnecessary content is present.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the rich input schema, full parameter documentation, annotations, output schema, and explicit use/not-use examples, the description is complete for an agent to select and invoke the tool correctly. Nothing essential about purpose, behavior, or when to use it is missing.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, so the input schema already documents all three parameters (전주차, 기준주차, 원본디렉터리) with defaults and explanations. The description does not add additional parameter-level meaning, so the baseline score of 3 is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description opens with a specific verb+resource statement: '원본 엑셀을 읽어 정규화 사실표로 만들고 그 규모를 돌려줍니다' (reads the original Excel, builds a normalized fact table, and returns its scale). It also distinguishes itself from sibling tools with the explicit not-used example routing to compute_baseline_findings, so an agent can tell it apart even without checking the schema.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The 'Examples' section explicitly states when to use the tool ('원본에 몇 개 과제가 들어와 있나요?' / '누가 안 냈나요?') and explicitly states when not to use it ('판정 5종이 필요할 때 → compute_baseline_findings'). This gives clear usage guidance and a named alternative, satisfying the highest bar for this dimension.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
save_approved_verificationAIdempotent
사용자가 승인한 검증 결과를 파일로 저장합니다. 유일한 쓰기 도구입니다.
사용자가 명시적으로 승인한 뒤에만 호출하십시오. 승인 없이 호출하지 마십시오.
저장하는 것은 지적 기록입니다. 보고서를 고치지 않습니다. 그래서 error 가
있다는 이유만으로 저장을 막지는 않습니다 — 오히려 error 가 있을 때 기록이 가장
필요합니다.
두 경우에만 거부합니다.
승인토큰이 현재 지적 내용과 맞지 않을 때. 사람이 확인하지 않은 내용이 파일로 남는 것을 막습니다. preview_verification_report 를 다시 호출하십시오.
error가 있는데 결론을 '통과' 로 적으려 할 때. 그것은 기록이 아니라 거짓입니다. '보류' 또는 '반송' 을 쓰십시오.
Returns: 저장응답: 저장 경로와 기록된 결론.
Examples: - 사용: 사용자가 "보류로 저장해 주세요"라고 승인한 뒤 - 사용하지 않음: 미리보기를 보여 주기 전 / 승인 문구가 없을 때
| Name | Required | Description | Default |
|---|---|---|---|
| 결론 | Yes | 통과 · 보류 · 반송 중 하나. error 가 있으면 '통과' 불가 | |
| 보고서 | Yes | 검증 대상 .docx 파일명 또는 경로 | |
| 전주차 | No | 대조 기준 직전 주차 | 2026-W34 |
| 기준주차 | No | 검증 대상 주차 | 2026-W35 |
| 승인토큰 | Yes | preview_verification_report 응답의 승인토큰 값 | |
| 원본디렉터리 | No | 원본 엑셀 디렉터리 | data/원본 |
Output Schema
| Name | Required | Description |
|---|---|---|
| info | Yes | |
| error | Yes | |
| stage | Yes | 검증 워크플로에서 지금 위치한 단계 |
| status | Yes | 이 호출의 결과 상태 |
| 결론 | Yes | |
| warning | Yes | |
| next_actions | No | 이어서 호출하면 좋은 도구 목록 |
| 저장경로 | Yes |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Beyond the annotations, the description explains that saving writes an intellectual record rather than modifying the report, that errors are not a reason to refuse saving, and that the tool rejects only when the approval token mismatches current findings or when an error is paired with a 'pass' conclusion. This substantially enriches the agent's understanding of the tool's behavior and failure modes.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is longer than average, but every section earns its place: safety condition, behavioral nuance, explicit rejection rules, return value, and usage examples. Critical approval guidance is front-loaded, and the structure makes the information easy to parse.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a write tool with 6 parameters, annotations, and an output schema, the description covers the critical operational context: when to call, what the token is, what causes rejection, and what the response contains. The optional file/path parameters are sufficiently documented in the schema, so nothing essential is missing.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, so the schema already documents all parameters. The description adds valuable context around 승인토큰 and 결론 constraints, but these largely reinforce schema descriptions rather than introducing new parameter-level meaning.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description opens with a clear verb and resource: saving user-approved verification results to a file, and explicitly states this is the only write tool, which distinguishes it from the sibling read/analysis tools. It immediately signals the tool's unique role in the workflow.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description gives explicit when-to-use and when-not-to-use guidance: call only after explicit user approval, never before showing the preview, and never without the approval phrase. It also names preview_verification_report as the source of the approval token and lists the two rejection conditions, providing an agent with concrete gating logic.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
verify_claimsARead-onlyIdempotent
보고서의 값을 원본과 대조합니다. L1(원본에 없음) · L2(원본과 다름).
L1 만으로는 부족합니다. L-18 의 값을 L-19 행에 옮겨 적으면 두 값 다 원본에
존재하므로 L1 은 통과합니다. 과제코드까지 맞춰 보는 L2 만이 잡습니다.
한 번의 실수가 여러 값을 틀리게 만들므로 억제 규칙이 있습니다 — 원본에 없는
과제는 그 행의 다른 값을 대조하지 않고, 미제출 과제의 금주 값은 대조하지 않으며,
파생 값(증감·경과일)은 재료가 이미 지적되면 건너뜁니다. 한 번 잘못 적은 것을
두 건으로 보고하지 않기 위한 것입니다.
반올림(0.5 이내) 차이는 error 가 아니라 warning 입니다.
Returns: 지적응답: L1·L2 지적 목록. 각 지적은 보고서 좌표와 원본 좌표를 갖습니다.
Examples: - 사용: "보고서 숫자가 원본과 맞나요?" - 사용하지 않음: 빠진 항목을 찾으려면 → check_completeness
| Name | Required | Description | Default |
|---|---|---|---|
| 보고서 | Yes | 검증 대상 .docx 파일명 또는 경로 | |
| 전주차 | No | 대조 기준 직전 주차 | 2026-W34 |
| 기준주차 | No | 검증 대상 주차 | 2026-W35 |
| 원본디렉터리 | No | 원본 엑셀 디렉터리 | data/원본 |
Output Schema
| Name | Required | Description |
|---|---|---|
| info | Yes | |
| error | Yes | |
| stage | Yes | 검증 워크플로에서 지금 위치한 단계 |
| status | Yes | 이 호출의 결과 상태 |
| 계층 | Yes | 이 호출이 검사한 계층 |
| 지적 | Yes | |
| warning | Yes | |
| next_actions | No | 이어서 호출하면 좋은 도구 목록 |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Annotations declare readOnlyHint, idempotentHint, and destructiveHint, but the description adds substantial behavioral context beyond that: L2 checks task codes, suppression rules prevent duplicate findings, derived values are skipped when their source is already flagged, and rounding tolerance maps to warning rather than error. No contradiction with annotations.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is detailed but every section earns its place: purpose, L1-vs-L2 rationale, suppression rules, rounding policy, return shape, and usage examples. The key purpose is front-loaded and the examples are compact and useful. Length is justified by the tool's non-obvious verification logic.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
The description explains the tool's core evaluation logic, edge cases, suppression behavior, rounding tolerance, and return shape. With an output schema present and full schema coverage, nothing an agent needs to invoke this tool correctly is missing. It handles a moderately complex verification task comprehensively.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, so the schema already documents all four parameters with names, defaults, and descriptions. The description adds general context about what 'verification' means and how findings are produced, but it does not add per-parameter meaning beyond the schema. Baseline 3 is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description opens with a specific verb and resource: '보고서의 값을 원본과 대조합니다' (compares report values against the original), then defines the two finding levels L1 and L2. It distinguishes itself from siblings by explicitly naming check_completeness as the tool for missing items, so an agent can select correctly.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description gives an explicit positive use case ('보고서 숫자가 원본과 맞나요?') and a negative case (missing items → check_completeness). It also documents important behavioral conditions such as suppression rules and when rounding differences become warnings, which helps the agent decide when and how to invoke the tool.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
10 tool updates
v0.1.0- First observed
check_completeness - First observed
compute_baseline_findings - First observed
extract_report_claims - First observed
flag_narrative_risks - First observed
list_verification_targets - First observed
preview_verification_report - First observed
read_report - First observed
read_source_data - First observed
save_approved_verification - First observed
verify_claims
TDQS
Scored across 10 tools
Each tool owns a distinct stage or verification level (L1/L2 vs L3 vs L4), and the descriptions explicitly cross-reference when another tool should be used instead. The aggregate preview tool is clearly positioned as a convenience wrapper over the intermediate tools, so there is no real ambiguity.
All tool names follow a consistent snake_case verb_noun pattern with specific, informative verbs: list, read, compute, extract, verify, check, flag, preview, save. The naming style is uniform and each name accurately predicts the tool's operation.
Ten tools map cleanly onto the stages of the verification pipeline: discover targets, load source, compute expected findings, parse report, extract claims, verify values, check completeness, flag narrative risks, preview, and save. The count is well-scoped and every tool has a clear purpose.
The set covers the full verification lifecycle from target discovery through source normalization, report parsing, claim extraction, multi-level checks, all-level preview, and an approval-gated save. There are no obvious dead ends: the only write tool is intentionally gated, and every intermediate tool feeds into the preview/save flow.
Maintenance
Related MCP Connectors
Verifies AI agent work end to end: real artifacts and outcomes checked, not self-reported success.
Verify work against acceptance criteria; signed receipts attest what passed and was earned.
PDF, photo, email, and file comparison evidence checks with plain-language reports.
Messy spreadsheets in, clean checkable tables out. Every result carries its arithmetic proof.
Related MCP Servers
- FlicenseNot gradedqualityCmaintenanceThis MCP server verifies that an agent’s claimed tool output matches the actual response returned by a tool to prevent invented or distorted results. It flags mismatches, omissions, and invented fields to ensure downstream logic only processes verified tool data.-
- AlicenseAqualityAmaintenanceEnables verification of AI coding agent self-reports against git diff truth and a deterministic gate, producing pass/regenerate/reject directives to ensure claimed work matches actual changes.6AGPL 3.0
- AlicenseAqualityBmaintenanceCompare design and implementation screenshots using pixel-by-pixel analysis, generating visual diff images and metrics.111 npmMIT
- AlicenseNot gradedqualityAmaintenanceDeterministic verification for AI-generated analysis. Reconciliation, consistency and Excel-integrity checks that stop the line when the numbers don't add up.45 PyPI1MIT