Skip to main content
Glama

K-Guard MCP

안경선배 · 바이브코딩 선배

만드는 흐름은 끊지 않고, 출하는 대충 넘기지 않습니다.

K-Guard MCP는 바이브코딩 결과물을 출하하기 전에 사이트, API 노출, 데이터 관리, 운영 위험을 함께 검수하는 로컬 우선 MCP 감사관입니다. Guardian은 문제가 없는 것과 아직 보지 못한 것을 구분하고, 출하 가능 / 고치고 출하 / 검수 범위 부족 판정과 다음 행동을 한국어로 돌려줍니다.

K-Guard는 인간의 사업 판단이나 법률 검토를 대신하는 보증서가 아닙니다. 시니어 개발자가 출하 전 묻는 질문과 fail-closed 게이트를 자동화합니다.

5분 설치 · 설치·디자인 검증 · 사용 가이드 · GitHub 공개 안내 · 필수 qualification · 제품 북극성 · 전체 도그푸드 판정 · 2026 대회 출품 준비

첫 5분: 현재 소스 체크아웃

아직 공개 패키지 인덱스 배포를 전제로 하지 않습니다. 처음 실행할 때는 저장소 루트에서 현재 소스를 설치하고, 안경선배가 보여주는 다음 행동을 따라갑니다.

python -m pip install .
k-guard install --client auto --profile local-dev --workspace .
k-guard doctor --client auto

auto는 설치된 Grok, Codex, Antigravity를 찾아 사용자 범위에 k-guard MCP를 병합하고, OpenAI tunnel-client가 있으면 ChatGPT용 로컬 profile을 준비합니다. --workspace .은 지금 프로젝트를 private binding으로 고정합니다. 이후 MCP가 다른 working directory에서 시작돼도 이 프로젝트를 검사하며, 경계 밖 경로는 high HOLD로 거부합니다. ChatGPT doctor/run에는 Tunnels Read + Use 권한의 CONTROL_PLANE_API_KEY도 현재 셸에 필요합니다. ChatGPT는 그 뒤 tunnel-client run과 개발자 모드 앱 연결이 남으므로 설치기는 성공으로 꾸미지 않고 부분 연결 · 다음 단계 필요를 반환합니다. 기존 설정은 보존하고 JSON 변경 전에는 백업을 만들며, 운영자 evidence key와 workspace 원문은 ~/.k-guard의 사용자 전용 파일에만 저장합니다. local-dev는 localhost read-only probe와 작은 고정 심화 경로만 켜며 외부·세션 probe는 계속 꺼 둡니다. 정적 검사만 필요하면 --profile workspace를 사용합니다.

설치와 진단의 기본 출력은 연결 준비 → AI 클라이언트 → 다음 행동 세 단계다. 자동화는 install --json, doctor --json을 사용합니다. 공모전 심사·릴리스 재현과 코드 수정은 5분 설치의 심사·재현 검증 경로를 사용해 build·evidence lock을 --require-hashes로 설치합니다. Semgrep 1.174.0과 pip-audit 2.10.1도 각각 requirements-semgrep.lock, requirements-pip-audit.lock의 전체 hash closure를 격리 venv에 설치해 감사 대상 런타임을 변형하지 않습니다.

MCP 클라이언트에서:

안경선배로 이 앱을 끝까지 봐줘. check_my_app으로 전체 검수를 시작하고,
continue_review를 state=completed 또는 failed가 될 때까지 반복해줘.
완료 전에는 통과라고 말하지 마. 코드를 고쳤다면 check_my_app을 다시 완료해줘.
출하 전에는 실제 사업 목적과 범위를 확인한 뒤 최신 review_id로
start_review_before_ship을 실행하고 다시 continue_review로 Guardian 완료까지 기다려줘.
experience.presentation 순서대로 판정, 이유, 다음 행동 3개만 먼저 말해줘.

check_my_app은 5초 안에 대충 끝내는 검사가 아니라 전체 워크스페이스 감사를 접수하는 도구입니다. 첫 응답은 review_in_progress이며 continue_review가 완료될 때까지 출하 판단을 내리지 않습니다. dist, build, .next의 배포용 텍스트 산출물도 검사하고, 후보 개수·경로 SHA-256·읽기 완료가 맞지 않으면 high로 막습니다. 완료 결과는 workspace와 source tree SHA-256에 묶인 review_receipt를 냅니다. 코드가 바뀌면 예전 review_id로 출하 검수를 시작할 수 없고 check_my_app을 다시 완료해야 합니다.

Related MCP server: VibeGuard MCP Server

안경선배 판정

코드

뜻

다음 행동

ship

설정한 범위와 high 기준에서 출하 가능

같은 커밋의 보고서와 증거 보관

hold_fix

blocking finding 존재

suggest_fix 후 같은 게이트 재실행

hold_coverage

동적 검사·흐름·목적·범위 증거 부족

빠진 검수 영역부터 채우기

hold_authority

단일 앱 결속·운영자 서명 증거 부족

동일 app_id와 K_GUARD_EVIDENCE_HMAC_KEY로 재실행

hold_qualification

앱 위험과 별개로 감사 도구의 deep·SCA·runtime·DB·field 자격 증거 부족

application_assurance와 auditor_qualification을 분리해 확인

review_only

검토용 보고서만 생성

fail_on=high로 출하 판정 실행

모든 대표 결과는 experience.presentation과 호환 alias인 experience.details.presentation을 함께 제공하며 순서는 verdict → why → next_actions → details로 고정됩니다. Guardian은 앱 위험을 application_assurance, 감사 도구 자체의 검증 상태를 auditor_qualification로 따로 보여줍니다. experience.verdict_code, experience.verdict_message, experience.summary는 기존 보고서 호환 필드입니다.

무엇을 보나

K-Guard combines:

  • Static scan: Korean PII, composite PII, Korean organization identifiers (사업자등록번호 checksum syntax validation; 법인등록번호 historical Annex checksum or post-2025-01-31 4+2+7 explicit-context/syntax recognition, not live registry validation), secrets

  • Config scan: CORS/debug/source map/env prefix risks

  • Senior app-risk scan: direct request-to-SQL/command/file/URL/HTML sinks, mass assignment, open redirect, browser token storage, weak cookies, plaintext password comparison, and JWT decode-without-verify

  • Korean data-governance scan: unique/sensitive field declarations, encryption/access-control evidence, access logging, external processor review, retention, and erasure

  • MCP-native threat scan: hidden instructions, tool poisoning, exfiltration intent, and overbroad local access across direct text plus bounded Unicode/confusable, escaped/percent/HTML, Base64, split-fragment, and three-line rolling normalization

  • Structured MCP config review: shell wrappers, mutable package launchers, plain remote HTTP, fixed credentials, unsafe links/read failures, and fail-closed discovery bounds across project/Codex/Grok/Antigravity config candidates

  • YARA-lite local rule pack: prompt-injection markers, exfil command markers, Korean bulk schema hints

  • Safe dynamic probe: localhost HTTP checks, explicitly authorized external-origin checks, optional bounded deep exposure checks, plus optional user-provided read-only session headers

  • Data Flow Risk Map: heuristic graph plus Python AST and lightweight JS/TS source -> sink taint analysis, including unique-import Python helper parameter-to-sink summaries and limited JS/TS route-to-service IDOR summaries

  • MCP runtime observer/interceptor: JSON/JSONL and stream-ready event checks for hidden instruction, PII-to-agentic/external sink flow, plus batch block/redact enforcement for forwarded event streams

  • Semgrep deep adapter: offline 40-rule profile, exact scanned-target proof, pinned 1.174.0 identity, source snapshot binding, and fail-closed JS/TS/Python/Java/Kotlin/Go/PHP/Ruby/C# findings

  • Nine-language validation pack: Python/JavaScript/TypeScript/Java/Kotlin/Go/PHP/Ruby/C# 90 pinned vulnerable/clean cases, TP/FN/FP/TN scoring, and exact two-run fingerprint reproduction

  • Software composition analysis: bounded Python/npm/Go manifest and lock coverage with pip-audit, npm audit, and govulncheck; partial engine, lock, output, or source-drift failure blocks release

  • Streamable HTTP MCP proxy: POST/GET SSE/DELETE complete mediation, principal-bound lifecycle, default-deny JIT/JEA grants, filtered tool inventory, bounded streams, and HMAC-chained raw-free audit logs

  • Database controls: SQLGlot AST allowlist, role/database/schema/table/column RBAC, EXPLAIN-before-read, SQLite query-only authorizer, path containment, and row/cell/result/time budgets

  • Read-only connectors: local SQLite, log, JSON/CSV/TSV storage sampling without raw value storage; connector gaps become high findings

  • Retention/deletion review: flags missing retention/deletion markers when personal-data signals exist

  • Cross-plane verdicts: correlates Korean PII findings with LLM/MCP/external/data-at-rest sink evidence

  • FP/FN scoreboard: fixture corpus recall and false-positive rate. FPR uses measurable_negative_count as denominator (clean negatives with no expected_absent); negative_count is all declared negatives and targeted_absence_case_count covers selected-rule absences that do not enter the FPR denominator. A zero measurable-negative denominator is reported as FPR 0.0.

  • SARIF/CI output: fail builds on configured severities

  • korean_senior Guardian profile: fail-closed four-domain contract for site security, API exposure, data management, and operational risk

  • Primary MCP tools: check_my_app, continue_review, start_review_before_ship; internal canonical engine: Guardian high; guided prompt: guided_review

  • Advanced MCP tools: scan_workspace, deep_analyzer_audit, validate_multilang_pack, software_composition_audit, validate_policy_controls, validate_streamable_http_runtime, scan_text, scan_diff, scan_mcp_config, probe_http, build_flow_map, observe_mcp_events, enforce_mcp_events, observe_mcp_event, score_fixture_corpus, data_release_gate, create_field_campaign_template, field_campaign_status, create_guardian_manifest_template, guardian_audit, explain_rule, suggest_fix, security_gate

설치 경계

release workflow가 만든 정확한 wheel과 함께 배포된 requirements-evidence.lock을 받은 사용자는 저장소 없이 아래처럼 감사된 dependency closure를 재현할 수 있습니다. k-guard, k-guard-dashboard, k-guard-mcp, python -m k_guard_mcp.cli, python -m k_guard_mcp.server는 설치된 wheel의 명령입니다.

release에는 SHA256SUMS, GitHub OIDC로 서명된 SLSA provenance bundle, CycloneDX SBOM attestation bundle도 포함됩니다. 온라인에서는 gh attestation verify ./k_guard_mcp-0.1.0-py3-none-any.whl -R windmillstudio/k-guard-mcp로 빌드 주체와 digest를 확인한 뒤 설치합니다. checksum만 맞고 attestation이 검증되지 않으면 공식 release artifact로 취급하지 않습니다.

python -m pip install --require-hashes -r ./requirements-evidence.lock
python -m pip install --no-deps ./k_guard_mcp-0.1.0-py3-none-any.whl
k-guard --help
k-guard install --client auto --profile local-dev --workspace .
k-guard doctor --client auto

Windows 애플리케이션 제어 정책이 pip의 k-guard.exe 콘솔 런처를 차단하는 관리형 PC에서는 같은 wheel의 모듈 진입점을 사용합니다. 기능과 판정 계약은 동일합니다.

python -m k_guard_mcp.cli --help
python -m k_guard_mcp.cli install --client auto --profile local-dev --workspace .
python -m k_guard_mcp.cli doctor --client auto

wheel만 설치하면 런타임 명령만 제공됩니다. release sdist와 저장소 체크아웃에는 scripts/..., tests/fixtures/..., 검증 템플릿이 포함됩니다. 개발 환경은 저장소 루트에서 두 lock을 --require-hashes로 설치한 뒤 python -m pip install --no-build-isolation --no-deps -e .로 준비합니다. evidence lock은 릴리스 dependency closure의 버전과 허용 SHA-256을 함께 고정하며, 라이선스·취약점·SBOM·fresh-wheel smoke가 같은 파일을 사용합니다.

안경선배 검수실

권한 있는 사이트를 화면에서 확인하려면 로컬 대시보드를 실행합니다.

k-guard-dashboard --port 8765

브라우저에서 http://127.0.0.1:8765/를 엽니다. 화면은 선배 판정 → 발견 → 검사 로그 → 노출 지도 순서이며, 최종 출하 권한은 화면이 아니라 MCP의 start_review_before_ship에만 있습니다. 브랜드 이미지는 프로젝트용으로 생성한 원본 자산이며 provenance는 docs/brand-assets.md에 기록합니다.

설치된 wheel CLI

아래 명령 중 tests/fixtures/korean_fixture_corpus.json은 소스 체크아웃에서 바로 실행할 수 있는 공개 예제 corpus입니다. wheel만 설치한 사용자는 같은 스키마의 자체 fixture 경로로 바꿉니다.

python -m k_guard_mcp.cli scan .
python -m k_guard_mcp.cli scan . --json report.json --markdown report.md
python -m k_guard_mcp.cli scan . --sarif k-guard.sarif --fail-on high
python -m k_guard_mcp.cli probe http://localhost:3000
python -m k_guard_mcp.cli probe http://localhost:3000 --deep-active
python -m k_guard_mcp.cli probe http://localhost:3000 --session-file session.headers.json --json
python -m k_guard_mcp.cli probe https://staging.example.com --allow-external --authorization-note "owned staging domain" --json
python -m k_guard_mcp.cli flow . --svg flow.svg --html flow.html
python -m k_guard_mcp.cli observe-mcp --events mcp-events.jsonl --json
python -m k_guard_mcp.cli mcp-proxy --report mcp-proxy-report.json --response-timeout 30 -- python -m your_upstream_mcp_server
python -m k_guard_mcp.cli mcp-http-proxy --upstream http://127.0.0.1:9000/mcp --port 8765 --report mcp-http-proxy.json --receipt-log mcp-http-proxy.receipts.jsonl
python -m k_guard_mcp.cli deep-analyze . --output deep-analyzer.json
python -m k_guard_mcp.cli language-validate --output language-validation.json
python -m k_guard_mcp.cli sca . --output sca.json
python -m k_guard_mcp.cli control-validate --output control-validation.json
python -m k_guard_mcp.cli runtime-validate --output runtime-validation.json
python -m k_guard_mcp.cli access-policy-template --output access-policy.json
python -m k_guard_mcp.cli agent-grant --policy access-policy.json --output agent.jwt --app-id APP --session-id SESSION --purpose RELEASE_REVIEW --subject AGENT --role release-reviewer --method tools/list --method tools/call --tool check_my_app --tool start_review_before_ship
python -m k_guard_mcp.cli score-corpus --corpus tests/fixtures/korean_fixture_corpus.json --output fixture-metrics.json --json
python -m k_guard_mcp.cli benchmark-template --output benchmarks/field-benchmark-template.csv
python -m k_guard_mcp.cli benchmark --manifest benchmarks/field-benchmark-template.csv --output field-benchmark.json --markdown field-benchmark.md --html field-benchmark.html
python -m k_guard_mcp.cli guardian-template --output benchmarks/guardian-targets.csv
python -m k_guard_mcp.cli suppression-template --output .k-guard/suppressions.csv
python -m k_guard_mcp.cli field-campaign-template --output benchmarks/field-app-roster.csv
python -m k_guard_mcp.cli field-campaign-status --roster benchmarks/field-app-roster.csv --output field-campaign-status.json
python -m k_guard_mcp.cli field-validation-template --ground-truth-output benchmarks/field-ground-truth.csv --review-output benchmarks/field-review.csv
python -m k_guard_mcp.cli field-validation-sign --ground-truth benchmarks/field-ground-truth.csv
python -m k_guard_mcp.cli field-validation-preregister --roster benchmarks/field-app-roster.csv --ground-truth benchmarks/field-ground-truth.csv --custodian-id split-custodian-a --output benchmarks/field-preregistration.json
python -m k_guard_mcp.cli guardian --manifest benchmarks/guardian-targets.csv --output guardian-report.json --markdown guardian-report.md --html guardian-report.html
python -m k_guard_mcp.cli guardian --manifest benchmarks/guardian-targets.csv --suppressions .k-guard/suppressions.csv --fail-on high --run-probes --run-sca --language-validation-report language-validation.json --mcp-http-proxy-report runtime-validation.json --control-validation-report control-validation.json --field-validation-report field-validation.json --output guardian-gate.json
python -m k_guard_mcp.cli field-validation-queue --guardian-report guardian-gate.json --output benchmarks/field-review.csv
python -m k_guard_mcp.cli field-validation-sign --review benchmarks/field-review.csv
python -m k_guard_mcp.cli field-validation-report --guardian-report guardian-gate.json --repeat-guardian-report guardian-gate-repeat.json --roster benchmarks/field-app-roster.csv --ground-truth benchmarks/field-ground-truth.csv --review benchmarks/field-review.csv --preregistration benchmarks/field-preregistration.json --profile field --output field-validation.json
python -m k_guard_mcp.cli mcp-intercept --events mcp-events.jsonl --forwarded-output forwarded.jsonl --report intercept-report.json --app-id YOUR_APP_ID --session-id RELEASE_SESSION_ID --guardian-report guardian-gate.json --fail-on-block
python -m k_guard_mcp.cli data-release-gate --guardian-report guardian-gate.json --guardian-manifest .k-guard/guardian-targets.csv --validation-source-guardian-report validation-source-guardian.json --validation-repeat-guardian-report validation-source-guardian-repeat.json --validation-report field-validation.json --validation-review benchmarks/field-review.csv --validation-ground-truth benchmarks/field-ground-truth.csv --validation-preregistration benchmarks/field-preregistration.json --validation-roster benchmarks/field-app-roster.csv --korean-fixture-corpus tests/fixtures/korean_fixture_corpus.json --korean-corpus-report fixture-metrics.json --mcp-intercept-report intercept-report.json --mcp-forwarded-output forwarded.jsonl --output data-release-gate.json

session.headers.json is short-lived and bound to one exact origin. Guardian only counts an authenticated comparison as complete when the asserted identity response also matches:

{
  "origin": "http://localhost:3000",
  "expires_at": "2026-07-14T12:30:00+09:00",
  "headers": {"Cookie": "session=<local-test-session>"},
  "identity_assertion": {
    "path": "/api/me",
    "expected_status": 200,
    "expected_body_sha256": "<64 lowercase hex characters>"
  }
}

Keep the file inside the invoked workspace, or beside the Guardian manifest. Files outside that boundary, links, expired sessions, mismatched origins, unsupported headers, and oversized files fail closed. The digest covers the exact bounded response bytes before UTF-8 decoding; raw session values and response bodies are not written to findings.

소스 체크아웃 전용 검증

아래 scripts/**와 pytest는 wheel에 포함되는 사용자 명령이 아닙니다.

이 공개 소스 스냅샷에서 재현 가능한 제품 회귀는 python scripts/public_source_tests.py입니다. 내부 전체 저장소의 python -m pytest -q full suite는 별도 배포되는 evidence, 공모전 문서, 릴리스 바이너리, 커밋된 Git 경계가 필요하므로 이 공개 체크아웃에서 실행 가능하다고 주장하지 않습니다.

python scripts/public_source_tests.py
python scripts/site_scale_calibration.py
python scripts/deep_probe_synthetic_calibration.py --targets 500 --output tmp/deep-probe-synthetic-500.json --markdown tmp/deep-probe-synthetic-500.md --html tmp/deep-probe-synthetic-500.html
python scripts/inner_core_product_gate.py --targets 500 --output tmp/inner-core-product-gate-500.json --markdown tmp/inner-core-product-gate-500.md --html tmp/inner-core-product-gate-500.html
python scripts/mcp_evasion_calibration.py --output evidence/regression/mcp-evasion-normalization.json
python examples/contest-demo/v1/demo.py run
python scripts/contest_readiness.py --output contest-readiness-report.json --markdown contest-readiness-report.md
python scripts/build_top_domain_manifest.py --output datasets/tranco-passive-homepage-10k.csv --limit 10000
python scripts/passive_homepage_calibration.py --targets datasets/tranco-passive-homepage-10k.csv --output reports/passive-homepage-10k-summary.json --checkpoint-jsonl reports/passive-homepage-10k-checkpoint.jsonl --max-targets 10000 --delay-ms 500

전체 소스 회귀의 Coverage gate 90.00%는 statement와 branch opportunity를 함께 계산한 branch-inclusive combined coverage입니다. branch 자체가 90%라는 뜻이 아니며, precision=2와 fail_under=90을 사용하므로 89.90%는 실패합니다. 공개 저장소 CI의 public_source_only 범위는 별도 배포 증거·native case를 제외하므로 전체 88%, redaction.py 85% 문턱을 적용하며 두 수치를 서로 바꿔 주장하지 않습니다.

소스 체크아웃 Release Hygiene

Use the release hygiene check before CTO review or publish prep:

python scripts/release_hygiene.py --json

Default mode validates that a dirty release-candidate worktree is classified, free of visible runtime scratch output, and free of unresolved review-required artifacts. Use --strict-clean after the intended release commit; strict mode also compares every package build input byte with its Git index blob. Tagged publication additionally requires --expected-tag v{project.version}, and that exact tag must resolve to the checked-out HEAD commit. The release workflow waits for the reusable Windows/macOS/Linux CI matrix, creates attestations, and publishes the tag artifacts as a GitHub Release. Details are in docs/release-hygiene.md.

The Guardian Actions template currently installs the exact K-Guard source checkout selected by the workflow commit; it does not assume a PyPI package. Before copying it to another repository, vendor K-Guard at a commit-pinned path and set K_GUARD_SOURCE_PATH. After release artifacts exist, consumers should pin either an exact wheel plus its published SHA-256, or a full 40-character Git commit in a direct-reference requirement. Replace the placeholders only with an actual release location:

k-guard-mcp @ https://<artifact-host>/<exact-wheel>.whl#sha256=<published-sha256>
k-guard-mcp @ git+https://<repository-url>.git@<40-character-commit>

K-Guard's primary license is MIT. Apache-2.0 upstream attribution, reviewed revisions, modified-file mapping, and excluded license boundaries are recorded in THIRD_PARTY_NOTICES.md and docs/upstream-adoption.md.

MCP

python -m pip install --require-hashes -r requirements-build.lock
python -m pip install --require-hashes -r requirements-evidence.lock
python -m pip install --no-build-isolation --no-deps .
k-guard-mcp

MCP probe_http is disabled by default. Enable it only for trusted audit sessions:

K_GUARD_MCP_ENABLE_PROBE=1 python -m k_guard_mcp.server

Authenticated read-only probing through MCP also requires K_GUARD_MCP_ENABLE_SESSION_PROBE=1 and a short-lived, origin-bound local session_file. Header values are read locally and are not written to findings. A header alone never proves login: Guardian requires the optional identity_assertion to match before authenticated comparison coverage can pass.

Bounded deep active probing through MCP also requires K_GUARD_MCP_ENABLE_DEEP_ACTIVE_PROBE=1 and probe_http(..., deep_active=true). This mode checks a small fixed list of exposed env/git/backup/debug paths and still avoids login attempts, mutations, fuzzing, and exploit payloads.

Authorized external probing through MCP also requires K_GUARD_MCP_ENABLE_EXTERNAL_PROBE=1 plus either K_GUARD_MCP_EXTERNAL_ALLOWED_HOSTS=example.com,staging.example.com or a per-call external_authorized=true with an authorization_note. The report records the authorization basis with DYN_EXTERNAL_TARGET_AUTHORIZATION_AUDIT.

설치와 연결은 ChatGPT, Grok, Codex, Antigravity 네 클라이언트에 맞췄으며 자세한 절차는 docs/quickstart-ko.md와 docs/mcp-client-install.md에 있습니다.

공모전 결과보고서와 실제 호환성 증거를 준비할 때는 docs/contest-2026-result-report-draft-ko.md와 docs/client-interop-evidence-kit-ko.md를 사용합니다. 실제 호환 완료는 클라이언트별 install → restart → tool list → check_my_app → reconnect 녹화, 고유 SHA-256, 별도 검토가 모두 있는 범위만 집계합니다.

MCP calls also enforce argument and inline-text budgets by default:

  • K_GUARD_MCP_MAX_FILES=1000

  • K_GUARD_MCP_MAX_MB=10

  • K_GUARD_MCP_MAX_TEXT_MB=1

  • K_GUARD_MCP_MAX_ARG_CHARS=4096

  • K_GUARD_MCP_GUARDIAN_MAX_TARGETS=100

  • K_GUARD_MCP_GUARDIAN_MAX_REQUESTS=200

Guardian MCP calls preflight the whole manifest against the target, filtered-file, byte, and projected HTTP-request budgets. File expansion is bounded at the configured limit plus one detection entry, so an oversized tree is rejected without first enumerating the entire tree. Oversized multi-target work returns a Guardian-shaped fail-closed report; use the CLI or split the manifest for intentionally larger batches. Dynamic HTTP inspection reads at most 1 MiB per response by default and also stops at 16 MiB, 80 requests, or 30 seconds per probe run.

Safety Defaults

  • JSON/Markdown/MCP outputs pass through a central redaction layer

  • SARIF output also passes through the same redaction layer and stores raw-free evidence

  • Dynamic probe only allows localhost, 127.0.0.1, and ::1 by default

  • External dynamic probe requires explicit authorization evidence and opt-in, then remains fixed-path, read-only, same-origin, and no-redirect. Each request resolves only allowlisted public addresses and connects to the selected validated IP while preserving the original HTTP Host/TLS SNI.

  • Dynamic probe does not follow redirects to non-allowlisted hosts

  • Dynamic probe uses non-destructive HTTP methods only

  • --deep-active is a bounded authorized check for common exposed .env, .git/config, backup/dump, and debug/runtime paths. It is not recursive crawling, password guessing, exploit payloading, or a path brute-force dictionary.

  • Dynamic probe uses a timeout and caps sampled response bodies

  • External secret validity checks are not performed

Severity and Confidence

Severity values are validated centrally:

  • critical: credential/private-key/DB URL exposure, direct high-risk identifiers, or unauthenticated sensitive routes

  • high: strongly identifying combinations, risky localhost exposure, or sensitive flow candidates

  • medium: standalone contact/location/config signals and hardening findings

  • low: weak heuristic signals

  • info: informational observations

Confidence values are high, medium, and low.

Data Flow And Inner-Core Limits

The flow map is explicitly EXPERIMENTAL and marked as heuristic+ast-taint+js-ts-taint with line-distance+python-intra-procedural-ast+js-ts-intra-file+limited-interprocedural-taint precision. It is a developer triage aid: Python AST taint is supported, and JS/TS now has lightweight intra-file taint, limited route-to-service summaries, plus framework-aware heuristics for Next.js route handlers/server actions, Express IDOR-shaped route params, Supabase service-role/RLS boundary hints, and Firebase Admin auth-boundary hints. Full TypeScript type checking, alias-complete import resolution, middleware proof, deployed RLS/Firebase rule proof, and complete inter-procedural taint remain roadmap items. Flow findings include raw-free source/sink line hashes to make evidence reproducible without echoing sensitive values. Flow visualizations are generated as local SVG/HTML without external JavaScript or CDN dependencies. The same redaction layer protects JSON, Markdown, SVG, HTML, and MCP responses.

Runtime MCP observation ingests JSONL/JSON event exports through observe_mcp_events and can also evaluate one event at a time through observe_mcp_event(session_id=...). CLI mcp-intercept applies those block and redact decisions to a batch event stream before writing forwarded JSONL. CLI mcp-proxy -- <upstream argv> is the live enforcement path for line-delimited stdio JSON-RPC. CLI mcp-http-proxy --upstream <URL> enforces the same policy across Streamable HTTP POST, GET SSE, and DELETE session lifecycles, with official Python MCP SDK interoperability coverage. Both proxies emit the same raw-free, transaction-linked HMAC receipt chain for access deny and content allow/redact/block decisions; configured sidecar persistence happens before forwarding and fails closed. Operator-secret verification is required for tamper-resistance claims because HMAC is a shared-secret tag, not a public-key signature. Both proxies fail closed on invalid framing, correlation errors, size or timeout limits, and transport control failures. Streaming observer state has bounded idle/LRU session retention. MCP enforce_mcp_events remains report-only. Binary framing, nonstandard transports, and a universal drop-in proxy for every MCP client remain roadmap work.

Read-only connectors inspect local SQLite/log/storage files only. Remote Postgres/Supabase/Firebase/S3, backups, and actual deletion execution are roadmap items.

Feedback Drift Loop

k-guard feedback --type fn --rule PII_PHONE --text "missed sample" --output feedback.jsonl
k-guard feedback-export --input feedback.jsonl --output feedback-summary.json --reviewed

Feedback files are sanitized before write and summarized locally for corpus tuning. False-negative snippets use extra conservative token masking because the detector may have missed the sensitive value. feedback-export requires --reviewed or K_GUARD_FEEDBACK_EXPORT_REVIEWED=1 so accidental automated exports fail closed. Review feedback-summary.json before sharing it outside the partner environment; do not transmit raw feedback.jsonl.

Field Benchmark

benchmark-template creates a 20/20/10 manifest:

  • 20 general baseline sites or reports

  • 20 vibe-coded suspected sites or reports

  • 10 owned, partner-approved, or bug-bounty scoped targets

benchmark aggregates raw-free K-Guard JSON reports and, only with --run-probes, authorized manifest rows marked mode=probe. It reports high/critical target rate, strong-identifier detection rate, top rules, and manual false-positive rate by cohort. The default path is report-only so benchmark work can start from dashboard exports without touching external sites.

The same workflow is available through MCP as create_benchmark_template and field_benchmark. MCP benchmark probes require the same explicit probe opt-ins as probe_http.

Guardian Mode

guardian-template creates an authorized target manifest for continuous product guarding. A row can point to a local workspace, an HTTP origin, an MCP runtime JSONL export, or an existing raw-free K-Guard JSON report. guardian aggregates all rows into one raw-free report with per-target gates, new/resolved finding drift, top recurring rules, and fix recipes from suggest_fix.

Guardian manifests also carry raw-free business-intent and scope assertion fields: business_purpose, data_classes, user_scope, public_endpoints, scope_basis, and scope_proof_ref. K-Guard does not claim human-level business understanding or prove ownership by itself; it records whether those assertions exist and stores only hashed refs. Scope completion requires an explicit scope_proof_ref; locators and legacy authorization notes are not treated as proof. Data-release gating requires those target-level contracts and verified operator-keyed evidence bundles whose artifact hashes match the current report before treating a report as shipment evidence.

New templates set audit_profile=korean_senior. In this profile a release gate does not pass merely because it found zero blockers. It also requires a substantive workspace with at least one supported and successfully decoded production source file, flow analysis, a completed deep HTTP review, declared endpoint paths that actually return 2xx/3xx/401/403 rather than only 404, and explicit purpose/data/user/scope assertions. Guardian content-hashes each workspace immediately before and after its audit; a mismatch emits GUARDIAN_SOURCE_CHANGED_DURING_AUDIT, blocks the target, and excludes that run from substantive coverage. Use an immutable CI checkout for release authority. The report exposes review_contract.domains for site_security, api_exposure, data_management, and operational_risk; guardian_gate.passed remains false when any required domain is incomplete. Legacy manifests without audit_profile remain on the narrower standard profile and must not be presented as four-domain senior coverage.

public_endpoints is executable review scope, not decorative metadata. Guardian safely adds valid same-origin paths from that field to the fixed GET/OPTIONS probe set (maximum 50; no absolute URL, parent traversal, or templated path). This lets the API review cover app-specific read-only endpoints while keeping the probe bounded.

When an HTTP row includes session_file, Guardian runs the same bounded path set twice: once unauthenticated and once with the operator-provided read-only session. This keeps public exposure checks visible instead of replacing them with an authenticated-only view. The session must prove both an auth-wall transition and the declared identity response digest. A korean_senior gate rejects HTTP coverage when either proof is absent, when a probe produced request or control errors, or when no valid declared endpoint scope was reached.

guardian --fail-on high is the canonical pre-release gate. It is the workflow to use when K-Guard should decide whether a target app can ship under a configured threshold. Workspace-only scan --fail-on and MCP security_gate are quick checks; they do not replace Guardian's manifest, coverage-gap, drift, and multi-target execution contract.

By default, guardian writes a report and exits successfully so teams can review findings without turning it into a release blocker. Use --fail-on high when the same report should act as a CI gate; it exits with code 3 when blocking targets or new blocking findings are present. On the first run without --previous, the report is an initial_snapshot: current blockers and coverage gaps can still fail the gate, but K-Guard does not label every current finding as new drift. In gate mode, HTTP rows in the manifest must actually execute via --run-probes or they become coverage gaps instead of silent passes.

HTTP rows are not executed unless --run-probes is passed. The CLI path is for a trusted local operator and uses explicit CLI flags/manifest rows as its opt-in. MCP is agent-mediated and stricter: guardian_audit(..., run_probes=true) requires K_GUARD_MCP_ENABLE_PROBE=1; manifests that request external, deep-active, or session probes additionally require K_GUARD_MCP_ENABLE_EXTERNAL_PROBE=1, K_GUARD_MCP_ENABLE_DEEP_ACTIVE_PROBE=1, or K_GUARD_MCP_ENABLE_SESSION_PROBE=1 respectively. Guardian mode still uses fixed safe GET/OPTIONS probes and does not perform login attempts, password guessing, mutation, exploit payloads, recursive crawling, or cross-host redirect following.

MCP clients should pass fail_on="high" to guardian_audit for the canonical release-gate verdict in guardian_gate.passed; process exit codes remain a CLI concern. Use --previous previous-guardian-report.json to turn the report into a drift monitor. New blocking findings are listed separately only when a previous report is loaded; combine --previous with --fail-on when those findings should stop a release. If MCP control checks stop guardian before target execution, report mode and gate mode both return a guardian-shaped response with execution_contract, summary, and findings; gate mode additionally includes guardian_gate.passed=false. The report includes an execution_contract section so skipped, errored, and executed targets are visible in one place, including Markdown and HTML exports.

MCP security_gate(path, fail_on) is a quick workspace-only gate. It now returns security_gate.passed=false on MCP control failures such as invalid thresholds, argument budgets, workspace budget limits, or scan exceptions, but it intentionally reports coverage_model="workspace_only". Use Guardian for release decisions that need HTTP targets, MCP runtime exports, prior reports, or coverage-gap accounting.

Suppression policy is fail-closed. suppression-template creates a CSV that binds every waiver to app_id, audit_profile, the current source snapshot or review-evidence hash, target_id, finding fingerprint, owner, reason, and future expiry. A waiver cannot be replayed against another app or changed release snapshot; invalid, stale, or expired rows add a high-severity policy finding. Suppressions cannot clear Guardian coverage gaps or MCP control-failure rules. field-validation-queue exports every high/critical candidate with a redacted fingerprint, detector subtype, artifact scope, file/body/header location kind, and available response hash. The strict field-validation-report --profile field claim remains closed until 12-20 owned/partner apps, 120 labeled cases, 50 positives, 40 negatives, five critical cases, three strata, a preregistered holdout with at least 70 cases, 35 positives, 35 negatives and 35 candidates, role-separated reviewer/custodian signatures, and an exact second canonical Guardian execution pass all fixed thresholds. Overall/holdout precision, holdout high/critical recall, and holdout specificity must pass both the point estimate and Wilson 95% lower-bound floor; critical holdout recall remains exactly 1.0. Every candidate must bind to exactly one frozen development/holdout scope. Candidate (false_positive + benign) / (true_positive + false_positive + benign) is reported as false discovery rate; false-positive rate is calculated only over clean cases as FP / (FP + TN). The data-release gate is stricter: any known false negative or benign high/critical candidate blocks release. K_GUARD_FIELD_REVIEWER_HMAC_KEYS and K_GUARD_FIELD_CUSTODIAN_HMAC_KEY must be distinct from the operator evidence key; these local HMACs separate roles but do not prove real-world identity or cryptographically independent execution. Legacy validation-* commands aggregate candidate labels only and cannot establish field recall.

The public automatic-block qualification contract is separate from field validation. release_blocker_actionability_v3 requires a preregistered census of at least 100 automatic blockers, 0.90 candidate actionability, and a 0.80 Wilson 95% lower bound. It also requires automatic blockers in at least 20 applications. An application counts as fully actionable only when every automatic blocker in that application is labeled true_positive; both its fully-actionable application rate and Wilson lower bound must pass 0.90 and 0.80. This app-level sensitivity gate prevents dozens of correlated lines in one repository from creating false statistical confidence. Manual-review and policy-integrity holds remain fail-closed but are excluded from automatic-block actionability.

The complete evidence-tier, first-baseline, labeling, and repeat-run contract is documented in docs/field-validation-v2-ko.md.

data-release-gate is stricter: it requires K_GUARD_EVIDENCE_HMAC_KEY, the original Guardian manifest, a canonical high Guardian claim bound to the current report, target evidence and source snapshots, separately signed primary and repeat validation-source Guardian originals, the exact ground-truth/reviewer CSVs, the original custodian preregistration, Korean corpus evidence, and the actual MCP interceptor forwarded stream. It reruns field validation from those originals, revalidates reviewer/custodian HMACs, and requires the recomputed projection to equal the submitted report. It also reopens the repeat Guardian and independently checks content, bundle, execution attestation, toolchain, manifest, source/HTTP/MCP inputs, and exact candidate multiset. Design-partner validation is intentionally independent from the single app currently being released; its candidate app/target/finding refs must match the validation-source Guardian report, not masquerade as release-app coverage. A reusable GitHub Actions template lives at docs/templates/github-actions/guardian-release-gate.yml.

Unauthenticated JSON is split by risk. Sensitive/private-record structure remains DYN_UNAUTH_API_JSON at high severity; JSON without those indicators becomes DYN_PUBLIC_API_JSON_REVIEW at info severity so an intentional public API does not block release merely for returning JSON.

scripts/site_scale_calibration.py runs local black-box HTTP fixtures for large general HTML noise, medium public contact pages, small vibe-coded bulk JSON, valid strong identifiers, and bank-account JSON. It does not use external network access.

scripts/deep_probe_synthetic_calibration.py runs a local synthetic loopback calibration harness through the same dashboard scan_url(..., deep_active=True) path. The default evidence run uses 500 loopback invocations over 24 bounded scenarios; this is not 500 real websites, not vulnerability discovery, and not penetration testing. It covers .env, .git/config, backup SQL, debug endpoints, admin/API exposure, OpenAPI, source maps, CORS, redirects, PII/secret response tiers, and false-positive controls for login walls, SPA shells, and HTML fallbacks. It also includes negative controls that prove the expected-vs-observed scorer can detect injected missing and unexpected rules. It does not use external network access; real external deep probes still require explicit target authorization.

scripts/inner_core_product_gate.py runs the broader local synthetic product gate for the "inner-core" audit claim. It combines the 500-target loopback deep-probe calibration with static code/config/MCP text checks, Python AST taint, MCP runtime JSONL observation, read-only SQLite/log/storage connectors, retention/deletion review, cross-plane PII-to-agentic/external verdicts, and raw-free evidence graph checks. This gate must have zero missing required rules, zero unexpected deep-probe rules, passing negative controls, non-empty flow graph nodes/edges, and no forbidden raw markers in the serialized report. It is a product-depth gate, not proof of third-party site vulnerability discovery.

The public CI workflow runs python scripts/public_source_tests.py plus a 24-target inner-core gate on push/pull request. That selector is the sanitized-snapshot regression surface; it does not run the internal full pytest suite. The scheduled/manual audit workflow uses the same public-source selector, runs the 500-target inner-core gate, and uploads its JSON/Markdown/HTML evidence pack. The internal full pytest suite remains a private-source boundary. The repository self-SARIF scan is uploaded after a successful scan as non-gating evidence because this scanner repository intentionally contains detector rules, fixtures, and documentation examples that should trigger K-Guard findings; use --fail-on against the product being audited, not against K-Guard's own fixture-heavy source tree unless a project-specific baseline exists.

scripts/passive_homepage_calibration.py runs GET / only homepage calibration from a CSV manifest. It supports --max-targets, --delay-ms, --checkpoint-jsonl, and --resume for 10k-scale sharded runs. It reports cohort, rank-bucket, outcome, and hygiene-tier aggregates such as well_managed_quiet, hardening_gap, boundary_redirect, and messy_or_risky_signal, so noisy well-managed sites and messy long-tail sites can be calibrated separately. It also emits a release_gate with pass/warn/fail checks for measurement yield, high/critical rate, strong-identifier rate, and boundary redirect rate. It does not request /admin, /api, .env, .git, OPTIONS, or recursive paths.

scripts/build_top_domain_manifest.py creates that passive calibration manifest automatically from a public top-domain CSV or ZIP source. The default source is Tranco's latest top-1m ZIP, so operators do not need to manually collect 10,000 URLs. Use --start-rank to build long-tail messy-candidate cohorts, for example ranks 900,001 through 910,000. Majestic Million-style CSVs can also be supplied with --source-url.

AI-only contest RC evidence

The contest RC keeps development evidence in separate lanes instead of publishing one pooled accuracy number:

python scripts/qualify_korean_privacy_ai_only.py --output evidence/qualification/korean-privacy-ai-only-v1.json
python scripts/ai_public_benchmark_scorecard.py --output evidence/qualification/ai-public-benchmark-scorecard-v1.json
python scripts/benchmark.py --profile contest --output benchmark-report.json
  • The Korean qualification reports 117 fixture cases and a frozen 68-case evaluator-authored holdout as separate lanes. It also checks five workspace contracts, the four official unique-identifier concepts, business/corporate-number boundaries, and six sensitive-vocabulary surfaces. It does not publish a pooled confusion matrix or claim blind, human-adjudicated, registry, partner, or field accuracy.

  • The public scorecard preserves current and historical lanes separately. --require-integrity-pass deliberately fails while any selected historical artifact has a digest or binding mismatch; a report can still be generated so an inadmissible historical result remains visible instead of being silently rewritten or dropped.

  • The contest performance profile measures exact synthetic all-benign low-signal corpora on one disclosed host, including fresh-process cold and persistent-scanner warm latency, 10/50/100 MiB scaling, in-process CPython thread concurrency 1/4/8, peak RSS, complete candidate coverage, and raw-free result invariance. It does not measure finding-dense scaling, process-level parallelism, production SLO, field accuracy, hardware-normalized comparison, or third-party superiority.

Current Limits

  • Product hardening roadmap: docs/pre-release-auditor-hardening-plan-ko.md

  • PDF/DOCX/HWP extraction is not included yet

  • Dynamic checks are localhost-only unless explicitly allowlisted or attested by the operator for an owned, partner-approved, or bug-bounty scoped external target

  • User-provided session headers are attached only to read-only GET requests and header values are not stored

  • JS/TS taint is conservative and lightweight, with intra-file taint, limited route-to-service summaries, and framework-aware heuristics for common Next.js/Express/Supabase/Firebase boundary mistakes; Python AST taint is intra-procedural

  • Runtime MCP observation and the MCP enforce_mcp_events tool remain advisory; mcp-proxy and mcp-http-proxy perform actual bidirectional enforcement for line-delimited stdio JSON-RPC and the tested Streamable HTTP lifecycle. Binary framing, nonstandard transports, and a universal drop-in proxy for every client remain outside the enforced boundary

  • Remote DB/storage/backups and actual deletion execution are not verified yet

  • Korean PII patterns are rule-based and need project-specific false-positive tuning

  • Korean business registration numbers use checksum syntax validation on synthetic/vendor-authored fixtures. Historical corporate registration numbers (issued before 2025-01-31) may use the old Annex alternating 1,2 weighted checksum. Since 2025-01-31, current corporate numbers are 4 registry + 2 type + 7 serial digits with no checksum, so detection is explicit field-context/syntax recognition only. None of this is natural-person PII, live registry validation, or independent field validation. Context-only current values are unverified syntax/context recognition. Privacy-first ambiguity: a plausible Korean RRN/FRN wins over a corporate or business label, header, or split JSON key, and is never classified or redacted as an organization ID.

  • The evaluator-authored 68-case Korean sensitive/org holdout (evidence/holdout/korean-sensitive-org-v1.cjson) is a post-implementation inspection of synthetic oracles, not a blind field-accuracy or registry-validation study. A case passes when every must_all rule is present, each must_any group has at least one matching rule, and no forbidden rule appears (per-case any-rule recall). After this pass the frozen manifest scores 68/68 with recall 1.0, specificity 1.0, and exact two-run repeat. That is not a claim of live field accuracy.

Available Tools

28 tools
build_flow_mapC

Build an EXPERIMENTAL heuristic data-flow risk map for source and sink patterns.

NameRequiredDescriptionDefault
pathYes

TDQS

C2.4/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries full responsibility for behavioral disclosure. It only labels the tool as 'EXPERIMENTAL heuristic', which hints at unreliability but does not describe side effects, return behavior, or whether it is read-only. This is insufficient for a tool that might have complex outputs.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single clear sentence with no wasted words. It is front-loaded with the action and subject, making it easy to parse. However, it is minimal to the point of missing critical details, which slightly lowers the score.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness1/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The description provides only a high-level purpose and fails to explain the parameter, expected output, or any operational context. Given the lack of annotations and output schema, this is severely incomplete for an agent to call the tool correctly.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The schema has 0% description coverage, and the description does not mention the 'path' parameter at all. There is no explanation of what 'path' should point to or its format, leaving the agent completely uninformed about the only required input.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool builds a data-flow risk map for source and sink patterns, using a specific verb and resource. It is not a tautology and is distinguishable from sibling audit tools, though it doesn't explicitly name alternatives.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus others, nor any exclusions or alternative tools. The single-sentence description offers no contextual triggers or prerequisites.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

check_my_appB
Read-only

Review the complete bound workspace; poll with continue_review until terminal.

NameRequiredDescriptionDefault
pathNo검사할 프로젝트 경로. 설치 시 고정된 워크스페이스에서는 '.'을 사용합니다..
include_flowNo소스에서 입력·처리·외부 전송 흐름 분석을 함께 실행합니다.

Output Schema

NameRequiredDescription
methodYes
findingsNo
experienceYes
review_jobNo
guardian_gateNo
review_receiptNo
primary_workflowNo
application_assuranceNo
auditor_qualificationNo

TDQS

B3.4/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and destructiveHint=false, so the safety profile is covered. The description adds the polling behavior, which is genuinely useful beyond annotations, but it does not explain what 'terminal' means, what the response contains, or any side effects (e.g., state changes between polls). Since it adds some behavior context but not full transparency, a 3 is appropriate.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is two short sentences with no filler. The core purpose ('Review the complete bound workspace') is front-loaded, and the polling instruction is a necessary operational detail. It could arguably be more structured (e.g., listing return behavior), but it is appropriately concise for the amount of information it conveys.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The tool has a rich output schema (which likely explains the 'terminal' state and review results), so the description does not need to detail return types. However, the phrase 'until terminal' is ambiguous without context on how to recognize terminality, and the description does not clarify the scope of 'complete bound workspace' or what 'review' entails (e.g., security, code quality, dependencies). Given the complexity of a polling-based review, the description is minimally complete but leaves gaps that the schema and sibling definitions may or may not fill.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema already documents both parameters fully (100% coverage), including the meaning of 'path' ('checks the project path; use '.' for the fixed workspace') and 'include_flow' (whether to run input/processing/external transmission flow analysis). The description adds nothing about parameters beyond what the schema provides, so the baseline 3 applies.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description specifies a clear verb ('Review') and a resource ('the complete bound workspace'), so an agent can deduce the tool's core function. It also hints at a distinctive workflow (polling with continue_review) that sets it apart from simpler scans, but it doesn't explicitly name or contrast siblings, so it stops short of a 5.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The instruction 'poll with continue_review until terminal' gives a usage pattern, implying this is a long-running operation and that continue_review is the follow-up tool. However, it does not state when to prefer this over alternatives like scan_workspace or start_review_before_ship, nor does it give exclusions or prerequisites. The guidance is implicit rather than explicit.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

continue_reviewA
Read-onlyIdempotent

Wait briefly for a long review; repeat until state is completed or failed.

NameRequiredDescriptionDefault
review_idYescheck_my_app 또는 start_review_before_ship이 돌려준 검수 번호
wait_secondsNo한 번에 기다릴 시간(0~4초). 완료될 때까지 이 도구를 반복 호출합니다.
finding_limitNo완료 결과에 포함할 findings 수(1~50)
response_modeNocompact(기본) 또는 full(호환용 전체 결과)compact
finding_offsetNo완료 결과 findings 페이지 시작 위치

Output Schema

NameRequiredDescription
methodYes
findingsNo
experienceYes
review_jobNo
guardian_gateNo
review_receiptNo
primary_workflowNo
application_assuranceNo
auditor_qualificationNo

TDQS

A3.8/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate read-only, idempotent, and non-destructive behavior. The description adds valuable context about the iterative waiting mechanism and the terminal states, which goes beyond what annotations declare. This clarifies that multiple calls may be needed and defines the loop exit condition without contradicting the annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, front-loaded sentence that captures the essential behavior and stop condition. It contains no redundant details, and for a tool with 5 parameters, the schema fully covers parameter specifics, so brevity is both appropriate and efficient.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The description conveys the core polling loop and terminal decisions, sufficient for an agent to understand the call pattern. With annotations covering safety and schema covering parameters, the description need not list parameters or response format. It could be more explicit about error handling or max retry expectations, but for a standard polling tool this is adequately complete.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with detailed per-parameter descriptions (e.g., wait_seconds limits, finding_limit range), so the description adds no parameter-level value. As per baseline for high schema coverage, a score of 3 is appropriate since the description effectively delegates parameter comprehension to the schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states a clear action ('Wait briefly') and a specific resource ('a long review') with an explicit termination condition ('until state is completed or failed'). It distinguishes itself from sibling start_review_before_ship by being the polling/waiting counterpart, making its role unambiguous.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies a polling loop but does not explicitly state when to call it, such as after start_review_before_ship or check_my_app. It lacks any mention of alternative tools or exclusion criteria, leaving preparation and sequencing to caller inference. The schema's review_id description helps but is not part of the tool description itself.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

create_benchmark_templateC

Create a 20/20/10 field benchmark manifest CSV template.

NameRequiredDescriptionDefault
output_pathYes

TDQS

C2.4/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries the full burden. It only says 'Create' without disclosing side effects, such as whether it overwrites an existing file, what the return value looks like, or any permission requirements. The description adds no behavioral context beyond the trivial fact of creation.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness3/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, concise sentence with no waste. However, it is too terse, sacrificing necessary detail for brevity. Front-loading is acceptable, but the cryptic '20/20/10' and lack of any explanation reduce its effectiveness.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple tool with one parameter and no annotations, the description should at least explain what a 'benchmark manifest' is, whether the file is created or overwritten, and any output expectations. The description lacks these details, making it incomplete for an agent to use correctly without prior domain knowledge.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The schema has only one parameter, output_path, with zero description coverage. The description does not mention the parameter at all, so an agent has no information about the expected format, whether it's a directory or full path, or the file name conventions. The description fails to compensate for the lack of schema documentation.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states a clear verb ('Create') and a specific resource ('20/20/10 field benchmark manifest CSV template'). The 'benchmark' keyword distinguishes it from sibling template tools like create_field_campaign_template and create_guardian_manifest_template. It is specific but leaves the meaning of '20/20/10' unexplained, so not a 5.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus the sibling template tools. There is no mention of alternatives, exclusions, or selection criteria. An agent would have to infer usage from the name alone, which is not sufficient when similar templates exist.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

create_field_campaign_templateC

Create the empty 12-20 app owned/partner roster used before holdout preregistration.

NameRequiredDescriptionDefault
output_pathYes

TDQS

C2.4/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries full responsibility for disclosing behavioral traits. It only says 'create', which is generic and matches the tool name; it does not mention whether the operation is destructive, whether it overwrites existing files, what permissions are required, or what success/error responses look like. The description adds minimal value beyond the tool name.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness3/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is extremely concise (a single sentence) with no wasted words. However, it is so terse that it omits essential details, making it under-specified rather than efficiently structured. It is neither bloated nor well-organized; it simply lacks substance.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a tool with one parameter, no output schema, and no annotations, the description should at least clarify what 'empty roster' means, what output_path should point to, and any prerequisites or side effects. The description only gives a vague workflow hint ('before holdout preregistration') and leaves the main operational details undocumented, making it insufficient for a correct call.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The schema has no parameter descriptions (coverage 0%) and the tool description does not mention the 'output_path' parameter at all. Even though the parameter name is somewhat self-explanatory, the description fails to elaborate on expected format, path conventions, or default behavior. The description offers zero assistance for correct parameter usage.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states a specific verb ('Create') and a specific resource ('empty 12-20 app owned/partner roster'), and gives a context cue ('before holdout preregistration'). It is clear about what the tool does, though it does not explicitly contrast with sibling template creators like create_benchmark_template or create_guardian_manifest_template. The purpose is distinguishable by the unique resource name.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The phrase 'used before holdout preregistration' implies a temporal context but does not give explicit when-to-use vs when-not-to-use guidance, nor does it mention any alternative tools or conditions for choosing this tool over a sibling. There is no guidance on preconditions or expected workflow.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

create_guardian_manifest_templateC

Create a korean_senior Guardian manifest for four-domain pre-release reviews.

NameRequiredDescriptionDefault
output_pathYes

TDQS

C2.9/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations provided, the description carries the full burden of disclosing side effects. It says 'create' but does not describe whether the tool overwrites existing files, requires specific permissions, or produces a specific return value. The lack of behavioral detail (e.g., idempotency, error conditions) leaves the agent without important operational context.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, focused sentence that is front-loaded with the action. It is concise without padding, but its brevity comes at the cost of missing critical details, making it more under-specified than efficiently concise.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a mutation tool that creates a file, with no annotations, no output schema, and no parameter documentation, the description is far from complete. It omits details about the manifest structure, default behavior, and parameter semantics, which an agent would need to invoke the tool correctly and safely.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the description must compensate by explaining the output_path parameter. It does not: the description only mentions the manifest creation and gives no guidance on the expected format, constraints, or usage of output_path. The parameter name is self-explanatory but the description adds no additional semantic value.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'Create' and the resource 'a korean_senior Guardian manifest', and adds the specific context of 'four-domain pre-release reviews.' This distinguishes it from sibling template tools like create_benchmark_template and create_field_campaign_template, making the purpose unambiguous.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage for pre-release reviews but does not explicitly state when to use this tool versus similar template creators, nor does it mention any exclusions or alternatives. An agent would have to infer the use case from the name and description, lacking explicit routing guidance.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

data_release_gateC

Run the strict data shipment gate over Guardian, validation, Korean corpus, and MCP interceptor evidence.

NameRequiredDescriptionDefault
guardian_report_pathYes
guardian_manifest_pathYes
validation_report_pathYes
validation_review_pathYes
validation_roster_pathYes
korean_corpus_report_pathYes
mcp_forwarded_output_pathYes
mcp_intercept_report_pathYes
korean_fixture_corpus_pathYes
validation_ground_truth_pathYes
validation_preregistration_pathYes
max_validation_false_positive_rateNo
validation_repeat_guardian_report_pathYes
validation_source_guardian_report_pathYes

TDQS

C2.4/5.0
Behavior1/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations are absent, so the description carries the full burden of behavioral disclosure. It only says 'Run' the gate, without stating whether it is read-only, destructive, requires specific inputs, or what happens on failure. With 14 parameters and no cautions, the agent has no idea of side effects or prerequisites—a serious gap.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, concise sentence that front-loads the action and lists evidence categories. There is no filler or redundancy. However, given the tool's complexity, it is overly terse, though conciseness itself is well-handled.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness1/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a tool with 14 required parameters, no annotations, no output schema, and no parameter descriptions, the description is grossly incomplete. It fails to explain what each path is for, what the gate checks, success criteria, side effects, or output format. An agent cannot confidently invoke this tool correctly.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the description must compensate. It groups evidence into Guardian, validation, Korean corpus, and MCP interceptor categories, which helps map high-level intent but does not explain the 14 specific path parameters, their expected formats, or relationships. This is insufficient for an agent to correctly populate all required fields.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states a specific verb 'Run' and resource 'strict data shipment gate', and lists the evidence sources (Guardian, validation, Korean corpus, MCP interceptor). It is clear what the tool does overall, though it does not explicitly differentiate from sibling tools like security_gate or guardian_audit. The distinctive evidence components give some differentiation, hence a 4.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

There is no guidance on when to use this tool versus alternatives. It omits prerequisites, exclusions, or context clues such as 'use this before shipping data' or 'do not use if X'. The agent must infer usage from the tool name and stack. This is a significant miss for a tool with many related siblings.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

deep_analyzer_auditC

Run the local fail-closed Semgrep deep profile; this is intrafile evidence, not an authorization proof.

NameRequiredDescriptionDefault
workspace_pathYes

TDQS

C2.7/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries the full burden but only discloses a few behavioral traits: 'fail-closed' and 'intrafile evidence, not an authorization proof'. These are useful, but it does not mention permissions, side effects, rate limits, or output behavior. It adds some context beyond the schema but leaves many aspects undisclosed.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is extremely concise—one sentence with two clauses—and front-loads the action. Every word earns its place, but the brevity leaves essential details missing, so it is efficient but not optimally informative.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given that this is a security audit tool with only one parameter and no output schema, the description is incomplete. It does not explain the return value, the exact meaning of 'workspace_path', prerequisites, or how the result relates to other tools. The caveats about fail-closed and non-authorization are helpful, but the agent lacks critical operational details.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the description must compensate for the parameter 'workspace_path', but it provides no explanation of what this parameter expects, its format, or its purpose. The agent has no additional information beyond the variable name, making it difficult to invoke correctly.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states a specific action ('Run the local fail-closed Semgrep deep profile') and a clear resource (Semgrep deep profile), with an additional qualifier about its scope ('intrafile evidence, not an authorization proof'). It is clear about what the tool does, though it does not explicitly differentiate from sibling tools like scan_workspace or software_composition_audit.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

There is no guidance on when to use this tool versus alternatives. The phrase 'intrafile evidence' hints at a single-file analysis scope, but it does not state conditions or mention sibling tools. No exclusions or alternative routing is provided.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

enforce_mcp_eventsC

Evaluate MCP runtime block/redact policy and return a raw-free report-only interceptor result.

NameRequiredDescriptionDefault
textYes
labelNomcp-runtime-events

TDQS

C2.4/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description must carry all behavioral disclosure. It mentions 'report-only' (non-destructive) and 'raw-free' (does not expose raw data), which are helpful, but it does not clarify whether any state is modified, whether authentication is needed, or the exact nature of the interceptor result. The disclosure is partial despite carrying the full burden.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence with the primary action front-loaded. It is concise and avoids filler, though it may be too terse for the tool's complexity. In terms of structure, it communicates the core action efficiently.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness1/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given no output schema, no annotations, minimal parameter documentation, and a relatively complex policy-evaluation task, the description is severely incomplete. It fails to explain the interceptor result, parameter semantics, or any side effects, leaving the agent without enough context to invoke the tool correctly.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0% and the description does not explain the purpose of the 'text' or 'label' parameters. An agent cannot infer what text to pass or how label affects the call. The description adds no meaning beyond the generic parameter names.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description uses a specific verb ('Evaluate') and resource ('MCP runtime block/redact policy') and indicates the output type ('raw-free report-only interceptor result'). It distinguishes from siblings like observe_mcp_event (observation) and scan_mcp_config (scanning), though 'raw-free' and 'interceptor' are jargon that could confuse agents.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit guidance on when to use this tool versus its siblings. It does not mention alternatives, exclusions, or prerequisites. The only implicit signal is the verb 'Evaluate' suggesting policy enforcement, but nothing clarifies a selection condition.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

explain_ruleB
Read-onlyIdempotent

Explain a K-Guard rule in plain language with impact, fix steps, and verification.

NameRequiredDescriptionDefault
rule_idYes

TDQS

B3.1/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint, idempotentHint, and destructiveHint, covering the safety profile. The description adds that the tool provides impact, fix steps, and verification, which is useful context beyond a generic 'explain'. However, it does not disclose output format, error handling, or any other behavioral traits, so the added value is moderate.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

A single sentence that front-loads the action and lists the key outputs. There is no fluff, and it is concise without being under-specified—every word contributes to describing the tool's function.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple tool with one parameter and annotations covering safety, the description is minimal but conveys the purpose. However, it lacks usage guidance and parameter semantics, and it does not contextually place itself among the many sibling tools. An agent would not know when to call it or how to find the rule_id, leaving notable gaps.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The schema provides only the parameter name 'rule_id' with type string and no description. The tool description does not explain what a rule_id is, how to obtain it, or its format. With 0% schema description coverage, the description wholly fails to compensate, leaving the agent with no semantic context for the sole required parameter.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states a specific action ('Explain a K-Guard rule') on a specific resource, and lists the content of the explanation (impact, fix steps, verification). This distinguishes it from siblings like suggest_fix, which focuses on proposing fixes rather than explaining a rule.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

There is no guidance on when to use this tool versus alternatives like suggest_fix or scan_workspace. It does not mention why one would prefer an explanation over a fix suggestion, nor any conditions or prerequisites, leaving the agent to infer usage.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

field_benchmarkC

Aggregate field benchmark reports by cohort; probes require explicit MCP probe opt-in.

NameRequiredDescriptionDefault
run_probesNo
review_pathNo
manifest_pathYes

TDQS

C2.7/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations provided, the description must convey behavioral traits such as side effects, return values, or error conditions. It only discloses that probes need explicit opt-in and that results are aggregated by cohort. It does not describe what the tool returns, whether it is read-only, or any side effects. The sparse disclosure leaves the agent uncertain about the tool's full behavior.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is two short sentences with no redundant wording. The primary action is stated first, followed by a specific constraint. Every word adds some value, and the structure is front-loaded with the main purpose.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given three parameters, no output schema, and no annotations, the description is insufficient. It does not explain what manifest_path should reference, what run_probes does beyond the opt-in hint, or the role of review_path. An agent would need external knowledge to invoke this correctly. The description covers only a fraction of the necessary context for a tool of this complexity.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema has 0% description coverage, so the description must explain the parameters. It does not define manifest_path, run_probes, or review_path beyond their names. The mention of cohort and probe opt-in hints at some parameter usage, but not enough for an agent to correctly fill in all parameters without further knowledge. The description compensates poorly for the missing schema documentation.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states a specific verb ('Aggregate') and resource ('field benchmark reports') with a clear qualifier ('by cohort'). It distinguishes the tool from siblings like create_benchmark_template or field_campaign_status, which deal with creation or status rather than aggregation. The probe opt-in clause adds a specific characteristic, but the description does not explicitly name any sibling for comparison.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description gives no guidance on when to use this tool over alternatives. It states a requirement about probes ('probes require explicit MCP probe opt-in') but does not explain when aggregation is appropriate or when to choose another tool. There is no mention of context, prerequisites, or exclusions.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

field_campaign_statusC

Validate the app roster and emit a raw-free fail-closed campaign status.

NameRequiredDescriptionDefault
output_pathYes
roster_pathYes

TDQS

C2.4/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description must disclose behavior. 'Fail-closed' hints at error handling but doesn't explain side effects, required permissions, or what happens on failure. 'Raw-free' suggests output transformation but is undefined.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness3/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence with no waste, but it sacrifices substance for brevity. It is concise in length but not in delivering necessary information.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness1/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With two required parameters and no output schema, an agent cannot infer what output looks like, what 'raw-free' means, or what 'fail-closed' implies. The description is inadequate for safe invocation.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 0%, so the description must define both required parameters. It never mentions roster_path or output_path, leaving their purpose entirely unclear.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description identifies a specific action ('validate') and resource ('app roster'), with a defined outcome ('emit a campaign status'). It is distinct from sibling validation tools by focusing on campaign status.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is given on when to use this tool versus alternatives like validate_policy_controls or scan_workspace. It does not state prerequisites, exclusions, or selection criteria.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

guardian_auditC

Run Guardian; korean_senior rows require four review domains and fail closed when fail_on is set.

NameRequiredDescriptionDefault
fail_onNo
run_scaNo
run_probesNo
manifest_pathYes
previous_report_pathNo
mcp_http_proxy_report_pathNo
field_validation_report_pathNo
control_validation_report_pathNo
language_validation_report_pathNo

TDQS

C2.2/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Since no annotations are provided, the description must carry the full burden of behavioral disclosure. It does reveal two behaviors: the requirement for four review domains for korean_senior rows and the fail-closed behavior when fail_on is set. However, it does not disclose whether the tool is read-only, what it modifies, any authentication requirements, or any side effects. This is insufficient for an audit tool of this complexity.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness2/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence that combines two unrelated pieces of information with a semicolon. It is concise but severely under-specified for a tool with 9 parameters. The structure does not front-load the most important information about the tool's purpose or usage; instead it focuses on an edge case about korean_senior rows.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness1/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a tool with 9 parameters, no annotations, and no output schema, the description is drastically incomplete. An agent has no understanding of what the tool returns, what most parameters do, or what the audit covers. The description only addresses a narrow scenario, leaving the agent to guess about the rest.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the description should compensate by explaining key parameters. It only hints at 'fail_on' by mentioning it in the fail-closed clause, but does not explain its values or purpose. Parameters like run_sca, run_probes, and various report paths are left completely unexplained, making it hard for an agent to know how to set them.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose3/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states 'Run Guardian' which identifies the action, but it does not explain what Guardian does or why it would be used. The mention of 'korean_senior rows' and 'four review domains' suggests a specific audit context, but without knowing what Guardian does, the purpose remains ambiguous. It distinguishes from siblings only by name, not by functionality.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description gives a specific condition: 'korean_senior rows require four review domains' and 'fail closed when fail_on is set.' This hints at when this tool might be needed, but it does not explicitly state when to use this tool over alternatives like deep_analyzer_audit or software_composition_audit. There is no guidance on exclusions or when not to use it.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

observe_mcp_eventC

Observe one MCP runtime event and return stream-ready block/redact policy decisions.

NameRequiredDescriptionDefault
textYes
labelNomcp-runtime-event
session_idNodefault

TDQS

C2.9/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries the full burden of behavioral disclosure. It mentions 'observe' which hints at read-only, but does not state whether the tool has side effects, modifies state, requires specific permissions, or what 'stream-ready block/redact policy decisions' entail. The description is too vague to inform an agent about side effects or constraints.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence that front-loads the core action and output. It is concise with zero wasted words, making it easy to parse quickly.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a tool with 3 parameters, no output schema, and no annotations, the description is incomplete. It does not explain how to construct the input, what the return value looks like, or any operational context (e.g., streaming behavior, policy format). An agent calling this tool would lack essential details to use it correctly.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, meaning the schema provides no explanation for parameters. The description does not compensate by explaining the role of 'text', 'label', or 'session_id'. There is no guidance on what content to pass or how these parameters influence the output. This is a significant gap for a 3-parameter tool.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states a specific verb ('observe'), a specific object ('one MCP runtime event'), and the result ('return stream-ready block/redact policy decisions'). It clearly differentiates from sibling tools like observe_mcp_events (plural) and enforce_mcp_events by emphasizing the singular scope and the decision-returning action.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

There is no explicit guidance on when to use this tool versus its siblings. The description implies usage for a single event but does not state when to prefer it over observe_mcp_events or enforce_mcp_events. No exclusions or alternative conditions are provided, leaving the agent to infer the context.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

observe_mcp_eventsB

Observe MCP runtime/proxy JSONL events for PII, hidden instructions, and agentic/external flow.

NameRequiredDescriptionDefault
textYes
labelNomcp-runtime-events

TDQS

B3.4/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations provided, the description carries the full burden of behavioral disclosure. It does explain that the tool scans for PII, hidden instructions, and agentic/external flow, which gives insight into its function. However, it does not explicitly state whether the tool is read-only, has side effects, or requires network access. The term 'observe' implies passivity, but this is not confirmed.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, well-structured sentence that delivers the core purpose upfront and appends the specific detection targets. It contains no superfluous words and is highly efficient, making it easy for an agent to parse quickly.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the absence of an output schema and annotations, the description should at least hint at what the tool returns. It does not mention output format or return values. Additionally, it fails to explain the role of the optional 'label' parameter. For a tool with only two parameters, the description is reasonably complete for the primary action but leaves critical context gaps for a fully informed call.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The schema description coverage is 0%, so the description must compensate for parameter clarity. The description implies that the 'text' parameter contains JSONL events (from 'Observe MCP runtime/proxy JSONL events'), but it does not explicitly map description content to parameters, and the 'label' parameter is completely unexplained. This leaves the agent uncertain about parameter formatting and purpose.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action (observe) and the resource (MCP runtime/proxy JSONL events) and specifies the focus (PII, hidden instructions, agentic/external flow). This distinguishes it from sibling tools like 'observe_mcp_event' (singular) and 'enforce_mcp_events' (different action) without needing to inspect their schemas.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description does not provide any guidance on when to use this tool versus alternatives. It does not mention specific scenarios or indicate conditions where a different tool would be more appropriate. No exclusions or alternative references are given.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

probe_httpC

Run safe read-only HTTP probes against localhost or explicitly authorized external targets.

NameRequiredDescriptionDefault
base_urlYes
deep_activeNo
session_fileNo
authorization_noteNo
external_authorizedNo

TDQS

C2.7/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations provided, the description carries the full burden of behavioral disclosure. It does state 'safe read-only', indicating non-mutating behavior, and restricts targets to localhost or authorized external, which is useful. However, it fails to disclose behaviors related to parameters, response format, authentication needs, or rate limiting, leaving significant gaps.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single concise sentence that front-loads the core purpose and target constraint. It avoids redundancy and is easy to parse. However, it is perhaps too brief given the other gaps, but for conciseness alone it is strong.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness1/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool has 5 parameters, no output schema, and no annotations, a complete description would need to cover parameter semantics, expected return values, and use cases. This description only provides a high-level purpose and target restriction, leaving the agent without enough information to call the tool correctly. It is substantially incomplete.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the description must compensate by explaining parameters. It offers no explanation for any of the five parameters (base_url, deep_active, session_file, authorization_note, external_authorized). The agent cannot infer their meaning or usage from the description, which is a severe deficiency.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly identifies the tool as a read-only HTTP prober with specific target constraints (localhost or explicitly authorized external targets). It uses a concrete verb ('Run') and a resource ('HTTP probes'), making the purpose unambiguous. While it doesn't name a sibling, no sibling tool appears similar, so it stands alone effectively.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies use for probing HTTP endpoints but provides no explicit scenarios, alternatives, or exclusions. It does not mention when to prefer another tool or when this tool should not be used. The guidance is inferred from the purpose statement rather than directly stated.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

scan_diffB

Scan only a git diff, without echoing raw diff content in the MCP response.

NameRequiredDescriptionDefault
base_refNoHEAD~1
head_refNoHEAD
workspace_pathNo.

TDQS

B3.4/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries the full burden of behavioral disclosure. It states that raw diff content is not echoed, which is a meaningful behavior. However, it does not describe what the tool does return, whether it is read-only, or any side effects. For a scan tool, this is a partial disclosure; more detail on the output format would improve transparency.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, focused sentence that front-loads the core purpose and the key behavioral absence. It is concise with no redundant wording. However, given the tool's parameters and lack of annotations, it may be slightly under-specified, but it earns its place as an efficient opening statement.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The tool has three parameters, no output schema, and no annotations. The description does not explain parameter semantics, expected output, or usage context beyond the scope of a git diff. An agent would lack crucial details to invoke the tool correctly, making the description inadequate for the tool's complexity.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0% (no parameter descriptions), so the description must compensate. It does not mention base_ref, head_ref, or workspace_path at all. The parameter names and defaults in the schema give some hints, but the description adds no additional meaning, leaving an agent unsure how to set the refs or workspace path correctly.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly identifies the resource (a git diff) and the action (scan), and adds a specific behavioral distinction ('without echoing raw diff content in the MCP response'). This unmistakably differentiates it from sibling scan tools like scan_workspace and scan_text, which target different resources.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies when to use this tool (for scanning a git diff) but does not explicitly mention alternatives or exclusions. An agent can infer the primary use case, but there is no guidance on when NOT to use it versus scan_workspace or scan_text. The scope is clear enough to make an inference, so it is not a complete miss.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

scan_mcp_configC

Discover and scan project MCP configs plus agent instruction and skill components.

NameRequiredDescriptionDefault
pathNo.

TDQS

C2.6/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries the full burden of behavioral disclosure. 'Discover and scan' implies a read operation, but it doesn't state whether it modifies anything, what it returns, how thorough the scan is, or whether it only scans the given path. There is no disclosure of potential side effects or performance implications. Minimal value beyond the literal meaning.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness3/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence, which is concise and front-loads the main verb. However, it is under-specified rather than efficiently detailed. Every word is used, but the ambiguity (e.g., 'discover and scan' vs just 'scan') means the sentence doesn't earn its place as the sole content.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the absence of annotations and output schema, the description must explain the tool's return value and behavior. It does not mention what the scan produces (list of files? config contents?), how to interpret results, or whether the path is required (though default '.' is in schema). For a tool that likely serves as an inventory/analysis entry point, the description is incomplete.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The schema has one parameter 'path' with no description and 0% schema coverage. The description does not explain what 'path' refers to (directory root? file?) or how it affects the scan. Since the schema provides no semantic help and the description adds nothing, parameter understanding is left to guessing.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description uses a clear verb+resource pattern ('Discover and scan project MCP configs plus agent instruction and skill components'), which states what the tool does. It is specific enough about the resource type to distinguish from generic scan tools like scan_workspace, but it doesn't fully delimit scope (what counts as 'agent instruction and skill components' is vague). Not a tautology, but could be sharper.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

There is no mention of when to use this tool versus the many sibling scanning tools (scan_workspace, scan_text, scan_diff, etc.). No context about typical use cases, prerequisites, or exclusions. The description offers no guidance on selection.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

scan_textB

Scan an inline text snippet without writing it to disk.

NameRequiredDescriptionDefault
textYes
labelNoinline-text

TDQS

B3.2/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations provided, the description carries the full burden of behavioral disclosure. It does disclose one meaningful trait: the operation does not write to disk. But it doesn't mention whether the scan is read-only, what side effects or requirements exist, or what the return format is. This is partial disclosure, but not comprehensive.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, concise sentence that leads with the primary action and key constraint. Every word adds value, and it avoids redundant phrasing. It is appropriately sized for a simple tool.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's simplicity (2 params, no output schema), the description covers the core behavior but leaves gaps: parameter semantics are unexplained, and differentiation from sibling scan tools (scan_workspace, scan_diff, etc.) is only implicit. An agent might not know exactly when to choose this over alternatives without additional context.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, and the description provides no information about the parameters. While the names 'text' and 'label' are fairly self-explanatory, the description does not clarify expected formats, defaults, or how the label is used. The description fails to compensate for the lack of schema descriptions.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states the verb 'scan' and the resource 'inline text snippet', clearly distinguishing it from file- or workspace-based scans. However, it doesn't specify the type or goal of the scan (e.g., security, content analysis), leaving some ambiguity about what the scan actually does.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The phrase 'inline text snippet' and 'without writing it to disk' strongly imply the intended use case: scanning text passed directly rather than from a file. However, it doesn't explicitly name alternative tools (e.g., scan_workspace, scan_diff) or state when those would be preferred, so the usage guidance is implied rather than explicit.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

scan_workspaceB

Scan a local workspace for secrets, Korean PII, composite PII, config risks, and flow risks.

NameRequiredDescriptionDefault
pathYes
include_flowNo

TDQS

B3.2/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description must carry the full burden of behavioral disclosure. It does not state whether the scan is read-only, whether it modifies files, what 'flow risks' entail, or what the return format looks like. The tool appears to be a scan, but its side effects and operational implications are opaque, which is a significant gap for a security-related tool.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, focused sentence with no wasted words. It leads with the action and resource, then lists the detection categories. It is efficient, though it could be improved by adding a sentence about parameters or usage without becoming verbose.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's complexity (scanning a whole workspace for multiple risk types) and the absence of an output schema and annotations, the description is insufficient. It does not explain what results are returned, how to interpret them, or the role of the include_flow parameter, leaving an agent with significant uncertainty about how to use the tool correctly.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

With 0% schema description coverage, the description must explain each parameter, but it only indirectly references 'path' via 'local workspace' and completely omits the 'include_flow' boolean. An agent would not know what toggling 'include_flow' does or why it defaults to true. The description fails to compensate for the schema's lack of documentation.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states a specific verb ('Scan'), a resource ('local workspace'), and enumerates the exact categories it detects (secrets, Korean PII, composite PII, config risks, flow risks). This clearly distinguishes it from sibling tools like scan_text or scan_diff that operate on different input types, so an agent can immediately tell what this tool is for.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage context (scanning a directory) via the phrase 'local workspace' and the required 'path' parameter, but it does not explicitly state when to choose this over alternatives like scan_text or scan_diff, nor does it mention any prerequisite conditions. The guidance is present but only implicit.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

score_fixture_corpusB

Evaluate a local fixture corpus and return FP/FN precision/recall scoreboard.

NameRequiredDescriptionDefault
corpus_pathYes

TDQS

B3.1/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations provided, the description carries the full burden. It mentions returning a scoreboard but does not disclose whether the operation is read-only, whether it modifies the corpus, requires specific permissions, or has side effects. The lack of explicit safety cues is a significant gap.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

A single sentence front-loads the core purpose and output. Every word is informative with no filler, earning a top score for efficiency and clarity of structure.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The tool is simple (one required param, no output schema), but the description lacks essential context: required input format, what constitutes a corpus, and any prerequisites. With no annotations to fall back on, this is not complete enough for confident invocation.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the description must explain the 'corpus_path' parameter. It only hints at 'local fixture corpus' without specifying path format, file/directory requirements, or any constraints. This is insufficient for an agent to determine correct input.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states a specific verb ('Evaluate'), a clear resource ('local fixture corpus'), and an explicit output ('FP/FN precision/recall scoreboard'). It uniquely identifies this tool among siblings, which are focused on scanning, validation, and audits rather than scoring a fixture corpus.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided about when to use this tool versus alternatives or any exclusions. The description only states what it does, leaving the agent to infer applicability without any contextual cues or usage conditions.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

security_gateC
Read-onlyIdempotent

Run the quick workspace gate. Use guardian_audit(fail_on=...) for the canonical release gate.

NameRequiredDescriptionDefault
pathNo.
fail_onNohigh
include_flowNo

TDQS

C2.3/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true, idempotentHint=true, and destructiveHint=false, covering mutation safety and side effects. The description adds 'quick' and 'workspace' context, which is slightly beyond annotations. However, it does not disclose what the gate actually does (e.g., what it scans, how it reports failures, whether it touches files). With annotations present, a 3 is appropriate – it adds minimal context but does not contradict or amplify the safety profile.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness2/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is short (two sentences) and front-loaded with the action, but it is under-specified. There is no wasted wording, yet the conciseness does not earn its place because it conveys almost no actionable information. A description this brief would be acceptable only if the schema and annotations carried the load, but they do not for parameters and purpose.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The tool has no output schema, no parameter descriptions, and a minimal description. There is no explanation of what the gate checks, what fail_on levels mean, what include_flow does, or how results are returned. Even with annotations, the agent lacks essential context to decide when and how to call this tool correctly. The description is far from complete for a security gate with three parameters.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, and the tool description does not mention any of the three parameters (path, fail_on, include_flow). The agent must rely purely on parameter names and defaults, which is insufficient for correct invocation. The description completely fails to compensate for the lack of schema descriptions, leaving parameter semantics entirely unexplained.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose2/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states 'Run the quick workspace gate' – a verb and resource, but 'workspace gate' is vague and does not specify what checks are performed, what outcomes are produced, or what 'gate' means in this context. It distinguishes from guardian_audit but does not define its own purpose clearly. A more specific statement like 'Run a lightweight security scan on the workspace' would be clearer.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description explicitly names guardian_audit as the canonical release gate, implying this tool is for a quicker, non-canonical check. This is partial guidance – it tells the agent when *not* to use this tool (for canonical releases) but does not state conditions for when to use this tool itself. It lacks direct 'use this when...' language, but the alternative reference provides some routing.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

software_composition_auditB

Audit Python/npm/Go locks; explicit authorization is required because engines may consult advisory databases.

NameRequiredDescriptionDefault
workspace_pathYes
authorize_advisory_lookupNo

TDQS

B3.2/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries the full burden. It discloses a key behavioral trait: explicit authorization is required because engines may consult advisory databases, implying external network access. However, it does not state whether the tool modifies files or only reads, nor does it describe any other side effects. The disclosure is useful but incomplete.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence that front-loads the core purpose and then adds the critical authorization note. There is no fluff or redundancy; every word contributes to understanding the tool's function and a key prerequisite.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The description is incomplete for a tool that audits lock files. It does not explain what 'audit' means in terms of output (e.g., vulnerability report, risk score), what happens during the audit, or how parameters like 'authorize_advisory_lookup' affect behavior. With no output schema and only minimal description, an agent would struggle to correctly invoke and interpret results.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the description must compensate. It barely touches on the 'authorize_advisory_lookup' parameter via the authorization mention, but it does not explain either parameter's purpose or how to set them. The description adds minimal value beyond what the schema shows (names and defaults). This is insufficient for a tool where parameters are not self-explanatory.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool audits Python/npm/Go locks, specifying the verb 'audit' and the target resources. It distinguishes from generic audit tools like deep_analyzer_audit by focusing on lock files for specific ecosystems. However, it does not explicitly name sibling alternatives, so it falls short of a 5.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage: use when you need to audit lock files for Python, npm, or Go. It does not provide explicit when-not guidance or mention alternatives, but the scope is clear enough to infer the primary use case. No exclusions or alternative suggestions are given.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

start_review_before_shipD

Start Guardian high only after a completed first review of the same source snapshot.

NameRequiredDescriptionDefault
app_idYes이 릴리스에서 변하지 않는 앱 식별자(예: my-shop-web)
live_urlNo선택 사항인 실제 앱 URL. 승인 없는 외부 능동 검사는 실행하지 않습니다.
user_scopeYes사용자와 권한 범위(예: anonymous, member, admin)
data_classesYes다루는 데이터 종류. 쉼표로 구분합니다(예: account, korean_pii, payment)
workspace_pathNo설치 시 고정된 프로젝트는 '.'을 사용합니다..
live_authorizedNo외부 live 대상의 능동 검수 권한을 운영자가 확인했는지 여부
run_live_reviewNo허가된 live URL에 동적 검수를 실행할지 여부
scope_proof_refYes검수 권한을 확인할 수 있는 운영자 측 근거의 참조값. 비밀 원문은 넣지 않습니다.
business_purposeYes앱이 실제로 제공하는 기능과 이용 목적
public_endpointsNo허가된 공개 엔드포인트 목록(예: /,/api/health)
initial_review_idYes완료된 check_my_app 검수 번호. 코드 수정 후에는 check_my_app을 다시 실행한 번호여야 합니다.
authorization_noteNo능동 검수 권한 범위에 대한 짧은 설명. 자격증명 원문은 넣지 않습니다.
previous_report_pathNo선택 사항인 이전 raw-free Guardian 보고서 경로
run_software_compositionNo의존성·라이선스·공급망 분석을 함께 실행합니다.

Output Schema

NameRequiredDescription
methodYes
findingsNo
experienceYes
review_jobNo
guardian_gateNo
review_receiptNo
primary_workflowNo
application_assuranceNo
auditor_qualificationNo

TDQS

D1.9/5.0
Behavior1/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries the full burden of behavioral disclosure. It does not reveal what side effects occur, whether the action is destructive, what permissions are needed, or what operational impact 'starting Guardian high' has. The tool appears to be a state-changing action with zero transparency.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness2/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence, which is concise but grossly under-specified. It omits essential information and does not front-load any useful detail. Conciseness without substance is not effective.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness1/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the complexity (14 parameters, 6 required) and an output schema, the description needs to explain the tool's purpose, return value, and usage context. It does none of that. The single sentence leaves an agent without enough information to know when or how to invoke the tool correctly.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the schema already documents all 14 parameters. The description adds no parameter-specific meaning, which aligns with the baseline of 3 when the schema does the heavy lifting.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose2/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description says 'Start Guardian high' but never defines what 'Guardian high' is. It mentions a precondition (after a completed first review) but does not state the tool's actual function, resource, or outcome. This is vague and could be confused with sibling tools like continue_review or guardian_audit.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

It provides one usage condition (only after a completed first review) but gives no guidance on when to use this tool versus siblings like check_my_app, continue_review, or guardian_audit. There is no mention of alternatives or exclusions beyond the single prerequisite.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

suggest_fixC
Read-onlyIdempotent

Return a dry-run fix recipe and regression-test suggestions for a rule.

NameRequiredDescriptionDefault
rule_idYes
frameworkNogeneric

TDQS

C2.9/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The annotations already declare readOnlyHint=true and idempotentHint=true, so the description correctly aligns by stating 'dry-run,' which implies no changes are applied. However, it does not mention any additional behavioral aspects like rate limits, required authentication, or the shape of the response. It adds a small amount of context about being a dry-run but stays within the safety profile the annotations already establish.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

A single, focused sentence that states the core functionality without any filler. The key concept (dry-run fix recipe) is front-loaded, and there is zero waste.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's relative simplicity (two parameters, read-only operation) and the presence of safety annotations, the description covers the basic operation. However, without an output schema, the agent does not know what a 'fix recipe' or 'regression-test suggestions' looks like, and the framework parameter's effect is unaddressed. This makes the description incomplete for a correct invocation.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The schema has no descriptions for rule_id or framework, and the description only refers to 'a rule,' which indirectly hints at rule_id but does not explain what a rule is or how framework modifies the output. With 0% schema coverage and no parameter explanation, the description fails to compensate, leaving the agent to guess at the meaning and semantics of both parameters.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

States a clear action (return) and a specific object of that action: a dry-run fix recipe and regression-test suggestions for a rule. It distinguishes itself from siblings like explain_rule by focusing on fixes rather than explanations, though it does not explicitly name alternatives.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Provides no explicit guidance on when to choose this tool over the many siblings, such as explain_rule or scan tools. The only implicit usage is that it applies to a rule, but there is no information about prerequisites, contexts, or when not to use it.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

validate_multilang_packC

Run the pinned nine-language pack twice; this does not claim field accuracy.

NameRequiredDescriptionDefault
pack_pathNo

TDQS

C2.6/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations provided, the description is the sole source of behavioral disclosure. It discloses that the tool runs twice and explicitly states it does not claim field accuracy, which is a useful limitation. However, it does not describe side effects, return values, or what the validation process actually does beyond running twice, leaving significant behavioral gaps.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, efficient sentence that front-loads the action and includes a caveat. It contains no redundant words or unnecessary detail, making it concise and easy to parse.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool has one parameter and no output schema, the description should explain what pack_path should point to, what running twice accomplishes, and what the expected output or result indicates. The description only instructs to run it twice and disclaims accuracy, which is insufficient for an agent to invoke it correctly without guessing.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The schema has one parameter (pack_path) with 0% description coverage, meaning the schema provides no meaning. The tool description does not mention the parameter at all, offering no context about what path to supply, its format, or its purpose. The description completely fails to compensate for the missing schema documentation.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states a specific action ('Run the pinned nine-language pack twice') on a named resource, making the primary action clear. The tool name 'validate_multilang_pack' reinforces the purpose of validation, and the caveat 'does not claim field accuracy' differentiates it from accuracy-focused tools. However, it does not explicitly state that it validates a multilingual pack, relying on the name for that.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides no guidance on when to use this tool versus siblings like validate_policy_controls or scan_workspace. It does not mention prerequisites, scenarios, exclusions, or alternatives. An agent has no basis for choosing this tool over others.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

validate_policy_controlsC

Run the repeated synthetic JIT/JEA and database AST/RBAC/isolation control pack.

NameRequiredDescriptionDefault
output_pathNo

TDQS

C2.6/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations provided, the description carries the full burden of behavioral disclosure. It only says 'Run', implying execution but does not state side effects, whether it is read-only, what output it produces, or any dependencies. The phrase 'repeated synthetic' hints at repetition but remains vague and unexplained.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single concise sentence with no redundant words. It front-loads the primary action and resource. While it lacks structure or headers, it is efficient and easy to read for its length.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The tool lacks an output schema, annotations, and rich parameter documentation. The description gives only a terse summary that assumes domain knowledge about JIT/JEA and AST/RBAC. It does not explain what the validation entails, what the output looks like, or any prerequisites, leaving the agent under-informed for a validation/control tool.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 0% and the description does not mention the sole parameter 'output_path' at all. The parameter name suggests it is an output destination, but that is not clarified. The description adds no meaning beyond what the schema already shows, and fails to compensate for the lack of schema documentation.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states a clear action ('Run') and a specific resource ('the repeated synthetic JIT/JEA and database AST/RBAC/isolation control pack'). It provides enough specificity to distinguish it from siblings like validate_multilang_pack, though the jargon-heavy phrasing ('synthetic JIT/JEA' and 'AST/RBAC/isolation') may be ambiguous without domain context.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus alternatives. It does not mention any sibling tools, conditions, or exclusions. The description simply states what it does, leaving the agent to infer context from the name and context signals.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

validate_streamable_http_runtimeD

Run the repeated Streamable HTTP authorization, lifecycle, SSE, and audit matrix.

NameRequiredDescriptionDefault
output_pathNo

TDQS

D1.6/5.0
Behavior1/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations provided, the description carries the full burden of behavior disclosure. It only says it 'runs' something, without disclosing side effects, read-only vs mutating nature, auth requirements, or output format. This is a serious gap for a tool that likely performs complex validation.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness2/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single short sentence, but it is under-specified rather than concise. It contains almost no actionable information, so the words do not earn their place. It is more of a heading than an explanation.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness1/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a tool that likely executes a multi-faceted validation matrix, the description provides no context on what the matrix entails, how to interpret results, or how the output_path is used. With no output schema and minimal description, an agent cannot confidently call this tool.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The only parameter, output_path, has 0% schema description coverage and the description does not mention it at all. The description adds no meaning to the parameter, failing to compensate for the schema's lack of explanation.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose3/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states a specific verb ('Run') and resource ('Streamable HTTP'), and lists topics it covers (authorization, lifecycle, SSE, audit). However, 'repeated ... matrix' is vague and does not clearly convey what the tool actually does. It does not explicitly differentiate from sibling validation tools like validate_policy_controls or validate_multilang_pack, but the resource name gives some distinction.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines1/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description gives no guidance on when to use this tool versus its siblings. It does not mention prerequisites, scenarios, or exclusions. An agent would have no cue for choosing this over other validation tools.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Tool Schema Changelog

Recent tool additions, removals, and schema changes observed during successful MCP inspections.

  1. 28 tool updatesv0.1.0
    • First observedbuild_flow_map
    • First observedcheck_my_app
    • First observedcontinue_review
    • First observedcreate_benchmark_template
    • First observedcreate_field_campaign_template
    • First observedcreate_guardian_manifest_template
    • First observeddata_release_gate
    • First observeddeep_analyzer_audit
    • First observedenforce_mcp_events
    • First observedexplain_rule
    • First observedfield_benchmark
    • First observedfield_campaign_status
    • First observedguardian_audit
    • First observedobserve_mcp_event
    • First observedobserve_mcp_events
    • First observedprobe_http
    • First observedscan_diff
    • First observedscan_mcp_config
    • First observedscan_text
    • First observedscan_workspace
    • First observedscore_fixture_corpus
    • First observedsecurity_gate
    • First observedsoftware_composition_audit
    • First observedstart_review_before_ship
    • First observedsuggest_fix
    • First observedvalidate_multilang_pack
    • First observedvalidate_policy_controls
    • First observedvalidate_streamable_http_runtime

TDQS

C2.5/5.0

Scored across 28 tools

Disambiguation4/5

Most tools have clearly distinct purposes with detailed descriptions. However, a few near-duplicates exist (e.g., observe_mcp_event vs observe_mcp_events, security_gate vs guardian_audit) that could slightly confuse an agent. Overall, the set is well-separated.

Naming Consistency2/5

Tool names mix conventions inconsistently. Many follow verb_noun (scan_workspace, create_field_campaign_template, explain_rule), but several use noun_noun (software_composition_audit, data_release_gate, field_campaign_status, security_gate). There is also singular/plural inconsistency (observe_mcp_event vs observe_mcp_events). This makes naming patterns unpredictable.

Tool Count2/5

With 28 tools, this exceeds the 25+ threshold and feels heavy. While the domain is broad, many tools overlap in function (multiple validation and audit tools). The server could consolidate some related tools (e.g., separate scan_* tools) without losing clarity.

Completeness4/5

The tool surface covers the main security workflow: scanning, validation, audits, templates, explanations, fixes, and status gates. Minor gaps exist (e.g., no explicit rule management or history retrieval), but the core lifecycle is present and agents can complete typical tasks.

Maintenance

ActivitySlowing
ResponsivenessNo issues

Related MCP Connectors

Related MCP Servers

  • A
    license
    A
    quality
    B
    maintenance
    MCP server that enables AI coding tools to scan projects for security vulnerabilities, secret leaks, and compliance issues, generating Korean-language audit reports.
    15
    9
    PolyForm Noncommercial 1.0.0
  • A
    license
    Not graded
    quality
    B
    maintenance
    Enables AI coding tools to scan projects for security vulnerabilities, hardcoded secrets, injection flaws, and privacy violations with 699 rules and 76 MCP tools, all running locally with zero telemetry.
    6 npm
    7
    MIT
  • A
    license
    Not graded
    quality
    B
    maintenance
    Enables MCP-compatible AI agents to scan code for leaked secrets, copyleft licenses, unprotected routes, missing privacy policies, and risky card handling before committing or shipping.
    115 npm
    MIT
  • A
    license
    Not graded
    quality
    B
    maintenance
    Provides on-machine security scanning for Copilot-generated code, including SAST, secrets, dependency, container, and configuration checks, plus AI-specific risk detection, with findings and fixes available via MCP tools.
    Apache 2.0