Skip to main content
Glama

K-Guard MCP

안경선배 · 바이브코딩 선배

만드는 흐름은 끊지 않고, 출하는 대충 넘기지 않습니다.

K-Guard MCP es un auditor MCP local-first que revisa el sitio, la exposición de API, la gestión de datos y el riesgo operativo antes de enviar los resultados de vibecoding. Guardian distingue entre lo que no tiene problemas y lo que aún no se ha visto, y devuelve el veredicto 출하 가능 / 고치고 출하 / 검수 범위 부족 y las siguientes acciones en coreano.

K-Guard no es una garantía que reemplace el juicio empresarial humano ni la revisión legal. Automatiza las preguntas que un desarrollador senior hace antes del envío y las compuertas fail-closed.

5분 설치 · 설치·디자인 검증 · 사용 가이드 · GitHub 공개 안내 · 필수 qualification · 제품 북극성 · 전체 도그푸드 판정 · 2026 대회 출품 준비

Primeros 5 minutos: checkout del código fuente actual

Todavía no se asume la distribución en un índice público de paquetes. En la primera ejecución, instala el código fuente actual desde la raíz del repositorio y sigue las siguientes acciones que te muestra 안경선배.

python -m pip install .
k-guard install --client auto --profile local-dev --workspace .
k-guard doctor --client auto

auto busca Grok, Codex y Antigravity instalados, fusiona el MCP k-guard en el ámbito del usuario y, si existe tunnel-client de OpenAI, prepara un perfil local para ChatGPT. --workspace . fija el proyecto actual como un binding privado. A partir de entonces, aunque el MCP se inicie desde otro directorio de trabajo, inspeccionará este proyecto y rechazará las rutas fuera del límite con un HOLD alto. Para el doctor/run de ChatGPT, también se necesita CONTROL_PLANE_API_KEY con permisos de Tunnels Read + Use en el shell actual. Como ChatGPT deja pendientes tunnel-client run y la conexión de la app en modo desarrollador, el instalador no lo presenta como un éxito y devuelve 부분 연결 · 다음 단계 필요. Se conserva la configuración existente y se crea una copia de seguridad antes de cualquier cambio en JSON; las claves de evidencia del operador y el texto original del workspace se guardan solo en archivos exclusivos del usuario en ~/.k-guard. local-dev solo activa la sonda read-only de localhost y un pequeño conjunto fijo de rutas de profundización, manteniendo desactivadas las sondas externas y de sesión. Si solo se necesita análisis estático, usa --profile workspace.

La salida básica de instalación y diagnóstico tiene tres pasos: 연결 준비 → AI 클라이언트 → 다음 행동. Para automatización, usa install --json y doctor --json. Para la reproducción de la evaluación del concurso, la reproducción del release y la modificación de código, usa la ruta de verificación de evaluación y reproducción de la instalación de 5 minutos para instalar el build y el evidence lock con --require-hashes. Semgrep 1.174.0 y pip-audit 2.10.1 también se instalan en un venv aislado con el cierre completo de hashes de requirements-semgrep.lock y requirements-pip-audit.lock respectivamente, sin modificar el runtime auditado.

En el cliente MCP:

안경선배로 이 앱을 끝까지 봐줘. check_my_app으로 전체 검수를 시작하고,
continue_review를 state=completed 또는 failed가 될 때까지 반복해줘.
완료 전에는 통과라고 말하지 마. 코드를 고쳤다면 check_my_app을 다시 완료해줘.
출하 전에는 실제 사업 목적과 범위를 확인한 뒤 최신 review_id로
start_review_before_ship을 실행하고 다시 continue_review로 Guardian 완료까지 기다려줘.
experience.presentation 순서대로 판정, 이유, 다음 행동 3개만 먼저 말해줘.

check_my_app no es una inspección que se termina a la ligera en 5 segundos, sino una herramienta que recibe la auditoría completa del workspace. La primera respuesta es review_in_progress y no se emite un veredicto de envío hasta que continue_review se complete. También se inspeccionan los artefactos de texto de distribución en dist, build y .next; si el número de candidatos, el SHA-256 de las rutas y la finalización de la lectura no coinciden, se bloquea con severidad alta. El resultado final produce un review_receipt vinculado al SHA-256 del workspace y del árbol fuente. Si el código cambia, no se puede iniciar la revisión de envío con el review_id anterior y hay que completar check_my_app de nuevo.

Related MCP server: VibeGuard MCP Server

Veredicto de 안경선배

Código

Significado

Siguiente acción

ship

Enviable dentro del alcance configurado y los criterios high

Conservar el informe y las evidencias del mismo commit

hold_fix

Existe un hallazgo bloqueante

Ejecutar suggest_fix y volver a ejecutar la misma compuerta

hold_coverage

Faltan evidencias de inspección dinámica, flujo, propósito y alcance

Completar primero las áreas de revisión faltantes

hold_authority

Faltan evidencias de vinculación a una sola app y firma del operador

Reejecutar con el mismo app_id y K_GUARD_EVIDENCE_HMAC_KEY

hold_qualification

Faltan evidencias de calificación deep, SCA, runtime, DB y field de la herramienta de auditoría, independientemente del riesgo de la app

Verificar por separado application_assurance y auditor_qualification

review_only

Solo genera un informe de revisión

Ejecutar el veredicto de envío con fail_on=high

Todos los resultados representativos proporcionan experience.presentation y el alias compatible experience.details.presentation, con el orden fijo verdict → why → next_actions → details. Guardian muestra el riesgo de la app como application_assurance y el estado de validación de la propia herramienta de auditoría como auditor_qualification, por separado. experience.verdict_code, experience.verdict_message y experience.summary son campos compatibles con informes existentes.

Qué examina

K-Guard combina:

  • Escaneo estático: PII coreana, PII compuesta, identificadores de organizaciones coreanas (validación sintáctica de checksum de 사업자등록번호; reconocimiento sintáctico/contextual del anexo histórico de 법인등록번호 o del formato 4+2+7 posterior al 2025-01-31, no validación en registro en vivo), secretos

  • Escaneo de configuración: riesgos de CORS/debug/source map/prefijo de entorno

  • Escaneo senior de riesgo de app: sinks directos de request a SQL/comando/archivo/URL/HTML, mass assignment, open redirect, almacenamiento de tokens en navegador, cookies débiles, comparación de contraseñas en texto plano y JWT decode-sin-verify

  • Escaneo de gobernanza de datos coreana: declaraciones de campos únicos/sensibles, evidencias de cifrado/control de acceso, registro de accesos, revisión de procesadores externos, retención y borrado

  • Escaneo de amenazas nativas de MCP: instrucciones ocultas, envenenamiento de herramientas, intención de exfiltración y acceso local excesivo en texto directo más normalización acotada Unicode/confusable, escapada/porcentaje/HTML, Base64, fragmentos divididos y de tres líneas rodantes

  • Revisión estructurada de configuración MCP: wrappers de shell, lanzadores de paquetes mutables, HTTP remoto en claro, credenciales fijas, enlaces inseguros/fallos de lectura y límites de descubrimiento fail-closed en candidatos de configuración de proyecto/Codex/Grok/Antigravity

  • Paquete de reglas locales YARA-lite: marcadores de prompt injection, marcadores de comandos de exfiltración, pistas de esquemas masivos coreanos

  • Sonda dinámica segura: comprobaciones HTTP en localhost, comprobaciones de orígenes externos explícitamente autorizados, comprobaciones opcionales acotadas de exposición profunda, más cabeceras de sesión read-only opcionales proporcionadas por el usuario

  • Mapa de riesgo de flujo de datos: grafo heurístico más análisis de taint source -> sink en AST de Python y JS/TS ligero, incluidos resúmenes de parámetro-a-sink de helpers de Python con import único y resúmenes limitados de IDOR de ruta-a-servicio en JS/TS

  • Observador/Interceptor de runtime MCP: comprobaciones de eventos JSON/JSONL y listos para stream para instrucciones ocultas, flujo de PII a sinks agénticos/externos, más aplicación de bloqueo/redacción por lotes para flujos de eventos reenviados

  • Adaptador profundo Semgrep: perfil offline de 40 reglas, prueba exacta del objetivo escaneado, identidad fijada 1.174.0, vinculación de instantánea de fuente y hallazgos fail-closed en JS/TS/Python/Java/Kotlin/Go/PHP/Ruby/C#

  • Paquete de validación de nueve lenguajes: 90 casos fijados vulnerables/limpios en Python/JavaScript/TypeScript/Java/Kotlin/Go/PHP/Ruby/C#, puntuación TP/FN/FP/TN y reproducción exacta de huella en dos ejecuciones

  • Análisis de composición de software: cobertura acotada de manifiestos y locks de Python/npm/Go con pip-audit, npm audit y govulncheck; el fallo parcial del motor, el lock, la salida o la deriva de fuente bloquea el release

  • Proxy MCP HTTP streamable: mediación completa de POST/GET SSE/DELETE, ciclo de vida vinculado al principal, concesiones JIT/JEA de denegación por defecto, inventario de herramientas filtrado, streams acotados y registros de auditoría sin datos brutos encadenados con HMAC

  • Controles de base de datos: allowlist AST de SQLGlot, RBAC de rol/base de datos/esquema/tabla/columna, EXPLAIN-antes-de-leer, autorizador de solo consulta SQLite, contención de rutas y presupuestos de fila/celda/resultado/tiempo

  • Conectores de solo lectura: muestreo de almacenamiento local SQLite, log, JSON/CSV/TSV sin almacenamiento de valores brutos; las brechas de conectores se convierten en hallazgos high

  • Revisión de retención/borrado: marca la falta de marcadores de retención/borrado cuando existen señales de datos personales

  • Veredictos entre planos: correlaciona hallazgos de PII coreana con evidencias de sinks LLM/MCP/externos/en reposo

  • Marcador FP/FN: recall del corpus de fixtures y tasa de falsos positivos. El FPR usa measurable_negative_count como denominador (negativos limpios sin expected_absent); negative_count son todos los negativos declarados y targeted_absence_case_count cubre ausencias de reglas seleccionadas que no entran en el denominador del FPR. Un denominador de negativos medibles cero se reporta como FPR 0.0.

  • Salida SARIF/CI: falla el build según las severidades configuradas

  • Perfil Guardian korean_senior: contrato fail-closed de cuatro dominios para seguridad del sitio, exposición de API, gestión de datos y riesgo operativo

  • Herramientas MCP principales: check_my_app, continue_review, start_review_before_ship; motor canónico interno: Guardian high; prompt guiado: guided_review

  • Herramientas MCP avanzadas: scan_workspace, deep_analyzer_audit, validate_multilang_pack, software_composition_audit, validate_policy_controls, validate_streamable_http_runtime, scan_text, scan_diff, scan_mcp_config, probe_http, build_flow_map, observe_mcp_events, enforce_mcp_events, observe_mcp_event, score_fixture_corpus, data_release_gate, create_field_campaign_template, field_campaign_status, create_guardian_manifest_template, guardian_audit, explain_rule, suggest_fix, security_gate

Límites de instalación

Los usuarios que reciban requirements-evidence.lock distribuido junto con el wheel exacto creado por el workflow de release pueden reproducir el cierre de dependencias auditado sin el repositorio, como se muestra a continuación. k-guard, k-guard-dashboard, k-guard-mcp, python -m k_guard_mcp.cli y python -m k_guard_mcp.server son comandos del wheel instalado.

El release también incluye SHA256SUMS, el bundle de provenance SLSA firmado con OIDC de GitHub y el bundle de attestation SBOM CycloneDX. En línea, verifica el sujeto de construcción y el digest con gh attestation verify ./k_guard_mcp-0.1.0-py3-none-any.whl -R windmillstudio/k-guard-mcp antes de instalar. Si solo coincide el checksum pero la attestation no se verifica, no se trata como un artefacto de release oficial.

python -m pip install --require-hashes -r ./requirements-evidence.lock
python -m pip install --no-deps ./k_guard_mcp-0.1.0-py3-none-any.whl
k-guard --help
k-guard install --client auto --profile local-dev --workspace .
k-guard doctor --client auto

En PCs gestionados donde la política de control de aplicaciones de Windows bloquea el lanzador de consola k-guard.exe de pip, usa el punto de entrada de módulo del mismo wheel. El contrato de funcionalidad y veredicto es idéntico.

python -m k_guard_mcp.cli --help
python -m k_guard_mcp.cli install --client auto --profile local-dev --workspace .
python -m k_guard_mcp.cli doctor --client auto

Con solo instalar el wheel, solo se proporcionan los comandos de runtime. El sdist del release y el checkout del repositorio incluyen scripts/..., tests/fixtures/... y las plantillas de validación. El entorno de desarrollo se prepara instalando los dos locks con --require-hashes desde la raíz del repositorio y luego python -m pip install --no-build-isolation --no-deps -e .. El evidence lock fija juntos la versión del cierre de dependencias del release y los SHA-256 permitidos; la licencia, las vulnerabilidades, el SBOM y el smoke del wheel fresco usan el mismo archivo.

Sala de revisión de 안경선배

Para ver el sitio autorizado en pantalla, ejecuta el dashboard local.

k-guard-dashboard --port 8765

Abre http://127.0.0.1:8765/ en el navegador. La pantalla sigue el orden 선배 판정 → 발견 → 검사 로그 → 노출 지도, y la autoridad final de envío no está en la pantalla sino solo en start_review_before_ship del MCP. Las imágenes de marca son activos originales creados para el proyecto y su provenance se registra en docs/brand-assets.md.

CLI del wheel instalado

Entre los comandos siguientes, tests/fixtures/korean_fixture_corpus.json es un corpus de ejemplo público ejecutable directamente desde el checkout del código fuente. Los usuarios que solo instalaron el wheel deben reemplazarlo con la ruta de su propio fixture con el mismo esquema.

python -m k_guard_mcp.cli scan .
python -m k_guard_mcp.cli scan . --json report.json --markdown report.md
python -m k_guard_mcp.cli scan . --sarif k-guard.sarif --fail-on high
python -m k_guard_mcp.cli probe http://localhost:3000
python -m k_guard_mcp.cli probe http://localhost:3000 --deep-active
python -m k_guard_mcp.cli probe http://localhost:3000 --session-file session.headers.json --json
python -m k_guard_mcp.cli probe https://staging.example.com --allow-external --authorization-note "owned staging domain" --json
python -m k_guard_mcp.cli flow . --svg flow.svg --html flow.html
python -m k_guard_mcp.cli observe-mcp --events mcp-events.jsonl --json
python -m k_guard_mcp.cli mcp-proxy --report mcp-proxy-report.json --response-timeout 30 -- python -m your_upstream_mcp_server
python -m k_guard_mcp.cli mcp-http-proxy --upstream http://127.0.0.1:9000/mcp --port 8765 --report mcp-http-proxy.json --receipt-log mcp-http-proxy.receipts.jsonl
python -m k_guard_mcp.cli deep-analyze . --output deep-analyzer.json
python -m k_guard_mcp.cli language-validate --output language-validation.json
python -m k_guard_mcp.cli sca . --output sca.json
python -m k_guard_mcp.cli control-validate --output control-validation.json
python -m k_guard_mcp.cli runtime-validate --output runtime-validation.json
python -m k_guard_mcp.cli access-policy-template --output access-policy.json
python -m k_guard_mcp.cli agent-grant --policy access-policy.json --output agent.jwt --app-id APP --session-id SESSION --purpose RELEASE_REVIEW --subject AGENT --role release-reviewer --method tools/list --method tools/call --tool check_my_app --tool start_review_before_ship
python -m k_guard_mcp.cli score-corpus --corpus tests/fixtures/korean_fixture_corpus.json --output fixture-metrics.json --json
python -m k_guard_mcp.cli benchmark-template --output benchmarks/field-benchmark-template.csv
python -m k_guard_mcp.cli benchmark --manifest benchmarks/field-benchmark-template.csv --output field-benchmark.json --markdown field-benchmark.md --html field-benchmark.html
python -m k_guard_mcp.cli guardian-template --output benchmarks/guardian-targets.csv
python -m k_guard_mcp.cli suppression-template --output .k-guard/suppressions.csv
python -m k_guard_mcp.cli field-campaign-template --output benchmarks/field-app-roster.csv
python -m k_guard_mcp.cli field-campaign-status --roster benchmarks/field-app-roster.csv --output field-campaign-status.json
python -m k_guard_mcp.cli field-validation-template --ground-truth-output benchmarks/field-ground-truth.csv --review-output benchmarks/field-review.csv
python -m k_guard_mcp.cli field-validation-sign --ground-truth benchmarks/field-ground-truth.csv
python -m k_guard_mcp.cli field-validation-preregister --roster benchmarks/field-app-roster.csv --ground-truth benchmarks/field-ground-truth.csv --custodian-id split-custodian-a --output benchmarks/field-preregistration.json
python -m k_guard_mcp.cli guardian --manifest benchmarks/guardian-targets.csv --output guardian-report.json --markdown guardian-report.md --html guardian-report.html
python -m k_guard_mcp.cli guardian --manifest benchmarks/guardian-targets.csv --suppressions .k-guard/suppressions.csv --fail-on high --run-probes --run-sca --language-validation-report language-validation.json --mcp-http-proxy-report runtime-validation.json --control-validation-report control-validation.json --field-validation-report field-validation.json --output guardian-gate.json
python -m k_guard_mcp.cli field-validation-queue --guardian-report guardian-gate.json --output benchmarks/field-review.csv
python -m k_guard_mcp.cli field-validation-sign --review benchmarks/field-review.csv
python -m k_guard_mcp.cli field-validation-report --guardian-report guardian-gate.json --repeat-guardian-report guardian-gate-repeat.json --roster benchmarks/field-app-roster.csv --ground-truth benchmarks/field-ground-truth.csv --review benchmarks/field-review.csv --preregistration benchmarks/field-preregistration.json --profile field --output field-validation.json
python -m k_guard_mcp.cli mcp-intercept --events mcp-events.jsonl --forwarded-output forwarded.jsonl --report intercept-report.json --app-id YOUR_APP_ID --session-id RELEASE_SESSION_ID --guardian-report guardian-gate.json --fail-on-block
python -m k_guard_mcp.cli data-release-gate --guardian-report guardian-gate.json --guardian-manifest .k-guard/guardian-targets.csv --validation-source-guardian-report validation-source-guardian.json --validation-repeat-guardian-report validation-source-guardian-repeat.json --validation-report field-validation.json --validation-review benchmarks/field-review.csv --validation-ground-truth benchmarks/field-ground-truth.csv --validation-preregistration benchmarks/field-preregistration.json --validation-roster benchmarks/field-app-roster.csv --korean-fixture-corpus tests/fixtures/korean_fixture_corpus.json --korean-corpus-report fixture-metrics.json --mcp-intercept-report intercept-report.json --mcp-forwarded-output forwarded.jsonl --output data-release-gate.json

session.headers.json es de corta duración y está vinculado a un único origen exacto. Guardian solo considera completa una comparación autenticada cuando la respuesta de identidad afirmada también coincide:

{
  "origin": "http://localhost:3000",
  "expires_at": "2026-07-14T12:30:00+09:00",
  "headers": {"Cookie": "session=<local-test-session>"},
  "identity_assertion": {
    "path": "/api/me",
    "expected_status": 200,
    "expected_body_sha256": "<64 lowercase hex characters>"
  }
}

Mantén el archivo dentro del workspace invocado, o junto al manifiesto de Guardian. Los archivos fuera de ese límite, los enlaces, las sesiones caducadas, los orígenes no coincidentes, las cabeceras no soportadas y los archivos sobredimensionados fallan de forma cerrada. El digest cubre los bytes exactos de la respuesta acotada antes de la decodificación UTF-8; los valores brutos de sesión y los cuerpos de respuesta no se escriben en los hallazgos.

Validación exclusiva del checkout del código fuente

Los scripts/** y pytest siguientes no son comandos de usuario incluidos en el wheel.

python -m pytest -q
python scripts/site_scale_calibration.py
python scripts/deep_probe_synthetic_calibration.py --targets 500 --output tmp/deep-probe-synthetic-500.json --markdown tmp/deep-probe-synthetic-500.md --html tmp/deep-probe-synthetic-500.html
python scripts/inner_core_product_gate.py --targets 500 --output tmp/inner-core-product-gate-500.json --markdown tmp/inner-core-product-gate-500.md --html tmp/inner-core-product-gate-500.html
python scripts/mcp_evasion_calibration.py --output evidence/regression/mcp-evasion-normalization.json
python examples/contest-demo/v1/demo.py run
python scripts/contest_readiness.py --output contest-readiness-report.json --markdown contest-readiness-report.md
python scripts/build_top_domain_manifest.py --output datasets/tranco-passive-homepage-10k.csv --limit 10000
python scripts/passive_homepage_calibration.py --targets datasets/tranco-passive-homepage-10k.csv --output reports/passive-homepage-10k-summary.json --checkpoint-jsonl reports/passive-homepage-10k-checkpoint.jsonl --max-targets 10000 --delay-ms 500

El gate de cobertura 90.00% de la regresión completa del código fuente es una cobertura combinada inclusiva de ramas que calcula juntas las oportunidades de statement y branch. No significa que las ramas en sí sean 90%, y como usa precision=2 y fail_under=90, 89.90% falla. El alcance public_source_only del CI del repositorio público excluye las evidencias de distribución separadas y los casos nativos, por lo que aplica los umbrales de 88% total y 85% de redaction.py; no se intercambian las dos cifras entre sí.

Higiene de release del checkout del código fuente

Usa la comprobación de higiene de release antes de la revisión del CTO o la preparación de la publicación:

python scripts/release_hygiene.py --json

El modo predeterminado valida que un árbol de trabajo sucio de candidato a release esté clasificado, libre de salida de scratch de runtime visible y libre de artefactos sin resolver que requieran revisión. Usa --strict-clean después del commit de release previsto; el modo estricto también compara cada byte de entrada de construcción del paquete con su blob del índice de Git. La publicación etiquetada además requiere --expected-tag v{project.version}, y esa etiqueta exacta debe resolverse al commit HEAD verificado. El workflow de release espera la matriz CI reutilizable de Windows/macOS/Linux, crea las attestations y publica los artefactos de la etiqueta como GitHub Release. Los detalles están en docs/release-hygiene.md.

La plantilla de Guardian Actions actualmente instala el checkout exacto del código fuente de K-Guard seleccionado por el commit del workflow; no asume un paquete de PyPI. Antes de copiarla a otro repositorio, provee K-Guard en una ruta fijada por commit y establece K_GUARD_SOURCE_PATH. Cuando existan artefactos de release, los consumidores deben fijar o un wheel exacto con su SHA-256 publicado, o un commit de Git completo de 40 caracteres en un requisito de referencia directa. Reemplaza los placeholders solo con una ubicación de release real:

k-guard-mcp @ https://<artifact-host>/<exact-wheel>.whl#sha256=<published-sha256>
k-guard-mcp @ git+https://<repository-url>.git@<40-character-commit>

K-Guard's primary license is MIT. Apache-2.0 upstream attribution, reviewed revisions, modified-file mapping, and excluded license boundaries are recorded in THIRD_PARTY_NOTICES.md and docs/upstream-adoption.md.

MCP

python -m pip install --require-hashes -r requirements-build.lock
python -m pip install --require-hashes -r requirements-evidence.lock
python -m pip install --no-build-isolation --no-deps .
k-guard-mcp

MCP probe_http is disabled by default. Enable it only for trusted audit sessions:

K_GUARD_MCP_ENABLE_PROBE=1 python -m k_guard_mcp.server

Authenticated read-only probing through MCP also requires K_GUARD_MCP_ENABLE_SESSION_PROBE=1 and a short-lived, origin-bound local session_file. Header values are read locally and are not written to findings. A header alone never proves login: Guardian requires the optional identity_assertion to match before authenticated comparison coverage can pass.

Bounded deep active probing through MCP also requires K_GUARD_MCP_ENABLE_DEEP_ACTIVE_PROBE=1 and probe_http(..., deep_active=true). This mode checks a small fixed list of exposed env/git/backup/debug paths and still avoids login attempts, mutations, fuzzing, and exploit payloads.

Authorized external probing through MCP also requires K_GUARD_MCP_ENABLE_EXTERNAL_PROBE=1 plus either K_GUARD_MCP_EXTERNAL_ALLOWED_HOSTS=example.com,staging.example.com or a per-call external_authorized=true with an authorization_note. The report records the authorization basis with DYN_EXTERNAL_TARGET_AUTHORIZATION_AUDIT.

La instalación y la conexión están adaptadas a los cuatro clientes ChatGPT, Grok, Codex y Antigravity; los procedimientos detallados están en docs/quickstart-ko.md y docs/mcp-client-install.md.

Al preparar el informe de resultados del concurso y las pruebas reales de compatibilidad, utilice docs/contest-2026-result-report-draft-ko.md y docs/client-interop-evidence-kit-ko.md. La compatibilidad real completada solo se contabiliza en el ámbito que incluye la grabación install → restart → tool list → check_my_app → reconnect por cliente, el SHA-256 único y una revisión separada.

MCP calls also enforce argument and inline-text budgets by default:

  • K_GUARD_MCP_MAX_FILES=1000

  • K_GUARD_MCP_MAX_MB=10

  • K_GUARD_MCP_MAX_TEXT_MB=1

  • K_GUARD_MCP_MAX_ARG_CHARS=4096

  • K_GUARD_MCP_GUARDIAN_MAX_TARGETS=100

  • K_GUARD_MCP_GUARDIAN_MAX_REQUESTS=200

Guardian MCP calls preflight the whole manifest against the target, filtered-file, byte, and projected HTTP-request budgets. File expansion is bounded at the configured limit plus one detection entry, so an oversized tree is rejected without first enumerating the entire tree. Oversized multi-target work returns a Guardian-shaped fail-closed report; use the CLI or split the manifest for intentionally larger batches. Dynamic HTTP inspection reads at most 1 MiB per response by default and also stops at 16 MiB, 80 requests, or 30 seconds per probe run.

Safety Defaults

  • JSON/Markdown/MCP outputs pass through a central redaction layer

  • SARIF output also passes through the same redaction layer and stores raw-free evidence

  • Dynamic probe only allows localhost, 127.0.0.1, and ::1 by default

  • External dynamic probe requires explicit authorization evidence and opt-in, then remains fixed-path, read-only, same-origin, and no-redirect. Each request resolves only allowlisted public addresses and connects to the selected validated IP while preserving the original HTTP Host/TLS SNI.

  • Dynamic probe does not follow redirects to non-allowlisted hosts

  • Dynamic probe uses non-destructive HTTP methods only

  • --deep-active is a bounded authorized check for common exposed .env, .git/config, backup/dump, and debug/runtime paths. It is not recursive crawling, password guessing, exploit payloading, or a path brute-force dictionary.

  • Dynamic probe uses a timeout and caps sampled response bodies

  • External secret validity checks are not performed

Severity and Confidence

Severity values are validated centrally:

  • critical: credential/private-key/DB URL exposure, direct high-risk identifiers, or unauthenticated sensitive routes

  • high: strongly identifying combinations, risky localhost exposure, or sensitive flow candidates

  • medium: standalone contact/location/config signals and hardening findings

  • low: weak heuristic signals

  • info: informational observations

Confidence values are high, medium, and low.

Data Flow And Inner-Core Limits

The flow map is explicitly EXPERIMENTAL and marked as heuristic+ast-taint+js-ts-taint with line-distance+python-intra-procedural-ast+js-ts-intra-file+limited-interprocedural-taint precision. It is a developer triage aid: Python AST taint is supported, and JS/TS now has lightweight intra-file taint, limited route-to-service summaries, plus framework-aware heuristics for Next.js route handlers/server actions, Express IDOR-shaped route params, Supabase service-role/RLS boundary hints, and Firebase Admin auth-boundary hints. Full TypeScript type checking, alias-complete import resolution, middleware proof, deployed RLS/Firebase rule proof, and complete inter-procedural taint remain roadmap items. Flow findings include raw-free source/sink line hashes to make evidence reproducible without echoing sensitive values. Flow visualizations are generated as local SVG/HTML without external JavaScript or CDN dependencies. The same redaction layer protects JSON, Markdown, SVG, HTML, and MCP responses.

Runtime MCP observation ingests JSONL/JSON event exports through observe_mcp_events and can also evaluate one event at a time through observe_mcp_event(session_id=...). CLI mcp-intercept applies those block and redact decisions to a batch event stream before writing forwarded JSONL. CLI mcp-proxy -- <upstream argv> is the live enforcement path for line-delimited stdio JSON-RPC. CLI mcp-http-proxy --upstream <URL> enforces the same policy across Streamable HTTP POST, GET SSE, and DELETE session lifecycles, with official Python MCP SDK interoperability coverage. Both proxies emit the same raw-free, transaction-linked HMAC receipt chain for access deny and content allow/redact/block decisions; configured sidecar persistence happens before forwarding and fails closed. Operator-secret verification is required for tamper-resistance claims because HMAC is a shared-secret tag, not a public-key signature. Both proxies fail closed on invalid framing, correlation errors, size or timeout limits, and transport control failures. Streaming observer state has bounded idle/LRU session retention. MCP enforce_mcp_events remains report-only. Binary framing, nonstandard transports, and a universal drop-in proxy for every MCP client remain roadmap work.

Read-only connectors inspect local SQLite/log/storage files only. Remote Postgres/Supabase/Firebase/S3, backups, and actual deletion execution are roadmap items.

Feedback Drift Loop

k-guard feedback --type fn --rule PII_PHONE --text "missed sample" --output feedback.jsonl
k-guard feedback-export --input feedback.jsonl --output feedback-summary.json --reviewed

Feedback files are sanitized before write and summarized locally for corpus tuning. False-negative snippets use extra conservative token masking because the detector may have missed the sensitive value. feedback-export requires --reviewed or K_GUARD_FEEDBACK_EXPORT_REVIEWED=1 so accidental automated exports fail closed. Review feedback-summary.json before sharing it outside the partner environment; do not transmit raw feedback.jsonl.

Field Benchmark

benchmark-template creates a 20/20/10 manifest:

  • 20 general baseline sites or reports

  • 20 vibe-coded suspected sites or reports

  • 10 owned, partner-approved, or bug-bounty scoped targets

benchmark aggregates raw-free K-Guard JSON reports and, only with --run-probes, authorized manifest rows marked mode=probe. It reports high/critical target rate, strong-identifier detection rate, top rules, and manual false-positive rate by cohort. The default path is report-only so benchmark work can start from dashboard exports without touching external sites.

The same workflow is available through MCP as create_benchmark_template and field_benchmark. MCP benchmark probes require the same explicit probe opt-ins as probe_http.

Guardian Mode

guardian-template creates an authorized target manifest for continuous product guarding. A row can point to a local workspace, an HTTP origin, an MCP runtime JSONL export, or an existing raw-free K-Guard JSON report. guardian aggregates all rows into one raw-free report with per-target gates, new/resolved finding drift, top recurring rules, and fix recipes from suggest_fix.

Guardian manifests also carry raw-free business-intent and scope assertion fields: business_purpose, data_classes, user_scope, public_endpoints, scope_basis, and scope_proof_ref. K-Guard does not claim human-level business understanding or prove ownership by itself; it records whether those assertions exist and stores only hashed refs. Scope completion requires an explicit scope_proof_ref; locators and legacy authorization notes are not treated as proof. Data-release gating requires those target-level contracts and verified operator-keyed evidence bundles whose artifact hashes match the current report before treating a report as shipment evidence.

New templates set audit_profile=korean_senior. In this profile a release gate does not pass merely because it found zero blockers. It also requires a substantive workspace with at least one supported and successfully decoded production source file, flow analysis, a completed deep HTTP review, declared endpoint paths that actually return 2xx/3xx/401/403 rather than only 404, and explicit purpose/data/user/scope assertions. Guardian content-hashes each workspace immediately before and after its audit; a mismatch emits GUARDIAN_SOURCE_CHANGED_DURING_AUDIT, blocks the target, and excludes that run from substantive coverage. Use an immutable CI checkout for release authority. The report exposes review_contract.domains for site_security, api_exposure, data_management, and operational_risk; guardian_gate.passed remains false when any required domain is incomplete. Legacy manifests without audit_profile remain on the narrower standard profile and must not be presented as four-domain senior coverage.

public_endpoints is executable review scope, not decorative metadata. Guardian safely adds valid same-origin paths from that field to the fixed GET/OPTIONS probe set (maximum 50; no absolute URL, parent traversal, or templated path). This lets the API review cover app-specific read-only endpoints while keeping the probe bounded.

When an HTTP row includes session_file, Guardian runs the same bounded path set twice: once unauthenticated and once with the operator-provided read-only session. This keeps public exposure checks visible instead of replacing them with an authenticated-only view. The session must prove both an auth-wall transition and the declared identity response digest. A korean_senior gate rejects HTTP coverage when either proof is absent, when a probe produced request or control errors, or when no valid declared endpoint scope was reached.

guardian --fail-on high is the canonical pre-release gate. It is the workflow to use when K-Guard should decide whether a target app can ship under a configured threshold. Workspace-only scan --fail-on and MCP security_gate are quick checks; they do not replace Guardian's manifest, coverage-gap, drift, and multi-target execution contract.

By default, guardian writes a report and exits successfully so teams can review findings without turning it into a release blocker. Use --fail-on high when the same report should act as a CI gate; it exits with code 3 when blocking targets or new blocking findings are present. On the first run without --previous, the report is an initial_snapshot: current blockers and coverage gaps can still fail the gate, but K-Guard does not label every current finding as new drift. In gate mode, HTTP rows in the manifest must actually execute via --run-probes or they become coverage gaps instead of silent passes.

Las filas HTTP no se ejecutan a menos que se pase --run-probes. La ruta CLI está pensada para un operador local de confianza y utiliza banderas CLI explícitas/filas de manifiesto como su mecanismo de aceptación. MCP está mediado por agentes y es más estricto: guardian_audit(..., run_probes=true) requiere K_GUARD_MCP_ENABLE_PROBE=1; los manifiestos que solicitan sondas externas, de activación profunda o de sesión requieren adicionalmente K_GUARD_MCP_ENABLE_EXTERNAL_PROBE=1, K_GUARD_MCP_ENABLE_DEEP_ACTIVE_PROBE=1 o K_GUARD_MCP_ENABLE_SESSION_PROBE=1 respectivamente. El modo Guardian sigue utilizando sondas fijas y seguras de GET/OPTIONS y no realiza intentos de inicio de sesión, adivinación de contraseñas, mutaciones, cargas útiles de explotación, rastreo recursivo ni seguimiento de redirecciones entre hosts.

Los clientes MCP deben pasar fail_on="high" a guardian_audit para obtener el veredicto canónico de puerta de lanzamiento en guardian_gate.passed; los códigos de salida del proceso siguen siendo una preocupación de la CLI. Use --previous previous-guardian-report.json para convertir el informe en un monitor de deriva. Los nuevos hallazgos bloqueantes se listan por separado solo cuando se carga un informe anterior; combine --previous con --fail-on cuando esos hallazgos deban detener un lanzamiento. Si los controles MCP detienen a Guardian antes de la ejecución del objetivo, tanto el modo de informe como el modo de puerta devuelven una respuesta con forma de Guardian que incluye execution_contract, summary y findings; el modo de puerta además incluye guardian_gate.passed=false. El informe incluye una sección execution_contract para que los objetivos omitidos, con error y ejecutados sean visibles en un solo lugar, incluidas las exportaciones Markdown y HTML.

security_gate(path, fail_on) de MCP es una puerta rápida solo para el espacio de trabajo. Ahora devuelve security_gate.passed=false en fallos de control MCP como umbrales no válidos, presupuestos de argumentos, límites de presupuesto del espacio de trabajo o excepciones de escaneo, pero informa intencionalmente coverage_model="workspace_only". Use Guardian para decisiones de lanzamiento que necesiten objetivos HTTP, exportaciones de tiempo de ejecución MCP, informes anteriores o contabilidad de brechas de cobertura.

La política de supresión es de cierre ante fallo. suppression-template crea un CSV que vincula cada exención a app_id, audit_profile, la instantánea de fuente actual o el hash de evidencia de revisión, target_id, la huella del hallazgo, el propietario, el motivo y la expiración futura. Una exención no puede reproducirse contra otra aplicación o una instantánea de lanzamiento modificada; las filas no válidas, obsoletas o expiradas añaden un hallazgo de política de severidad alta. Las supresiones no pueden eliminar brechas de cobertura de Guardian ni reglas de fallo de control MCP. field-validation-queue exporta cada candidato de severidad alta/crítica con una huella redactada, subtipo de detector, alcance del artefacto, tipo de ubicación de archivo/cuerpo/cabecera y hash de respuesta disponible. La afirmación estricta de field-validation-report --profile field permanece cerrada hasta que 12-20 aplicaciones propias/de socios, 120 casos etiquetados, 50 positivos, 40 negativos, cinco casos críticos, tres estratos, un conjunto de retención preregistrado con al menos 70 casos, 35 positivos, 35 negativos y 35 candidatos, firmas de revisor/custodio con roles separados y una segunda pasada canónica exacta de Guardian superen todos los umbrales fijos. La precisión general/de retención, el recall de alta/crítica en retención y la especificidad en retención deben superar tanto la estimación puntual como el límite inferior de Wilson al 95%; el recall crítico en retención permanece exactamente en 1.0. Cada candidato debe vincularse a exactamente un alcance congelado de desarrollo/retención. El candidato (false_positive + benign) / (true_positive + false_positive + benign) se informa como tasa de falsos descubrimientos; la tasa de falsos positivos se calcula solo sobre casos limpios como FP / (FP + TN). La puerta de liberación de datos es más estricta: cualquier falso negativo conocido o candidato benigno de alta/crítica bloquea el lanzamiento. K_GUARD_FIELD_REVIEWER_HMAC_KEYS y K_GUARD_FIELD_CUSTODIAN_HMAC_KEY deben ser distintos de la clave de evidencia del operador; estos HMAC locales separan roles pero no prueban identidad del mundo real ni ejecución criptográficamente independiente. Los comandos heredados validation-* agregan solo etiquetas de candidatos y no pueden establecer el recall de campo.

El contrato público de calificación de bloqueo automático es independiente de la validación de campo. release_blocker_actionability_v3 requiere un censo preregistrado de al menos 100 bloqueadores automáticos, 0.90 de capacidad de acción de candidatos y un límite inferior de Wilson al 95% de 0.80. También requiere bloqueadores automáticos en al menos 20 aplicaciones. Una aplicación cuenta como totalmente accionable solo cuando cada bloqueador automático en esa aplicación está etiquetado como true_positive; tanto su tasa de aplicaciones totalmente accionables como su límite inferior de Wilson deben superar 0.90 y 0.80. Esta puerta de sensibilidad a nivel de aplicación evita que docenas de líneas correlacionadas en un repositorio creen una falsa confianza estadística. Las retenciones de revisión manual e integridad de políticas permanecen con cierre ante fallo pero se excluyen de la capacidad de acción de bloqueo automático.

El contrato completo de nivel de evidencia, primera línea base, etiquetado y ejecución repetida está documentado en docs/field-validation-v2-ko.md.

data-release-gate es más estricto: requiere K_GUARD_EVIDENCE_HMAC_KEY, el manifiesto original de Guardian, una afirmación canónica high de Guardian vinculada al informe actual, instantáneas de evidencia de objetivo y de fuente, originales de Guardian de validación de fuente primaria y repetida firmados por separado, los CSV exactos de verdad fundamental/revisor, la preregistración original del custodio, evidencia del corpus coreano y el flujo reenviado real del interceptor MCP. Vuelve a ejecutar la validación de campo a partir de esos originales, revalida los HMAC de revisor/custodio y requiere que la proyección recalculada sea igual al informe enviado. También reabre el Guardian repetido y verifica de forma independiente contenido, paquete, atestación de ejecución, cadena de herramientas, manifiesto, entradas de fuente/HTTP/MCP y el multiconjunto exacto de candidatos. La validación con socios de diseño es intencionalmente independiente de la aplicación única que se está lanzando actualmente; sus referencias de aplicación/objetivo/hallazgo candidatas deben coincidir con el informe Guardian de la fuente de validación, no hacerse pasar por cobertura de la aplicación en lanzamiento. Una plantilla reutilizable de GitHub Actions está en docs/templates/github-actions/guardian-release-gate.yml.

El JSON no autenticado se divide por riesgo. La estructura de registros sensibles/privados permanece como DYN_UNAUTH_API_JSON con severidad alta; el JSON sin esos indicadores se convierte en DYN_PUBLIC_API_JSON_REVIEW con severidad informativa para que una API pública intencional no bloquee el lanzamiento solo por devolver JSON.

scripts/site_scale_calibration.py ejecuta fixtures HTTP locales de caja negra para ruido HTML general a gran escala, páginas de contacto públicas medianas, JSON masivo generado por vibración a pequeña escala, identificadores fuertes válidos y JSON de cuentas bancarias. No utiliza acceso a red externa.

scripts/deep_probe_synthetic_calibration.py ejecuta un arnés de calibración sintético de bucle local a través de la misma ruta scan_url(..., deep_active=True) del panel. La ejecución de evidencia predeterminada utiliza 500 invocaciones de bucle local en 24 escenarios acotados; esto no son 500 sitios web reales, no es descubrimiento de vulnerabilidades y no es prueba de penetración. Cubre .env, .git/config, SQL de respaldo, endpoints de depuración, exposición de administración/API, OpenAPI, mapas de fuente, CORS, redirecciones, niveles de respuesta de PII/secretos y controles de falsos positivos para muros de inicio de sesión, carcasas SPA y respaldos HTML. También incluye controles negativos que demuestran que el puntuador esperado-vs-observado puede detectar reglas inyectadas faltantes e inesperadas. No utiliza acceso a red externa; las sondas profundas externas reales aún requieren autorización explícita del objetivo.

scripts/inner_core_product_gate.py ejecuta la puerta de producto sintética local más amplia para la afirmación de auditoría del "núcleo interno". Combina la calibración de sonda profunda de bucle local de 500 objetivos con verificaciones estáticas de código/config/texto MCP, análisis de flujo de datos AST de Python, observación JSONL de tiempo de ejecución MCP, conectores de solo lectura de SQLite/log/almacenamiento, revisión de retención/eliminación, veredictos de PII entre planos hacia agentes/externos y verificaciones de grafo de evidencia sin datos sin procesar. Esta puerta debe tener cero reglas requeridas faltantes, cero reglas de sonda profunda inesperadas, controles negativos superados, nodos/bordes de grafo de flujo no vacíos y sin marcadores sin procesar prohibidos en el informe serializado. Es una puerta de profundidad de producto, no una prueba de descubrimiento de vulnerabilidades en sitios de terceros.

El flujo de trabajo de CI ejecuta la suite completa de pytest más una puerta de núcleo interno de 24 objetivos en push/solicitud de extracción, que cubre cada escenario sintético una vez. El flujo de trabajo de auditoría programado/manual ejecuta la puerta de núcleo interno de 500 objetivos y sube su paquete de evidencia JSON/Markdown/HTML. El escaneo SARIF autoaplicado del repositorio se sube como evidencia no bloqueante porque este repositorio de escáner contiene intencionalmente reglas de detector, fixtures y ejemplos de documentación que deberían activar hallazgos de K-Guard; use --fail-on contra el producto que se audita, no contra el propio árbol de fuentes cargado de fixtures de K-Guard, a menos que exista una línea base específica del proyecto.

scripts/passive_homepage_calibration.py ejecuta calibración de página de inicio GET / solo pasiva desde un manifiesto CSV. Admite --max-targets, --delay-ms, --checkpoint-jsonl y --resume para ejecuciones fragmentadas a escala de 10k. Informa agregados de cohorte, cubo de rango, resultado y nivel de higiene como well_managed_quiet, hardening_gap, boundary_redirect y messy_or_risky_signal, de modo que los sitios ruidosos bien gestionados y los sitios desordenados de cola larga puedan calibrarse por separado. También emite un release_gate con verificaciones de aprobación/advertencia/fallo para rendimiento de medición, tasa de alta/crítica, tasa de identificadores fuertes y tasa de redirecciones de límite. No solicita /admin, /api, .env, .git, OPTIONS ni rutas recursivas.

scripts/build_top_domain_manifest.py crea ese manifiesto de calibración pasiva automáticamente desde una fuente CSV o ZIP de dominios públicos. La fuente predeterminada es el último ZIP top-1m de Tranco, por lo que los operadores no necesitan recopilar manualmente 10,000 URL. Use --start-rank para construir cohortes de candidatos desordenados de cola larga, por ejemplo, los rangos 900,001 a 910,000. También se pueden proporcionar CSV estilo Majestic Million con --source-url.

Evidencia RC del concurso solo IA

El RC del concurso mantiene la evidencia de desarrollo en carriles separados en lugar de publicar un único número de precisión combinado:

python scripts/qualify_korean_privacy_ai_only.py --output evidence/qualification/korean-privacy-ai-only-v1.json
python scripts/ai_public_benchmark_scorecard.py --output evidence/qualification/ai-public-benchmark-scorecard-v1.json
python scripts/benchmark.py --profile contest --output benchmark-report.json
  • El informe de calificación coreano reporta 117 casos de fixtures y un conjunto de retención congelado de 68 casos redactado por el evaluador como carriles separados. También verifica cinco contratos de espacio de trabajo, los cuatro conceptos oficiales de identificador único, los límites de números de negocio/corporativos y seis superficies de vocabulario sensible. No publica una matriz de confusión combinada ni afirma precisión ciega, adjudicada por humanos, de registro, de socios o de campo.

  • La tarjeta de puntuación pública preserva los carriles actuales e históricos por separado. --require-integrity-pass falla deliberadamente mientras cualquier artefacto histórico seleccionado tenga una discrepancia de digesto o vinculación; aún se puede generar un informe para que un resultado histórico inadmisible permanezca visible en lugar de ser reescrito o eliminado silenciosamente.

  • El perfil de rendimiento del concurso mide corpus sintéticos exactos de señal baja todos benignos en un host divulgado, incluida la latencia en frío de proceso nuevo y en caliente de escáner persistente, escalado de 10/50/100 MiB, concurrencia de subprocesos CPython en proceso 1/4/8, RSS máximo, cobertura completa de candidatos e invariancia de resultados sin datos sin procesar. No mide escalado denso en hallazgos, paralelismo a nivel de proceso, SLO de producción, precisión de campo, comparación normalizada por hardware ni superioridad de terceros.

Límites actuales

  • Hoja de ruta de endurecimiento del producto: docs/pre-release-auditor-hardening-plan-ko.md

  • La extracción de PDF/DOCX/HWP aún no está incluida

  • Las comprobaciones dinámicas son solo para localhost, salvo que se incluyan explícitamente en la lista de permitidos o que el operador las atestigüe para un objetivo externo propio, aprobado por un socio o dentro del alcance de un programa de recompensas por errores

  • Las cabeceras de sesión proporcionadas por el usuario solo se adjuntan a solicitudes GET de solo lectura y los valores de las cabeceras no se almacenan

  • El análisis de flujo de datos (taint) JS/TS es conservador y ligero, con taint dentro del archivo, resúmenes limitados de ruta a servicio y heurísticas conscientes del framework para errores comunes de límites en Next.js/Express/Supabase/Firebase; el taint AST de Python es intraprocedimental

  • La observación MCP en tiempo de ejecución y la herramienta MCP enforce_mcp_events siguen siendo consultivas; mcp-proxy y mcp-http-proxy realizan la aplicación bidireccional real para JSON-RPC stdio delimitado por líneas y el ciclo de vida Streamable HTTP probado. El enmarcado binario, los transportes no estándar y un proxy universal de sustitución para cada cliente permanecen fuera del límite aplicado

  • La base de datos/almacenamiento/copias de seguridad remotas y la ejecución real de la eliminación aún no se verifican

  • Los patrones de PII coreanos se basan en reglas y necesitan un ajuste de falsos positivos específico del proyecto

  • Los números de registro de empresas coreanas utilizan validación de sintaxis de suma de verificación en fixtures sintéticos/creados por el proveedor. Los números de registro corporativo históricos (emitidos antes del 2025-01-31) pueden usar el antiguo anexo con suma de verificación ponderada alterna 1,2. Desde el 2025-01-31, los números corporativos actuales son 4 dígitos de registro + 2 de tipo + 7 de serie sin suma de verificación, por lo que la detección es solo reconocimiento explícito de contexto de campo/sintaxis. Nada de esto es PII de persona natural, validación de registro en vivo ni validación de campo independiente. Los valores actuales solo de contexto son reconocimiento de sintaxis/contexto no verificado. Ambigüedad prioritaria de privacidad: un RRN/FRN coreano plausible prevalece sobre una etiqueta corporativa o empresarial, cabecera o clave JSON dividida, y nunca se clasifica ni redacta como ID de organización.

  • El conjunto de retención (holdout) coreano sensible/org de 68 casos creado por el evaluador (evidence/holdout/korean-sensitive-org-v1.cjson) es una inspección posterior a la implementación de oráculos sintéticos, no un estudio ciego de precisión de campo ni de validación de registro. Un caso pasa cuando cada regla must_all está presente, cada grupo must_any tiene al menos una regla coincidente y no aparece ninguna regla forbidden (recall de cualquier regla por caso). Tras esta pasada, el manifiesto congelado puntúa 68/68 con recall 1.0, especificidad 1.0 y repetición exacta de dos ejecuciones. Eso no es una afirmación de precisión de campo en vivo.

Available Tools

28 tools
build_flow_mapC

Build an EXPERIMENTAL heuristic data-flow risk map for source and sink patterns.

NameRequiredDescriptionDefault
pathYes

TDQS

C2.4/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries full responsibility for behavioral disclosure. It only labels the tool as 'EXPERIMENTAL heuristic', which hints at unreliability but does not describe side effects, return behavior, or whether it is read-only. This is insufficient for a tool that might have complex outputs.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single clear sentence with no wasted words. It is front-loaded with the action and subject, making it easy to parse. However, it is minimal to the point of missing critical details, which slightly lowers the score.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness1/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The description provides only a high-level purpose and fails to explain the parameter, expected output, or any operational context. Given the lack of annotations and output schema, this is severely incomplete for an agent to call the tool correctly.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The schema has 0% description coverage, and the description does not mention the 'path' parameter at all. There is no explanation of what 'path' should point to or its format, leaving the agent completely uninformed about the only required input.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool builds a data-flow risk map for source and sink patterns, using a specific verb and resource. It is not a tautology and is distinguishable from sibling audit tools, though it doesn't explicitly name alternatives.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus others, nor any exclusions or alternative tools. The single-sentence description offers no contextual triggers or prerequisites.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

check_my_appB
Read-only

Review the complete bound workspace; poll with continue_review until terminal.

NameRequiredDescriptionDefault
pathNo검사할 프로젝트 경로. 설치 시 고정된 워크스페이스에서는 '.'을 사용합니다..
include_flowNo소스에서 입력·처리·외부 전송 흐름 분석을 함께 실행합니다.

Output Schema

NameRequiredDescription
methodYes
findingsNo
experienceYes
review_jobNo
guardian_gateNo
review_receiptNo
primary_workflowNo
application_assuranceNo
auditor_qualificationNo

TDQS

B3.4/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and destructiveHint=false, so the safety profile is covered. The description adds the polling behavior, which is genuinely useful beyond annotations, but it does not explain what 'terminal' means, what the response contains, or any side effects (e.g., state changes between polls). Since it adds some behavior context but not full transparency, a 3 is appropriate.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is two short sentences with no filler. The core purpose ('Review the complete bound workspace') is front-loaded, and the polling instruction is a necessary operational detail. It could arguably be more structured (e.g., listing return behavior), but it is appropriately concise for the amount of information it conveys.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The tool has a rich output schema (which likely explains the 'terminal' state and review results), so the description does not need to detail return types. However, the phrase 'until terminal' is ambiguous without context on how to recognize terminality, and the description does not clarify the scope of 'complete bound workspace' or what 'review' entails (e.g., security, code quality, dependencies). Given the complexity of a polling-based review, the description is minimally complete but leaves gaps that the schema and sibling definitions may or may not fill.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema already documents both parameters fully (100% coverage), including the meaning of 'path' ('checks the project path; use '.' for the fixed workspace') and 'include_flow' (whether to run input/processing/external transmission flow analysis). The description adds nothing about parameters beyond what the schema provides, so the baseline 3 applies.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description specifies a clear verb ('Review') and a resource ('the complete bound workspace'), so an agent can deduce the tool's core function. It also hints at a distinctive workflow (polling with continue_review) that sets it apart from simpler scans, but it doesn't explicitly name or contrast siblings, so it stops short of a 5.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The instruction 'poll with continue_review until terminal' gives a usage pattern, implying this is a long-running operation and that continue_review is the follow-up tool. However, it does not state when to prefer this over alternatives like scan_workspace or start_review_before_ship, nor does it give exclusions or prerequisites. The guidance is implicit rather than explicit.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

continue_reviewA
Read-onlyIdempotent

Wait briefly for a long review; repeat until state is completed or failed.

NameRequiredDescriptionDefault
review_idYescheck_my_app 또는 start_review_before_ship이 돌려준 검수 번호
wait_secondsNo한 번에 기다릴 시간(0~4초). 완료될 때까지 이 도구를 반복 호출합니다.
finding_limitNo완료 결과에 포함할 findings 수(1~50)
response_modeNocompact(기본) 또는 full(호환용 전체 결과)compact
finding_offsetNo완료 결과 findings 페이지 시작 위치

Output Schema

NameRequiredDescription
methodYes
findingsNo
experienceYes
review_jobNo
guardian_gateNo
review_receiptNo
primary_workflowNo
application_assuranceNo
auditor_qualificationNo

TDQS

A3.8/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate read-only, idempotent, and non-destructive behavior. The description adds valuable context about the iterative waiting mechanism and the terminal states, which goes beyond what annotations declare. This clarifies that multiple calls may be needed and defines the loop exit condition without contradicting the annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, front-loaded sentence that captures the essential behavior and stop condition. It contains no redundant details, and for a tool with 5 parameters, the schema fully covers parameter specifics, so brevity is both appropriate and efficient.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The description conveys the core polling loop and terminal decisions, sufficient for an agent to understand the call pattern. With annotations covering safety and schema covering parameters, the description need not list parameters or response format. It could be more explicit about error handling or max retry expectations, but for a standard polling tool this is adequately complete.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with detailed per-parameter descriptions (e.g., wait_seconds limits, finding_limit range), so the description adds no parameter-level value. As per baseline for high schema coverage, a score of 3 is appropriate since the description effectively delegates parameter comprehension to the schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states a clear action ('Wait briefly') and a specific resource ('a long review') with an explicit termination condition ('until state is completed or failed'). It distinguishes itself from sibling start_review_before_ship by being the polling/waiting counterpart, making its role unambiguous.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies a polling loop but does not explicitly state when to call it, such as after start_review_before_ship or check_my_app. It lacks any mention of alternative tools or exclusion criteria, leaving preparation and sequencing to caller inference. The schema's review_id description helps but is not part of the tool description itself.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

create_benchmark_templateC

Create a 20/20/10 field benchmark manifest CSV template.

NameRequiredDescriptionDefault
output_pathYes

TDQS

C2.4/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries the full burden. It only says 'Create' without disclosing side effects, such as whether it overwrites an existing file, what the return value looks like, or any permission requirements. The description adds no behavioral context beyond the trivial fact of creation.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness3/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, concise sentence with no waste. However, it is too terse, sacrificing necessary detail for brevity. Front-loading is acceptable, but the cryptic '20/20/10' and lack of any explanation reduce its effectiveness.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple tool with one parameter and no annotations, the description should at least explain what a 'benchmark manifest' is, whether the file is created or overwritten, and any output expectations. The description lacks these details, making it incomplete for an agent to use correctly without prior domain knowledge.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The schema has only one parameter, output_path, with zero description coverage. The description does not mention the parameter at all, so an agent has no information about the expected format, whether it's a directory or full path, or the file name conventions. The description fails to compensate for the lack of schema documentation.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states a clear verb ('Create') and a specific resource ('20/20/10 field benchmark manifest CSV template'). The 'benchmark' keyword distinguishes it from sibling template tools like create_field_campaign_template and create_guardian_manifest_template. It is specific but leaves the meaning of '20/20/10' unexplained, so not a 5.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus the sibling template tools. There is no mention of alternatives, exclusions, or selection criteria. An agent would have to infer usage from the name alone, which is not sufficient when similar templates exist.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

create_field_campaign_templateC

Create the empty 12-20 app owned/partner roster used before holdout preregistration.

NameRequiredDescriptionDefault
output_pathYes

TDQS

C2.4/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries full responsibility for disclosing behavioral traits. It only says 'create', which is generic and matches the tool name; it does not mention whether the operation is destructive, whether it overwrites existing files, what permissions are required, or what success/error responses look like. The description adds minimal value beyond the tool name.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness3/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is extremely concise (a single sentence) with no wasted words. However, it is so terse that it omits essential details, making it under-specified rather than efficiently structured. It is neither bloated nor well-organized; it simply lacks substance.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a tool with one parameter, no output schema, and no annotations, the description should at least clarify what 'empty roster' means, what output_path should point to, and any prerequisites or side effects. The description only gives a vague workflow hint ('before holdout preregistration') and leaves the main operational details undocumented, making it insufficient for a correct call.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The schema has no parameter descriptions (coverage 0%) and the tool description does not mention the 'output_path' parameter at all. Even though the parameter name is somewhat self-explanatory, the description fails to elaborate on expected format, path conventions, or default behavior. The description offers zero assistance for correct parameter usage.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states a specific verb ('Create') and a specific resource ('empty 12-20 app owned/partner roster'), and gives a context cue ('before holdout preregistration'). It is clear about what the tool does, though it does not explicitly contrast with sibling template creators like create_benchmark_template or create_guardian_manifest_template. The purpose is distinguishable by the unique resource name.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The phrase 'used before holdout preregistration' implies a temporal context but does not give explicit when-to-use vs when-not-to-use guidance, nor does it mention any alternative tools or conditions for choosing this tool over a sibling. There is no guidance on preconditions or expected workflow.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

create_guardian_manifest_templateC

Create a korean_senior Guardian manifest for four-domain pre-release reviews.

NameRequiredDescriptionDefault
output_pathYes

TDQS

C2.9/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations provided, the description carries the full burden of disclosing side effects. It says 'create' but does not describe whether the tool overwrites existing files, requires specific permissions, or produces a specific return value. The lack of behavioral detail (e.g., idempotency, error conditions) leaves the agent without important operational context.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, focused sentence that is front-loaded with the action. It is concise without padding, but its brevity comes at the cost of missing critical details, making it more under-specified than efficiently concise.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a mutation tool that creates a file, with no annotations, no output schema, and no parameter documentation, the description is far from complete. It omits details about the manifest structure, default behavior, and parameter semantics, which an agent would need to invoke the tool correctly and safely.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the description must compensate by explaining the output_path parameter. It does not: the description only mentions the manifest creation and gives no guidance on the expected format, constraints, or usage of output_path. The parameter name is self-explanatory but the description adds no additional semantic value.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'Create' and the resource 'a korean_senior Guardian manifest', and adds the specific context of 'four-domain pre-release reviews.' This distinguishes it from sibling template tools like create_benchmark_template and create_field_campaign_template, making the purpose unambiguous.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage for pre-release reviews but does not explicitly state when to use this tool versus similar template creators, nor does it mention any exclusions or alternatives. An agent would have to infer the use case from the name and description, lacking explicit routing guidance.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

data_release_gateC

Run the strict data shipment gate over Guardian, validation, Korean corpus, and MCP interceptor evidence.

NameRequiredDescriptionDefault
guardian_report_pathYes
guardian_manifest_pathYes
validation_report_pathYes
validation_review_pathYes
validation_roster_pathYes
korean_corpus_report_pathYes
mcp_forwarded_output_pathYes
mcp_intercept_report_pathYes
korean_fixture_corpus_pathYes
validation_ground_truth_pathYes
validation_preregistration_pathYes
max_validation_false_positive_rateNo
validation_repeat_guardian_report_pathYes
validation_source_guardian_report_pathYes

TDQS

C2.4/5.0
Behavior1/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations are absent, so the description carries the full burden of behavioral disclosure. It only says 'Run' the gate, without stating whether it is read-only, destructive, requires specific inputs, or what happens on failure. With 14 parameters and no cautions, the agent has no idea of side effects or prerequisites—a serious gap.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, concise sentence that front-loads the action and lists evidence categories. There is no filler or redundancy. However, given the tool's complexity, it is overly terse, though conciseness itself is well-handled.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness1/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a tool with 14 required parameters, no annotations, no output schema, and no parameter descriptions, the description is grossly incomplete. It fails to explain what each path is for, what the gate checks, success criteria, side effects, or output format. An agent cannot confidently invoke this tool correctly.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the description must compensate. It groups evidence into Guardian, validation, Korean corpus, and MCP interceptor categories, which helps map high-level intent but does not explain the 14 specific path parameters, their expected formats, or relationships. This is insufficient for an agent to correctly populate all required fields.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states a specific verb 'Run' and resource 'strict data shipment gate', and lists the evidence sources (Guardian, validation, Korean corpus, MCP interceptor). It is clear what the tool does overall, though it does not explicitly differentiate from sibling tools like security_gate or guardian_audit. The distinctive evidence components give some differentiation, hence a 4.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

There is no guidance on when to use this tool versus alternatives. It omits prerequisites, exclusions, or context clues such as 'use this before shipping data' or 'do not use if X'. The agent must infer usage from the tool name and stack. This is a significant miss for a tool with many related siblings.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

deep_analyzer_auditC

Run the local fail-closed Semgrep deep profile; this is intrafile evidence, not an authorization proof.

NameRequiredDescriptionDefault
workspace_pathYes

TDQS

C2.7/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries the full burden but only discloses a few behavioral traits: 'fail-closed' and 'intrafile evidence, not an authorization proof'. These are useful, but it does not mention permissions, side effects, rate limits, or output behavior. It adds some context beyond the schema but leaves many aspects undisclosed.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is extremely concise—one sentence with two clauses—and front-loads the action. Every word earns its place, but the brevity leaves essential details missing, so it is efficient but not optimally informative.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given that this is a security audit tool with only one parameter and no output schema, the description is incomplete. It does not explain the return value, the exact meaning of 'workspace_path', prerequisites, or how the result relates to other tools. The caveats about fail-closed and non-authorization are helpful, but the agent lacks critical operational details.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the description must compensate for the parameter 'workspace_path', but it provides no explanation of what this parameter expects, its format, or its purpose. The agent has no additional information beyond the variable name, making it difficult to invoke correctly.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states a specific action ('Run the local fail-closed Semgrep deep profile') and a clear resource (Semgrep deep profile), with an additional qualifier about its scope ('intrafile evidence, not an authorization proof'). It is clear about what the tool does, though it does not explicitly differentiate from sibling tools like scan_workspace or software_composition_audit.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

There is no guidance on when to use this tool versus alternatives. The phrase 'intrafile evidence' hints at a single-file analysis scope, but it does not state conditions or mention sibling tools. No exclusions or alternative routing is provided.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

enforce_mcp_eventsC

Evaluate MCP runtime block/redact policy and return a raw-free report-only interceptor result.

NameRequiredDescriptionDefault
textYes
labelNomcp-runtime-events

TDQS

C2.4/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description must carry all behavioral disclosure. It mentions 'report-only' (non-destructive) and 'raw-free' (does not expose raw data), which are helpful, but it does not clarify whether any state is modified, whether authentication is needed, or the exact nature of the interceptor result. The disclosure is partial despite carrying the full burden.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence with the primary action front-loaded. It is concise and avoids filler, though it may be too terse for the tool's complexity. In terms of structure, it communicates the core action efficiently.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness1/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given no output schema, no annotations, minimal parameter documentation, and a relatively complex policy-evaluation task, the description is severely incomplete. It fails to explain the interceptor result, parameter semantics, or any side effects, leaving the agent without enough context to invoke the tool correctly.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0% and the description does not explain the purpose of the 'text' or 'label' parameters. An agent cannot infer what text to pass or how label affects the call. The description adds no meaning beyond the generic parameter names.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description uses a specific verb ('Evaluate') and resource ('MCP runtime block/redact policy') and indicates the output type ('raw-free report-only interceptor result'). It distinguishes from siblings like observe_mcp_event (observation) and scan_mcp_config (scanning), though 'raw-free' and 'interceptor' are jargon that could confuse agents.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit guidance on when to use this tool versus its siblings. It does not mention alternatives, exclusions, or prerequisites. The only implicit signal is the verb 'Evaluate' suggesting policy enforcement, but nothing clarifies a selection condition.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

explain_ruleB
Read-onlyIdempotent

Explain a K-Guard rule in plain language with impact, fix steps, and verification.

NameRequiredDescriptionDefault
rule_idYes

TDQS

B3.1/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint, idempotentHint, and destructiveHint, covering the safety profile. The description adds that the tool provides impact, fix steps, and verification, which is useful context beyond a generic 'explain'. However, it does not disclose output format, error handling, or any other behavioral traits, so the added value is moderate.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

A single sentence that front-loads the action and lists the key outputs. There is no fluff, and it is concise without being under-specified—every word contributes to describing the tool's function.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple tool with one parameter and annotations covering safety, the description is minimal but conveys the purpose. However, it lacks usage guidance and parameter semantics, and it does not contextually place itself among the many sibling tools. An agent would not know when to call it or how to find the rule_id, leaving notable gaps.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The schema provides only the parameter name 'rule_id' with type string and no description. The tool description does not explain what a rule_id is, how to obtain it, or its format. With 0% schema description coverage, the description wholly fails to compensate, leaving the agent with no semantic context for the sole required parameter.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states a specific action ('Explain a K-Guard rule') on a specific resource, and lists the content of the explanation (impact, fix steps, verification). This distinguishes it from siblings like suggest_fix, which focuses on proposing fixes rather than explaining a rule.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

There is no guidance on when to use this tool versus alternatives like suggest_fix or scan_workspace. It does not mention why one would prefer an explanation over a fix suggestion, nor any conditions or prerequisites, leaving the agent to infer usage.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

field_benchmarkC

Aggregate field benchmark reports by cohort; probes require explicit MCP probe opt-in.

NameRequiredDescriptionDefault
run_probesNo
review_pathNo
manifest_pathYes

TDQS

C2.7/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations provided, the description must convey behavioral traits such as side effects, return values, or error conditions. It only discloses that probes need explicit opt-in and that results are aggregated by cohort. It does not describe what the tool returns, whether it is read-only, or any side effects. The sparse disclosure leaves the agent uncertain about the tool's full behavior.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is two short sentences with no redundant wording. The primary action is stated first, followed by a specific constraint. Every word adds some value, and the structure is front-loaded with the main purpose.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given three parameters, no output schema, and no annotations, the description is insufficient. It does not explain what manifest_path should reference, what run_probes does beyond the opt-in hint, or the role of review_path. An agent would need external knowledge to invoke this correctly. The description covers only a fraction of the necessary context for a tool of this complexity.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema has 0% description coverage, so the description must explain the parameters. It does not define manifest_path, run_probes, or review_path beyond their names. The mention of cohort and probe opt-in hints at some parameter usage, but not enough for an agent to correctly fill in all parameters without further knowledge. The description compensates poorly for the missing schema documentation.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states a specific verb ('Aggregate') and resource ('field benchmark reports') with a clear qualifier ('by cohort'). It distinguishes the tool from siblings like create_benchmark_template or field_campaign_status, which deal with creation or status rather than aggregation. The probe opt-in clause adds a specific characteristic, but the description does not explicitly name any sibling for comparison.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description gives no guidance on when to use this tool over alternatives. It states a requirement about probes ('probes require explicit MCP probe opt-in') but does not explain when aggregation is appropriate or when to choose another tool. There is no mention of context, prerequisites, or exclusions.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

field_campaign_statusC

Validate the app roster and emit a raw-free fail-closed campaign status.

NameRequiredDescriptionDefault
output_pathYes
roster_pathYes

TDQS

C2.4/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description must disclose behavior. 'Fail-closed' hints at error handling but doesn't explain side effects, required permissions, or what happens on failure. 'Raw-free' suggests output transformation but is undefined.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness3/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence with no waste, but it sacrifices substance for brevity. It is concise in length but not in delivering necessary information.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness1/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With two required parameters and no output schema, an agent cannot infer what output looks like, what 'raw-free' means, or what 'fail-closed' implies. The description is inadequate for safe invocation.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 0%, so the description must define both required parameters. It never mentions roster_path or output_path, leaving their purpose entirely unclear.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description identifies a specific action ('validate') and resource ('app roster'), with a defined outcome ('emit a campaign status'). It is distinct from sibling validation tools by focusing on campaign status.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is given on when to use this tool versus alternatives like validate_policy_controls or scan_workspace. It does not state prerequisites, exclusions, or selection criteria.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

guardian_auditC

Run Guardian; korean_senior rows require four review domains and fail closed when fail_on is set.

NameRequiredDescriptionDefault
fail_onNo
run_scaNo
run_probesNo
manifest_pathYes
previous_report_pathNo
mcp_http_proxy_report_pathNo
field_validation_report_pathNo
control_validation_report_pathNo
language_validation_report_pathNo

TDQS

C2.2/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Since no annotations are provided, the description must carry the full burden of behavioral disclosure. It does reveal two behaviors: the requirement for four review domains for korean_senior rows and the fail-closed behavior when fail_on is set. However, it does not disclose whether the tool is read-only, what it modifies, any authentication requirements, or any side effects. This is insufficient for an audit tool of this complexity.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness2/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence that combines two unrelated pieces of information with a semicolon. It is concise but severely under-specified for a tool with 9 parameters. The structure does not front-load the most important information about the tool's purpose or usage; instead it focuses on an edge case about korean_senior rows.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness1/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a tool with 9 parameters, no annotations, and no output schema, the description is drastically incomplete. An agent has no understanding of what the tool returns, what most parameters do, or what the audit covers. The description only addresses a narrow scenario, leaving the agent to guess about the rest.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the description should compensate by explaining key parameters. It only hints at 'fail_on' by mentioning it in the fail-closed clause, but does not explain its values or purpose. Parameters like run_sca, run_probes, and various report paths are left completely unexplained, making it hard for an agent to know how to set them.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose3/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states 'Run Guardian' which identifies the action, but it does not explain what Guardian does or why it would be used. The mention of 'korean_senior rows' and 'four review domains' suggests a specific audit context, but without knowing what Guardian does, the purpose remains ambiguous. It distinguishes from siblings only by name, not by functionality.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description gives a specific condition: 'korean_senior rows require four review domains' and 'fail closed when fail_on is set.' This hints at when this tool might be needed, but it does not explicitly state when to use this tool over alternatives like deep_analyzer_audit or software_composition_audit. There is no guidance on exclusions or when not to use it.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

observe_mcp_eventC

Observe one MCP runtime event and return stream-ready block/redact policy decisions.

NameRequiredDescriptionDefault
textYes
labelNomcp-runtime-event
session_idNodefault

TDQS

C2.9/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries the full burden of behavioral disclosure. It mentions 'observe' which hints at read-only, but does not state whether the tool has side effects, modifies state, requires specific permissions, or what 'stream-ready block/redact policy decisions' entail. The description is too vague to inform an agent about side effects or constraints.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence that front-loads the core action and output. It is concise with zero wasted words, making it easy to parse quickly.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a tool with 3 parameters, no output schema, and no annotations, the description is incomplete. It does not explain how to construct the input, what the return value looks like, or any operational context (e.g., streaming behavior, policy format). An agent calling this tool would lack essential details to use it correctly.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, meaning the schema provides no explanation for parameters. The description does not compensate by explaining the role of 'text', 'label', or 'session_id'. There is no guidance on what content to pass or how these parameters influence the output. This is a significant gap for a 3-parameter tool.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states a specific verb ('observe'), a specific object ('one MCP runtime event'), and the result ('return stream-ready block/redact policy decisions'). It clearly differentiates from sibling tools like observe_mcp_events (plural) and enforce_mcp_events by emphasizing the singular scope and the decision-returning action.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

There is no explicit guidance on when to use this tool versus its siblings. The description implies usage for a single event but does not state when to prefer it over observe_mcp_events or enforce_mcp_events. No exclusions or alternative conditions are provided, leaving the agent to infer the context.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

observe_mcp_eventsB

Observe MCP runtime/proxy JSONL events for PII, hidden instructions, and agentic/external flow.

NameRequiredDescriptionDefault
textYes
labelNomcp-runtime-events

TDQS

B3.4/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations provided, the description carries the full burden of behavioral disclosure. It does explain that the tool scans for PII, hidden instructions, and agentic/external flow, which gives insight into its function. However, it does not explicitly state whether the tool is read-only, has side effects, or requires network access. The term 'observe' implies passivity, but this is not confirmed.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, well-structured sentence that delivers the core purpose upfront and appends the specific detection targets. It contains no superfluous words and is highly efficient, making it easy for an agent to parse quickly.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the absence of an output schema and annotations, the description should at least hint at what the tool returns. It does not mention output format or return values. Additionally, it fails to explain the role of the optional 'label' parameter. For a tool with only two parameters, the description is reasonably complete for the primary action but leaves critical context gaps for a fully informed call.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The schema description coverage is 0%, so the description must compensate for parameter clarity. The description implies that the 'text' parameter contains JSONL events (from 'Observe MCP runtime/proxy JSONL events'), but it does not explicitly map description content to parameters, and the 'label' parameter is completely unexplained. This leaves the agent uncertain about parameter formatting and purpose.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action (observe) and the resource (MCP runtime/proxy JSONL events) and specifies the focus (PII, hidden instructions, agentic/external flow). This distinguishes it from sibling tools like 'observe_mcp_event' (singular) and 'enforce_mcp_events' (different action) without needing to inspect their schemas.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description does not provide any guidance on when to use this tool versus alternatives. It does not mention specific scenarios or indicate conditions where a different tool would be more appropriate. No exclusions or alternative references are given.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

probe_httpC

Run safe read-only HTTP probes against localhost or explicitly authorized external targets.

NameRequiredDescriptionDefault
base_urlYes
deep_activeNo
session_fileNo
authorization_noteNo
external_authorizedNo

TDQS

C2.7/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations provided, the description carries the full burden of behavioral disclosure. It does state 'safe read-only', indicating non-mutating behavior, and restricts targets to localhost or authorized external, which is useful. However, it fails to disclose behaviors related to parameters, response format, authentication needs, or rate limiting, leaving significant gaps.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single concise sentence that front-loads the core purpose and target constraint. It avoids redundancy and is easy to parse. However, it is perhaps too brief given the other gaps, but for conciseness alone it is strong.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness1/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool has 5 parameters, no output schema, and no annotations, a complete description would need to cover parameter semantics, expected return values, and use cases. This description only provides a high-level purpose and target restriction, leaving the agent without enough information to call the tool correctly. It is substantially incomplete.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the description must compensate by explaining parameters. It offers no explanation for any of the five parameters (base_url, deep_active, session_file, authorization_note, external_authorized). The agent cannot infer their meaning or usage from the description, which is a severe deficiency.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly identifies the tool as a read-only HTTP prober with specific target constraints (localhost or explicitly authorized external targets). It uses a concrete verb ('Run') and a resource ('HTTP probes'), making the purpose unambiguous. While it doesn't name a sibling, no sibling tool appears similar, so it stands alone effectively.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies use for probing HTTP endpoints but provides no explicit scenarios, alternatives, or exclusions. It does not mention when to prefer another tool or when this tool should not be used. The guidance is inferred from the purpose statement rather than directly stated.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

scan_diffB

Scan only a git diff, without echoing raw diff content in the MCP response.

NameRequiredDescriptionDefault
base_refNoHEAD~1
head_refNoHEAD
workspace_pathNo.

TDQS

B3.4/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries the full burden of behavioral disclosure. It states that raw diff content is not echoed, which is a meaningful behavior. However, it does not describe what the tool does return, whether it is read-only, or any side effects. For a scan tool, this is a partial disclosure; more detail on the output format would improve transparency.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, focused sentence that front-loads the core purpose and the key behavioral absence. It is concise with no redundant wording. However, given the tool's parameters and lack of annotations, it may be slightly under-specified, but it earns its place as an efficient opening statement.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The tool has three parameters, no output schema, and no annotations. The description does not explain parameter semantics, expected output, or usage context beyond the scope of a git diff. An agent would lack crucial details to invoke the tool correctly, making the description inadequate for the tool's complexity.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0% (no parameter descriptions), so the description must compensate. It does not mention base_ref, head_ref, or workspace_path at all. The parameter names and defaults in the schema give some hints, but the description adds no additional meaning, leaving an agent unsure how to set the refs or workspace path correctly.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly identifies the resource (a git diff) and the action (scan), and adds a specific behavioral distinction ('without echoing raw diff content in the MCP response'). This unmistakably differentiates it from sibling scan tools like scan_workspace and scan_text, which target different resources.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies when to use this tool (for scanning a git diff) but does not explicitly mention alternatives or exclusions. An agent can infer the primary use case, but there is no guidance on when NOT to use it versus scan_workspace or scan_text. The scope is clear enough to make an inference, so it is not a complete miss.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

scan_mcp_configC

Discover and scan project MCP configs plus agent instruction and skill components.

NameRequiredDescriptionDefault
pathNo.

TDQS

C2.6/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries the full burden of behavioral disclosure. 'Discover and scan' implies a read operation, but it doesn't state whether it modifies anything, what it returns, how thorough the scan is, or whether it only scans the given path. There is no disclosure of potential side effects or performance implications. Minimal value beyond the literal meaning.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness3/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence, which is concise and front-loads the main verb. However, it is under-specified rather than efficiently detailed. Every word is used, but the ambiguity (e.g., 'discover and scan' vs just 'scan') means the sentence doesn't earn its place as the sole content.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the absence of annotations and output schema, the description must explain the tool's return value and behavior. It does not mention what the scan produces (list of files? config contents?), how to interpret results, or whether the path is required (though default '.' is in schema). For a tool that likely serves as an inventory/analysis entry point, the description is incomplete.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The schema has one parameter 'path' with no description and 0% schema coverage. The description does not explain what 'path' refers to (directory root? file?) or how it affects the scan. Since the schema provides no semantic help and the description adds nothing, parameter understanding is left to guessing.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description uses a clear verb+resource pattern ('Discover and scan project MCP configs plus agent instruction and skill components'), which states what the tool does. It is specific enough about the resource type to distinguish from generic scan tools like scan_workspace, but it doesn't fully delimit scope (what counts as 'agent instruction and skill components' is vague). Not a tautology, but could be sharper.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

There is no mention of when to use this tool versus the many sibling scanning tools (scan_workspace, scan_text, scan_diff, etc.). No context about typical use cases, prerequisites, or exclusions. The description offers no guidance on selection.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

scan_textB

Scan an inline text snippet without writing it to disk.

NameRequiredDescriptionDefault
textYes
labelNoinline-text

TDQS

B3.2/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations provided, the description carries the full burden of behavioral disclosure. It does disclose one meaningful trait: the operation does not write to disk. But it doesn't mention whether the scan is read-only, what side effects or requirements exist, or what the return format is. This is partial disclosure, but not comprehensive.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, concise sentence that leads with the primary action and key constraint. Every word adds value, and it avoids redundant phrasing. It is appropriately sized for a simple tool.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's simplicity (2 params, no output schema), the description covers the core behavior but leaves gaps: parameter semantics are unexplained, and differentiation from sibling scan tools (scan_workspace, scan_diff, etc.) is only implicit. An agent might not know exactly when to choose this over alternatives without additional context.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, and the description provides no information about the parameters. While the names 'text' and 'label' are fairly self-explanatory, the description does not clarify expected formats, defaults, or how the label is used. The description fails to compensate for the lack of schema descriptions.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states the verb 'scan' and the resource 'inline text snippet', clearly distinguishing it from file- or workspace-based scans. However, it doesn't specify the type or goal of the scan (e.g., security, content analysis), leaving some ambiguity about what the scan actually does.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The phrase 'inline text snippet' and 'without writing it to disk' strongly imply the intended use case: scanning text passed directly rather than from a file. However, it doesn't explicitly name alternative tools (e.g., scan_workspace, scan_diff) or state when those would be preferred, so the usage guidance is implied rather than explicit.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

scan_workspaceB

Scan a local workspace for secrets, Korean PII, composite PII, config risks, and flow risks.

NameRequiredDescriptionDefault
pathYes
include_flowNo

TDQS

B3.2/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description must carry the full burden of behavioral disclosure. It does not state whether the scan is read-only, whether it modifies files, what 'flow risks' entail, or what the return format looks like. The tool appears to be a scan, but its side effects and operational implications are opaque, which is a significant gap for a security-related tool.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, focused sentence with no wasted words. It leads with the action and resource, then lists the detection categories. It is efficient, though it could be improved by adding a sentence about parameters or usage without becoming verbose.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's complexity (scanning a whole workspace for multiple risk types) and the absence of an output schema and annotations, the description is insufficient. It does not explain what results are returned, how to interpret them, or the role of the include_flow parameter, leaving an agent with significant uncertainty about how to use the tool correctly.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

With 0% schema description coverage, the description must explain each parameter, but it only indirectly references 'path' via 'local workspace' and completely omits the 'include_flow' boolean. An agent would not know what toggling 'include_flow' does or why it defaults to true. The description fails to compensate for the schema's lack of documentation.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states a specific verb ('Scan'), a resource ('local workspace'), and enumerates the exact categories it detects (secrets, Korean PII, composite PII, config risks, flow risks). This clearly distinguishes it from sibling tools like scan_text or scan_diff that operate on different input types, so an agent can immediately tell what this tool is for.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage context (scanning a directory) via the phrase 'local workspace' and the required 'path' parameter, but it does not explicitly state when to choose this over alternatives like scan_text or scan_diff, nor does it mention any prerequisite conditions. The guidance is present but only implicit.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

score_fixture_corpusB

Evaluate a local fixture corpus and return FP/FN precision/recall scoreboard.

NameRequiredDescriptionDefault
corpus_pathYes

TDQS

B3.1/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations provided, the description carries the full burden. It mentions returning a scoreboard but does not disclose whether the operation is read-only, whether it modifies the corpus, requires specific permissions, or has side effects. The lack of explicit safety cues is a significant gap.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

A single sentence front-loads the core purpose and output. Every word is informative with no filler, earning a top score for efficiency and clarity of structure.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The tool is simple (one required param, no output schema), but the description lacks essential context: required input format, what constitutes a corpus, and any prerequisites. With no annotations to fall back on, this is not complete enough for confident invocation.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the description must explain the 'corpus_path' parameter. It only hints at 'local fixture corpus' without specifying path format, file/directory requirements, or any constraints. This is insufficient for an agent to determine correct input.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states a specific verb ('Evaluate'), a clear resource ('local fixture corpus'), and an explicit output ('FP/FN precision/recall scoreboard'). It uniquely identifies this tool among siblings, which are focused on scanning, validation, and audits rather than scoring a fixture corpus.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided about when to use this tool versus alternatives or any exclusions. The description only states what it does, leaving the agent to infer applicability without any contextual cues or usage conditions.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

security_gateC
Read-onlyIdempotent

Run the quick workspace gate. Use guardian_audit(fail_on=...) for the canonical release gate.

NameRequiredDescriptionDefault
pathNo.
fail_onNohigh
include_flowNo

TDQS

C2.3/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true, idempotentHint=true, and destructiveHint=false, covering mutation safety and side effects. The description adds 'quick' and 'workspace' context, which is slightly beyond annotations. However, it does not disclose what the gate actually does (e.g., what it scans, how it reports failures, whether it touches files). With annotations present, a 3 is appropriate – it adds minimal context but does not contradict or amplify the safety profile.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness2/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is short (two sentences) and front-loaded with the action, but it is under-specified. There is no wasted wording, yet the conciseness does not earn its place because it conveys almost no actionable information. A description this brief would be acceptable only if the schema and annotations carried the load, but they do not for parameters and purpose.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The tool has no output schema, no parameter descriptions, and a minimal description. There is no explanation of what the gate checks, what fail_on levels mean, what include_flow does, or how results are returned. Even with annotations, the agent lacks essential context to decide when and how to call this tool correctly. The description is far from complete for a security gate with three parameters.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, and the tool description does not mention any of the three parameters (path, fail_on, include_flow). The agent must rely purely on parameter names and defaults, which is insufficient for correct invocation. The description completely fails to compensate for the lack of schema descriptions, leaving parameter semantics entirely unexplained.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose2/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states 'Run the quick workspace gate' – a verb and resource, but 'workspace gate' is vague and does not specify what checks are performed, what outcomes are produced, or what 'gate' means in this context. It distinguishes from guardian_audit but does not define its own purpose clearly. A more specific statement like 'Run a lightweight security scan on the workspace' would be clearer.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description explicitly names guardian_audit as the canonical release gate, implying this tool is for a quicker, non-canonical check. This is partial guidance – it tells the agent when *not* to use this tool (for canonical releases) but does not state conditions for when to use this tool itself. It lacks direct 'use this when...' language, but the alternative reference provides some routing.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

software_composition_auditB

Audit Python/npm/Go locks; explicit authorization is required because engines may consult advisory databases.

NameRequiredDescriptionDefault
workspace_pathYes
authorize_advisory_lookupNo

TDQS

B3.2/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries the full burden. It discloses a key behavioral trait: explicit authorization is required because engines may consult advisory databases, implying external network access. However, it does not state whether the tool modifies files or only reads, nor does it describe any other side effects. The disclosure is useful but incomplete.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence that front-loads the core purpose and then adds the critical authorization note. There is no fluff or redundancy; every word contributes to understanding the tool's function and a key prerequisite.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The description is incomplete for a tool that audits lock files. It does not explain what 'audit' means in terms of output (e.g., vulnerability report, risk score), what happens during the audit, or how parameters like 'authorize_advisory_lookup' affect behavior. With no output schema and only minimal description, an agent would struggle to correctly invoke and interpret results.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the description must compensate. It barely touches on the 'authorize_advisory_lookup' parameter via the authorization mention, but it does not explain either parameter's purpose or how to set them. The description adds minimal value beyond what the schema shows (names and defaults). This is insufficient for a tool where parameters are not self-explanatory.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool audits Python/npm/Go locks, specifying the verb 'audit' and the target resources. It distinguishes from generic audit tools like deep_analyzer_audit by focusing on lock files for specific ecosystems. However, it does not explicitly name sibling alternatives, so it falls short of a 5.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage: use when you need to audit lock files for Python, npm, or Go. It does not provide explicit when-not guidance or mention alternatives, but the scope is clear enough to infer the primary use case. No exclusions or alternative suggestions are given.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

start_review_before_shipD

Start Guardian high only after a completed first review of the same source snapshot.

NameRequiredDescriptionDefault
app_idYes이 릴리스에서 변하지 않는 앱 식별자(예: my-shop-web)
live_urlNo선택 사항인 실제 앱 URL. 승인 없는 외부 능동 검사는 실행하지 않습니다.
user_scopeYes사용자와 권한 범위(예: anonymous, member, admin)
data_classesYes다루는 데이터 종류. 쉼표로 구분합니다(예: account, korean_pii, payment)
workspace_pathNo설치 시 고정된 프로젝트는 '.'을 사용합니다..
live_authorizedNo외부 live 대상의 능동 검수 권한을 운영자가 확인했는지 여부
run_live_reviewNo허가된 live URL에 동적 검수를 실행할지 여부
scope_proof_refYes검수 권한을 확인할 수 있는 운영자 측 근거의 참조값. 비밀 원문은 넣지 않습니다.
business_purposeYes앱이 실제로 제공하는 기능과 이용 목적
public_endpointsNo허가된 공개 엔드포인트 목록(예: /,/api/health)
initial_review_idYes완료된 check_my_app 검수 번호. 코드 수정 후에는 check_my_app을 다시 실행한 번호여야 합니다.
authorization_noteNo능동 검수 권한 범위에 대한 짧은 설명. 자격증명 원문은 넣지 않습니다.
previous_report_pathNo선택 사항인 이전 raw-free Guardian 보고서 경로
run_software_compositionNo의존성·라이선스·공급망 분석을 함께 실행합니다.

Output Schema

NameRequiredDescription
methodYes
findingsNo
experienceYes
review_jobNo
guardian_gateNo
review_receiptNo
primary_workflowNo
application_assuranceNo
auditor_qualificationNo

TDQS

D1.9/5.0
Behavior1/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries the full burden of behavioral disclosure. It does not reveal what side effects occur, whether the action is destructive, what permissions are needed, or what operational impact 'starting Guardian high' has. The tool appears to be a state-changing action with zero transparency.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness2/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence, which is concise but grossly under-specified. It omits essential information and does not front-load any useful detail. Conciseness without substance is not effective.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness1/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the complexity (14 parameters, 6 required) and an output schema, the description needs to explain the tool's purpose, return value, and usage context. It does none of that. The single sentence leaves an agent without enough information to know when or how to invoke the tool correctly.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the schema already documents all 14 parameters. The description adds no parameter-specific meaning, which aligns with the baseline of 3 when the schema does the heavy lifting.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose2/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description says 'Start Guardian high' but never defines what 'Guardian high' is. It mentions a precondition (after a completed first review) but does not state the tool's actual function, resource, or outcome. This is vague and could be confused with sibling tools like continue_review or guardian_audit.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

It provides one usage condition (only after a completed first review) but gives no guidance on when to use this tool versus siblings like check_my_app, continue_review, or guardian_audit. There is no mention of alternatives or exclusions beyond the single prerequisite.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

suggest_fixC
Read-onlyIdempotent

Return a dry-run fix recipe and regression-test suggestions for a rule.

NameRequiredDescriptionDefault
rule_idYes
frameworkNogeneric

TDQS

C2.9/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The annotations already declare readOnlyHint=true and idempotentHint=true, so the description correctly aligns by stating 'dry-run,' which implies no changes are applied. However, it does not mention any additional behavioral aspects like rate limits, required authentication, or the shape of the response. It adds a small amount of context about being a dry-run but stays within the safety profile the annotations already establish.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

A single, focused sentence that states the core functionality without any filler. The key concept (dry-run fix recipe) is front-loaded, and there is zero waste.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's relative simplicity (two parameters, read-only operation) and the presence of safety annotations, the description covers the basic operation. However, without an output schema, the agent does not know what a 'fix recipe' or 'regression-test suggestions' looks like, and the framework parameter's effect is unaddressed. This makes the description incomplete for a correct invocation.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The schema has no descriptions for rule_id or framework, and the description only refers to 'a rule,' which indirectly hints at rule_id but does not explain what a rule is or how framework modifies the output. With 0% schema coverage and no parameter explanation, the description fails to compensate, leaving the agent to guess at the meaning and semantics of both parameters.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

States a clear action (return) and a specific object of that action: a dry-run fix recipe and regression-test suggestions for a rule. It distinguishes itself from siblings like explain_rule by focusing on fixes rather than explanations, though it does not explicitly name alternatives.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Provides no explicit guidance on when to choose this tool over the many siblings, such as explain_rule or scan tools. The only implicit usage is that it applies to a rule, but there is no information about prerequisites, contexts, or when not to use it.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

validate_multilang_packC

Run the pinned nine-language pack twice; this does not claim field accuracy.

NameRequiredDescriptionDefault
pack_pathNo

TDQS

C2.6/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations provided, the description is the sole source of behavioral disclosure. It discloses that the tool runs twice and explicitly states it does not claim field accuracy, which is a useful limitation. However, it does not describe side effects, return values, or what the validation process actually does beyond running twice, leaving significant behavioral gaps.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, efficient sentence that front-loads the action and includes a caveat. It contains no redundant words or unnecessary detail, making it concise and easy to parse.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool has one parameter and no output schema, the description should explain what pack_path should point to, what running twice accomplishes, and what the expected output or result indicates. The description only instructs to run it twice and disclaims accuracy, which is insufficient for an agent to invoke it correctly without guessing.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The schema has one parameter (pack_path) with 0% description coverage, meaning the schema provides no meaning. The tool description does not mention the parameter at all, offering no context about what path to supply, its format, or its purpose. The description completely fails to compensate for the missing schema documentation.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states a specific action ('Run the pinned nine-language pack twice') on a named resource, making the primary action clear. The tool name 'validate_multilang_pack' reinforces the purpose of validation, and the caveat 'does not claim field accuracy' differentiates it from accuracy-focused tools. However, it does not explicitly state that it validates a multilingual pack, relying on the name for that.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides no guidance on when to use this tool versus siblings like validate_policy_controls or scan_workspace. It does not mention prerequisites, scenarios, exclusions, or alternatives. An agent has no basis for choosing this tool over others.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

validate_policy_controlsC

Run the repeated synthetic JIT/JEA and database AST/RBAC/isolation control pack.

NameRequiredDescriptionDefault
output_pathNo

TDQS

C2.6/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations provided, the description carries the full burden of behavioral disclosure. It only says 'Run', implying execution but does not state side effects, whether it is read-only, what output it produces, or any dependencies. The phrase 'repeated synthetic' hints at repetition but remains vague and unexplained.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single concise sentence with no redundant words. It front-loads the primary action and resource. While it lacks structure or headers, it is efficient and easy to read for its length.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The tool lacks an output schema, annotations, and rich parameter documentation. The description gives only a terse summary that assumes domain knowledge about JIT/JEA and AST/RBAC. It does not explain what the validation entails, what the output looks like, or any prerequisites, leaving the agent under-informed for a validation/control tool.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 0% and the description does not mention the sole parameter 'output_path' at all. The parameter name suggests it is an output destination, but that is not clarified. The description adds no meaning beyond what the schema already shows, and fails to compensate for the lack of schema documentation.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states a clear action ('Run') and a specific resource ('the repeated synthetic JIT/JEA and database AST/RBAC/isolation control pack'). It provides enough specificity to distinguish it from siblings like validate_multilang_pack, though the jargon-heavy phrasing ('synthetic JIT/JEA' and 'AST/RBAC/isolation') may be ambiguous without domain context.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus alternatives. It does not mention any sibling tools, conditions, or exclusions. The description simply states what it does, leaving the agent to infer context from the name and context signals.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

validate_streamable_http_runtimeD

Run the repeated Streamable HTTP authorization, lifecycle, SSE, and audit matrix.

NameRequiredDescriptionDefault
output_pathNo

TDQS

D1.6/5.0
Behavior1/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations provided, the description carries the full burden of behavior disclosure. It only says it 'runs' something, without disclosing side effects, read-only vs mutating nature, auth requirements, or output format. This is a serious gap for a tool that likely performs complex validation.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness2/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single short sentence, but it is under-specified rather than concise. It contains almost no actionable information, so the words do not earn their place. It is more of a heading than an explanation.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness1/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a tool that likely executes a multi-faceted validation matrix, the description provides no context on what the matrix entails, how to interpret results, or how the output_path is used. With no output schema and minimal description, an agent cannot confidently call this tool.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The only parameter, output_path, has 0% schema description coverage and the description does not mention it at all. The description adds no meaning to the parameter, failing to compensate for the schema's lack of explanation.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose3/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states a specific verb ('Run') and resource ('Streamable HTTP'), and lists topics it covers (authorization, lifecycle, SSE, audit). However, 'repeated ... matrix' is vague and does not clearly convey what the tool actually does. It does not explicitly differentiate from sibling validation tools like validate_policy_controls or validate_multilang_pack, but the resource name gives some distinction.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines1/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description gives no guidance on when to use this tool versus its siblings. It does not mention prerequisites, scenarios, or exclusions. An agent would have no cue for choosing this over other validation tools.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Tool Schema Changelog

Recent tool additions, removals, and schema changes observed during successful MCP inspections.

  1. 28 tool updatesv0.1.0
    • First observedbuild_flow_map
    • First observedcheck_my_app
    • First observedcontinue_review
    • First observedcreate_benchmark_template
    • First observedcreate_field_campaign_template
    • First observedcreate_guardian_manifest_template
    • First observeddata_release_gate
    • First observeddeep_analyzer_audit
    • First observedenforce_mcp_events
    • First observedexplain_rule
    • First observedfield_benchmark
    • First observedfield_campaign_status
    • First observedguardian_audit
    • First observedobserve_mcp_event
    • First observedobserve_mcp_events
    • First observedprobe_http
    • First observedscan_diff
    • First observedscan_mcp_config
    • First observedscan_text
    • First observedscan_workspace
    • First observedscore_fixture_corpus
    • First observedsecurity_gate
    • First observedsoftware_composition_audit
    • First observedstart_review_before_ship
    • First observedsuggest_fix
    • First observedvalidate_multilang_pack
    • First observedvalidate_policy_controls
    • First observedvalidate_streamable_http_runtime

TDQS

C2.5/5.0

Scored across 28 tools

Disambiguation4/5

Most tools have clearly distinct purposes with detailed descriptions. However, a few near-duplicates exist (e.g., observe_mcp_event vs observe_mcp_events, security_gate vs guardian_audit) that could slightly confuse an agent. Overall, the set is well-separated.

Naming Consistency2/5

Tool names mix conventions inconsistently. Many follow verb_noun (scan_workspace, create_field_campaign_template, explain_rule), but several use noun_noun (software_composition_audit, data_release_gate, field_campaign_status, security_gate). There is also singular/plural inconsistency (observe_mcp_event vs observe_mcp_events). This makes naming patterns unpredictable.

Tool Count2/5

With 28 tools, this exceeds the 25+ threshold and feels heavy. While the domain is broad, many tools overlap in function (multiple validation and audit tools). The server could consolidate some related tools (e.g., separate scan_* tools) without losing clarity.

Completeness4/5

The tool surface covers the main security workflow: scanning, validation, audits, templates, explanations, fixes, and status gates. Minor gaps exist (e.g., no explicit rule management or history retrieval), but the core lifecycle is present and agents can complete typical tasks.

Maintenance

ActivitySlowing
ResponsivenessNo issues

Related MCP Connectors

Related MCP Servers

  • A
    license
    A
    quality
    B
    maintenance
    MCP server that enables AI coding tools to scan projects for security vulnerabilities, secret leaks, and compliance issues, generating Korean-language audit reports.
    15
    9
    PolyForm Noncommercial 1.0.0
  • A
    license
    Not graded
    quality
    B
    maintenance
    Enables AI coding tools to scan projects for security vulnerabilities, hardcoded secrets, injection flaws, and privacy violations with 699 rules and 76 MCP tools, all running locally with zero telemetry.
    6 npm
    7
    MIT
  • A
    license
    Not graded
    quality
    B
    maintenance
    Enables MCP-compatible AI agents to scan code for leaked secrets, copyleft licenses, unprotected routes, missing privacy policies, and risky card handling before committing or shipping.
    115 npm
    MIT
  • A
    license
    Not graded
    quality
    B
    maintenance
    Provides on-machine security scanning for Copilot-generated code, including SAST, secrets, dependency, container, and configuration checks, plus AI-specific risk detection, with findings and fixes available via MCP tools.
    Apache 2.0