alethia-mcp
Official@vitronai/alethia
검증 가능한 안전성을 갖춘 에이전트 네이티브 E2E. 에이전트가 자연어로 실제 브라우저를 조작하고, 파괴적 작업은 작동을 입증할 수 있는 안전 게이트로 차단됩니다 — 서명된 감사 추적 기록과 클라우드 없이.
설치
Claude Code — 가장 빠른 방법(플러그인):
/plugin marketplace add vitron-ai/alethia-mcp
/plugin install alethia@vitronai이 방법은 MCP 서버와 스킬을 한 번에 설정합니다 — 수동 npm install이나 MCP 구성 편집이 필요 없습니다. 재시작하거나 /reload-plugins를 실행하면 활성화됩니다.
Claude Code — 스킬만(플러그인 매니저 없음):
mkdir -p ~/.claude/skills/alethia && \
curl -fsSL https://raw.githubusercontent.com/vitron-ai/alethia-mcp/main/skills/alethia/SKILL.md \
-o ~/.claude/skills/alethia/SKILL.mdClaude Code를 재시작하세요. 다음에 페이지 테스트를 요청하면 Alethia가 아직 구성되지 않았음을 감지하고 브리지 설치 과정을 직접 안내합니다.
그 외 모든 클라이언트(Claude Desktop, Cursor, Cline, Continue):
npm install -g @vitronai/alethia그런 다음 클라이언트의 MCP 구성에 다음을 추가하세요:
{
"mcpServers": {
"alethia": {
"command": "alethia-mcp"
}
}
}클라이언트 | 구성 파일 |
Claude Code |
|
Claude Desktop (macOS) |
|
Claude Desktop (Windows) |
|
Claude Desktop (Linux) |
|
Cursor | 설정 → MCP → 서버 추가( |
Cline / Continue / 기타 | 클라이언트 자체 MCP 구성 파일 |
저장 후 클라이언트를 재시작하세요. 에이전트가 Alethia 도구를 처음 호출할 때 런타임이 자동으로 다운로드됩니다(서명됨, 약 100MB). 기본적으로 콕핏 창이 열려 진행 상황을 지켜볼 수 있습니다 — 숨기려면 ALETHIA_HEADLESS=1을 설정하세요. CI 환경에서는 자동으로 숨겨집니다.
브리지 업그레이드: npm install -g @vitronai/alethia@latest. 0.6.0부터 새 런타임 버전을 위해 새 브리지가 필요하지 않습니다 — 시작할 때마다 GitHub Releases를 조회합니다.
수동 업그레이드 없이 항상 최신 버전 실행:
{
"mcpServers": {
"alethia": {
"command": "npx",
"args": ["-y", "@vitronai/alethia@latest"]
}
}
}@latest 접미사가 중요합니다 — 없으면 npx -y가 오래된 캐시 버전을 제공할 수 있습니다. 트레이드오프: 콜드 캐시에서 10~30초가 추가되고, 실행할 때마다 npm이 현재 제공하는 버전을 가져옵니다(컴플라이언스가 중요한 작업에서는 명시적으로 업그레이드할 때만 변경되므로 전역 설치가 더 안전한 기본값입니다).
특정 런타임 버전 고정(재현 가능한 CI, 이분 탐색):
"env": { "ALETHIA_RUNTIME_VERSION": "0.4.0" }Claude Code 스킬 설치(선택 사항, 각 도구를 언제 사용할지 Claude에게 알려줍니다):
alethia-mcp --install-skillRelated MCP server: mcp-policy-gateway
무엇을 요청할까요?
이 도구들을 직접 호출할 필요는 없습니다 — 그냥 에이전트에게 자연어로 요청하면 적절한 도구를 선택합니다.
요청 예시 | 실행 결과 |
"로그인하고 대시보드가 로드되는지 확인해 줘." | 브라우저를 조작하고, 변경된 사항과 차단된 항목이 있는지 보고합니다. |
"이 페이지에 대한 테스트를 생성해 줘 — 아직 커버하지 않았어." | 페이지를 스캔하고 시작용 테스트 스위트를 작성하며, 발견한 모든 파괴적 컨트롤에 대한 안전 검사를 포함합니다. |
"이 페이지에서 안전 게이트가 파괴적 작업을 차단한다는 것을 입증해 줘." | 모든 파괴적 작업을 찾아 게이트가 각각을 차단하는지 확인합니다 — 작업별 통과/실패 보고서입니다. |
"이 페이지의 접근성을 감사해 줘." | axe-core를 통한 실제 WCAG 2.1 AA 감사입니다. |
"이 페이지의 컴플라이언스와 보안을 감사해 줘." | 8가지 NIST SP 800-53 통제 항목을 검사합니다. |
"방금 한 모든 작업의 서명된 증거 패키지를 내보내 줘." | 세션의 변조 방지 기록입니다 — 감사자에게 전달하세요. |
"대시보드와 설정 페이지를 동시에 확인해 줘." | 페이지당 하나씩 여러 테스트를 동시에 실행합니다. |
"스크린샷을 찍어 줘." / "그 목록에 항목이 몇 개 있어?" | 시각적 확인, 또는 자연어로는 직접 얻을 수 없는 답변(개수, 계산된 스타일)입니다. |
"지금 당장 모든 작업을 멈춰 — 뭔가 잘못된 것 같아." | 즉시 중지합니다. 콕핏 자체에서만 해제할 수 있습니다 — 에이전트는 자신의 킬 스위치를 해제할 수 없습니다. |
비밀번호, 토큰 또는 신용카드 필드에 입력하는 것은 실제 로그인 또는 결제 테스트로 요청을 구성한 경우에만 허용됩니다 — 에이전트가 이를 직접 활성화하므로 플래그를 지정할 필요가 없습니다.
바로 붙여넣을 수 있는 더 많은 예시: 에이전트 쿡북에 전체 워크스루가 있습니다 — 알 수 없는 페이지에서 테스트 부트스트래핑, 전체 컴플라이언스 패스, 병렬 다중 페이지 검사, 라이브 파트너 데모. 모두 그대로 붙여넣으면 되는 프롬프트입니다.
프로젝트에 Alethia 추가
프로젝트별 설치가 필요 없습니다 — MCP 서버가 구성되면 어떤 프로젝트의 어떤 에이전트도 사용할 수 있습니다.
.alethia파일을 저장소가 테스트 코드로 취급하는 아무 곳에나 넣으세요 —tests/e2e/처럼 적절한 위치에.# tests/e2e/login.alethia name login flow navigate to http://127.0.0.1:5173 assert "Sign in" is visible click Sign in type dev@company.com into the email field assert dashboard is visible에이전트에게 실행을 요청하세요: "tests/e2e/login.alethia를 http://127.0.0.1:5173 대상으로 실행해 줘."
CI에서 에이전트나 MCP 호스트 없이 실행하세요:
alethia run tests/e2e/login.alethia통과 시 0, 실패 시 1로 종료됩니다. 바로 사용 가능한 워크플로:
examples/github-actions.yml.
작동하는 참조 구현(데모 앱 + 스펙 + CI + 벤치마크)은 vitron-ai/alethia-anvil에 있습니다.
Cypress나 Playwright 대신 왜 Alethia인가?
Cypress / Playwright | Alethia | |
테스트를 작성하는 주체 |
| 자연어로 작성하는 AI 에이전트 |
파괴적 작업 차단 입증 | 수동 검토 | 프롬프트 하나 — 자동화된 기계 판독 가능 보고서 |
단계당 속도 | ~200 ms (Playwright MCP), ~2 s (Playwright CLI) | ~13ms — 숫자를 직접 재현해 보세요 |
증거 자료 | 스크린샷, 비디오 | 서명된 증거 패키지 |
네트워크 | 대부분의 클라우드 대시보드에서 기본적으로 켜져 있는 텔레메트리 | 에어갭 배포 가능 — 텔레메트리 제로, 127.0.0.1에 바인딩 |
테스트 도구일 뿐만도 아닙니다 — 에이전트가 현재 빌드 중인 페이지에서 getComputedStyle()이나 offsetWidth를 확인하도록 요청하면, 새로고침 후 검사하는 사이클 대신 DOM에서 직접 얻은 캐시되지 않은 실시간 답변을 받을 수 있습니다.
더 알아보기: 아키텍처 · 안전 게이트 · FAQ · 에이전트 주도 테스트를 위한 UI 패턴
CLI 플래그
alethia-mcp Run as a stdio MCP server (default)
alethia-mcp run <path> Run an NLP test file from the shell (CI mode)
alethia-mcp run --nlp "..." Run inline NLP from the shell
alethia-mcp run - Read NLP from stdin
alethia-mcp --version Print the version and exit
alethia-mcp --health-check Probe the Alethia runtime and exit 0/1
alethia-mcp --debug Run with debug logging on stderr더 짧은 alethia 별칭(동일한 바이너리)도 설치되므로, run 하위 명령을 alethia run <path>로 호출할 수 있습니다.
환경 변수
변수 | 기본값 | 설명 |
|
| 런타임이 수신 대기하는 위치 |
|
| 요청별 타임아웃 |
| 미설정(표시됨) |
|
|
| 대상 요소에 단계별 하이라이트를 표시합니다. |
| 미설정(최신) | 재현 가능한 CI를 위해 런타임을 특정 버전으로 고정합니다 |
|
| 자동 설치된 런타임이 위치하는 곳 |
| 미설정 | 브리지 자체를 고정하고 npm 자동 업데이트 확인을 건너뜁니다 |
| 미설정 | 자동 다운로드된 브리지 tarball이 이 |
| 미설정 |
|
| 미설정 |
|
브리지가 스스로 최신 상태를 유지하는 방법
런타임은 첫 사용 시 서명된 GitHub 릴리스(Ed25519 검증)에서 자동 설치됩니다. 브리지는 첫 시작 시 GitHub에 현재 버전을 조회합니다(1시간 캐시) — 브리지 소스에는 버전 고정이 없으므로, 전역 설치된 브리지는 새 런타임이 출시될 때마다 계속 최신 버전을 가져옵니다.
브리지도 자체 업데이트를 수행합니다(0.8.0부터): 시작 시 npm을 확인하고, tarball의 SHA-512를 검증하며,
~/.alethia/bridge/<version>/에 설치합니다. 명시적 조치 없이는 메이저 버전을 넘지 않습니다. 새 버전은 실제 MCP 핸드셰이크를 완료한 후에만 신뢰되며, 그 전에 충돌하는 버전은 3회 시도 후 격리됩니다.번들된 Claude Code 스킬도 같은 방식으로 자동 갱신됩니다 — 실행할 때마다
~/.claude/skills/alethia/SKILL.md와 비교하고 오래된 경우 덮어씁니다.
문제 해결
"Alethia desktop runtime is not running" — alethia-mcp --health-check를 실행하세요(없으면 자동 설치를 트리거합니다). 그래도 실패하면 GitHub까지의 네트워크 연결 가능 여부를 확인하세요.
"WRITE_HIGH" / "EA1 POLICY BLOCK" 감사 로그 항목 — 파괴적 작업이 차단되었습니다. 이는 올바른 fail-closed 동작이며, 수정해야 할 오류가 아닙니다. 이를 완화하려면 사람의 구성이 필요하며, 에이전트는 호출 내부에서 이를 수행할 수 없습니다.
"SENSITIVE_INPUT_DENIED" — 비밀번호/토큰/신용카드 필드가 감지되었습니다. 합법적인 인증/결제 테스트의 경우에만 allowSensitiveInput: true로 재정의하십시오.
MCP 클라이언트가 도구를 볼 수 없음 — alethia-mcp --health-check를 실행하고, 구성 형태를 확인하고, 클라이언트를 다시 시작하고, ALETHIA_DEBUG=1을 설정하여 브리지 트래픽을 기록하십시오.
"Server transport closed unexpectedly" / 브리지가 조용히 종료됨 — 일반적으로 오래된 캐시된 브리지입니다. npx -y @vitronai/alethia를 @latest 없이 사용하는 경우, @latest를 추가하거나 rm -rf ~/.npm/_npx를 실행하십시오. 전역 설치를 사용하는 경우 npm install -g @vitronai/alethia@latest를 실행하십시오. 그런 다음 클라이언트를 완전히 종료하고 다시 시작하십시오(macOS에서는 창을 닫는 것만으로는 부족하고 Cmd-Q).
"GitHub에서 새 릴리스를 확인했지만 런타임이 업그레이드되지 않음" — "현재 버전" 확인은 1시간 동안 캐시됩니다. rm ~/.alethia/.latest-release ~/.alethia/.bridge-registry-cache로 캐시를 지운 후 클라이언트를 다시 시작하십시오.
보안 태세
런타임은 아키텍처상 로컬 전용입니다. 서명된 바이너리는 file://, localhost, 127.0.0.1, .local 및 RFC1918 사설 범위 밖으로는 탐색을 거부합니다. 이는 컴파일 타임 상수이며, 이를 변경하는 플래그, 환경 변수 또는 UI 토글이 없습니다. 전체 위협 모델 및 공개 프로세스: SECURITY.md. 악용 신고: team@vitron.ai.
개인정보 보호
아키텍처상 로컬 전용 — 사용자 머신 외부로 수집, 전송, 저장되는 것이 없습니다. 페이지 콘텐츠, 스크린샷, 테스트 지침은 로컬에서 처리되며 어디에도 전송되지 않습니다. 증거 팩은 명시적 요청 시에만 파일 시스템에 기록됩니다. 텔레메트리, 분석, 크래시 리포트가 전혀 없습니다. 문의: team@vitron.ai.
라이선스 및 특허 고지
이 브리지는 MIT 라이선스입니다 — LICENSE 참조. Alethia 런타임 자체는 특허 출원 중입니다(미국 출원 번호 19/571,437). 이 브리지의 MIT 라이선스는 런타임에 대한 특허 라이선스를 부여하지 않습니다. 상업적 런타임 사용에는 별도의 라이선스가 필요할 수 있습니다. 라이선스 문의: team@vitron.ai.
Available Tools
15 toolsalethia_activate_kill_switchADestructive
Halt all current and queued automation immediately. The per-step VITRON-EA1 policy gate stays armed; subsequent tell() calls will be blocked with reason KILL_SWITCH_ACTIVE until reset. Use this when an agent appears to be acting unsafely, when human review is required, or to enforce a hard boundary at the end of a controlled test run.
| Name | Required | Description | Default |
|---|---|---|---|
| reason | No | Optional explanation that lands in the audit trail for later review. |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Beyond the destructiveHint annotation, the description discloses significant behavioral context: the VITRON-EA1 policy gate remains armed, subsequent tell() calls will be blocked with reason KILL_SWITCH_ACTIVE, and this state persists until reset. This gives the agent a clear picture of the tool's side effects and lasting impact.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is three sentences, front-loaded with the primary action, then the behavioral consequence, then the usage guidance. Every sentence provides essential information with no redundancy.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
The description covers the action, immediate effect, post-activation state, reset condition, and specific use cases. For a kill switch with no output schema, this is complete and leaves no major gaps in the agent's understanding.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The schema already fully describes the optional 'reason' parameter as 'Optional explanation that lands in the audit trail for later review.' The tool description does not add any additional semantic detail beyond the schema, so the baseline score of 3 applies.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description begins with 'Halt all current and queued automation immediately,' which is a specific verb and resource that clearly defines the tool's action. It distinguishes from sibling tools like alethia_status or alethia_tell by focusing on the kill switch functionality.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description explicitly lists when to use the tool: when an agent is acting unsafely, when human review is required, or to enforce a hard boundary at the end of a controlled test run. However, it does not mention when not to use it or point to alternative tools, so it falls just short of a 5.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
alethia_assert_safetyARead-only
Navigate to a URL, discover every destructive / write-high action on the page, and verify the VITRON-EA1 policy gate blocks each one. Returns a per-action report with block/allow status. This is the automated policy-verification primitive — proves the safety gate works on a real page without the agent or human having to click each destructive button manually. Use it as a compliance check before releasing an agent-driven workflow against a customer environment.
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | The URL to navigate to and audit. |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Annotations already indicate read-only and non-destructive. The description adds that it returns a per-action report with block/allow status and that it verifies blocks without performing clicks, providing behavioral context beyond the annotations. No contradiction.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Two sentences, each providing distinct value: what it does and when to use it. Every sentence earns its place with no wasted words.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Despite lacking an output schema, the description explicitly states the return format (per-action report with block/allow status). The single parameter is well-documented, and annotations cover the safety profile, making the description complete for this tool.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The schema fully describes the single 'url' parameter, so the description adds little beyond restating that it navigates to a URL. Baseline of 3 is appropriate when schema coverage is complete.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description uses specific verbs ('navigate', 'discover', 'verify') and clearly identifies the resource (every destructive/write-high action on a page) and the VITRON-EA1 policy gate. It distinguishes from sibling audit tools by framing this as policy verification rather than accessibility/NIST audits.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
Explicitly states when to use: 'Use it as a compliance check before releasing an agent-driven workflow against a customer environment.' It also implies it is the automated alternative to manually clicking destructive buttons, providing clear context.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
alethia_audit_nistARead-only
Run a NIST SP 800-53 Rev. 5 web application security controls audit on the current page. Checks 8 controls across 3 families: AC (login lockout, security banners, session timeout), IA (unmasked passwords, weak password constraints, MFA indicators), SI (input validation, error information leakage). Call after navigating with alethia_tell. Returns findings with control IDs and severity levels.
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Annotations already declare readOnlyHint=true and destructiveHint=false, establishing safety. The description adds context beyond this: it operates on 'the current page', checks 8 specified controls across 3 families, and returns findings with control IDs and severity levels. This gives the agent a clear model of what the tool does without contradicting the read-only hint.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is composed of three concise sentences: the first states the core action, the second details the specific controls, and the third gives usage guidance and output expectations. Every sentence earns its place with relevant information and no redundancy.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
With no output schema, the description appropriately mentions 'Returns findings with control IDs and severity levels,' covering return value expectations. It also explains the scope and usage context. It does not describe edge cases or prerequisites beyond navigation, but for a zero-parameter, read-only audit tool, this is a solid and complete description.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The tool has zero parameters, and schema coverage is 100% (vacuously). With 0 params, the baseline is 4. The description explains the tool's behavior and output even though there are no parameters to document, providing sufficient semantic context for invocation.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description opens with a specific verb+resource+scope: 'Run a NIST SP 800-53 Rev. 5 web application security controls audit on the current page.' It clearly states the standard (NIST SP 800-53 Rev. 5), the target (current page), and lists the exact control families (AC, IA, SI) with sample checks. This distinguishes it from the sibling alethia_audit_wcag by specifying a distinct standard and domain.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The instruction 'Call after navigating with alethia_tell' provides an explicit when-to-use context. It also implies the tool is for security audits, differentiating it from accessibility audits (alethia_audit_wcag). However, it does not explicitly mention when-not-to-use or alternative tools by name, so it stops short of a 5.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
alethia_audit_wcagARead-only
Run a WCAG 2.1 AA accessibility audit on the current page, powered by axe-core. Checks alt text, form labels, keyboard access, color contrast, ARIA usage, heading structure, and the rest of the axe-core ruleset — not a fixed checklist. Call after navigating with alethia_tell. Returns findings with rule IDs, impact levels, and issue counts.
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Annotations already declare readOnlyHint=true and destructiveHint=false, but the description adds substantial behavioral context: it operates on the current page, is powered by axe-core, covers a dynamic ruleset rather than a fixed checklist, and returns findings with rule IDs, impact levels, and issue counts. This goes well beyond the annotations.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is three sentences, with the main action front-loaded in the first sentence. Every sentence contributes: what it does, what it checks, and when to call it plus return format. No filler or redundancy.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a zero-parameter, read-only tool with annotations and no output schema, the description fully covers purpose, behavior, usage timing, and return value. It also distinguishes from the NIST audit sibling, making it complete for an agent to select and invoke correctly.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Input schema has zero parameters, so the baseline is 4. The description adds meaning by explaining that the tool operates on the current page with no required inputs, which is useful context. There are no parameter details to elaborate on.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
Description clearly states the tool runs a WCAG 2.1 AA accessibility audit on the current page using axe-core. It lists specific checks (alt text, form labels, keyboard access, etc.) and distinguishes itself from a fixed checklist, which differentiates it from the sibling alethia_audit_nist.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description gives an explicit usage instruction: 'Call after navigating with alethia_tell.' It does not explicitly name alternatives or state when not to use it, but the WCAG-specific scope and context make the appropriate use case clear, especially compared to the NIST audit sibling.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
alethia_compileARead-only
Compile natural-language test instructions to Alethia Action IR text, without executing anything. Returns the compiled IR, per-line confidence scores (0-1), and warnings for any lines the compiler could not parse. Use this to preview what tell() will run, debug coverage gaps, or generate reproducible IR scripts for CI pipelines.
| Name | Required | Description | Default |
|---|---|---|---|
| instructions | Yes | Plain-English instructions to compile (does not execute). |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Annotations already mark the tool as readOnly, and the description adds valuable behavioral context: it 'does not execute anything', returns compiled IR, per-line confidence scores (0-1), and warnings for unparsed lines. This goes beyond annotations by describing the exact output and failure indication.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Three concise sentences: the first states the core action and non-execution, the second lists the return values, and the third gives use cases. Every sentence earns its place with no filler.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a simple compile-only tool with one parameter and no output schema, the description fully explains purpose, behavior, output format (IR, confidence, warnings), and use cases. It is self-contained and leaves no significant gaps.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The input schema already fully describes the only parameter (instructions: 'Plain-English instructions to compile (does not execute).') with 100% coverage. The tool description paraphrases this as 'natural-language test instructions' but adds no new semantic detail, so the baseline of 3 applies.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description starts with a specific verb 'Compile' and defines the resource as 'natural-language test instructions to Alethia Action IR text'. It also explicitly states 'without executing anything', differentiating it from execution-focused sibling tools like alethia_tell.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description explicitly tells when to use the tool: 'preview what tell() will run, debug coverage gaps, or generate reproducible IR scripts for CI pipelines.' This provides clear use cases and implies it should not be used for actual execution.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
alethia_evalA
Evaluate a JavaScript expression in the page under test and return the result. Runs in the context of the navigated page, not the Alethia host UI. Use this for queries the NLP compiler cannot express — counting elements, reading computed styles, checking localStorage, or any DOM inspection that needs raw JS.
| Name | Required | Description | Default |
|---|---|---|---|
| expression | Yes | JavaScript expression to evaluate in the page context. Example: "document.querySelectorAll('li').length" |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With annotations present (readOnlyHint: false, destructiveHint: false), the description adds meaningful context: it runs in the navigated page rather than the host UI and returns the evaluation result. However, it does not explicitly warn that arbitrary JS may have side effects, though this is partially implied by readOnlyHint: false.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Three concise sentences deliver the core purpose, execution context, and usage guidance without redundancy. Information is front-loaded and every sentence earns its place.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool's simplicity (one parameter, no output schema) and strong annotations, the description covers purpose, context, examples, and execution environment. It is fully complete for an agent to select and invoke the tool correctly.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100% and the only parameter 'expression' is well-defined with an example. The description adds usage examples but does not add new parameter-level semantics beyond what the schema already provides, warranting the baseline score.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool evaluates a JavaScript expression in the page under test, using the specific verb 'Evaluate' and identifying the resource. It distinguishes itself from siblings by emphasizing the page context versus the Alethia host UI and positions itself for queries the NLP compiler cannot express.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
Explicitly says 'Use this for queries the NLP compiler cannot express' and provides concrete examples (counting elements, reading computed styles, checking localStorage). It also implicitly excludes use for host UI operations and anything the NLP compiler can handle, giving clear when-to-use and when-not-to-use guidance.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
alethia_export_sessionARead-only
Export the full session recording as a signed evidence pack. Contains every tool call made during this session with timestamps, inputs, outputs, policy decisions, and a SHA-256 integrity hash. Use at the end of an agent loop to produce cryptographic proof of everything the agent did. Designed for compliance review and chain-of-custody.
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
The description adds meaningful behavioral context beyond the readOnlyHint and destructiveHint annotations, detailing exactly what the evidence pack contains ('every tool call... timestamps, inputs, outputs, policy decisions, and a SHA-256 integrity hash'). This enriches the agent's understanding of the tool's output and purpose, though it does not specify the exact format or delivery mechanism of the pack.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is three sentences, front-loaded with the primary action, followed by useful detail about contents and usage. Every sentence contributes distinct information without redundancy or fluff, making it appropriately concise and well-structured.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a tool with no parameters and no output schema, the description covers the essential aspects: what it does, what it includes, when to use it, and its purpose. The annotations cover safety traits, and the description fills in the behavioral and usage context, achieving a high level of completeness.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The tool has zero parameters, so the input schema is trivially complete. The description adds contextual meaning by explaining what the evidence pack will include, which indirectly clarifies the tool's output, even though param semantics are not directly addressed. This meets the baseline for zero-parameter tools.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool's function: 'Export the full session recording as a signed evidence pack.' It specifies the resource (session recording) and unique output (signed evidence pack with timestamps, inputs, outputs, policy decisions, and SHA-256 hash), distinguishing it from sibling tools like alethia_audit_wcag or alethia_status.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides explicit guidance on when to use the tool: 'Use at the end of an agent loop to produce cryptographic proof of everything the agent did.' It also contextualizes the use case ('Designed for compliance review and chain-of-custody'), though it does not explicitly mention when not to use it or name alternatives.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
alethia_hide_cockpitAIdempotent
Hide the Alethia cockpit window. The runtime keeps running and continues to accept tool calls; only the visible window is dismissed.
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
The description adds key behavioral context beyond annotations: the runtime keeps running and continues to accept tool calls, clarifying that this is non-destructive and only affects the UI. This complements the idempotentHint and destructiveHint annotations without contradiction.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Two concise sentences entirely focused on the action and its scope. No fluff or redundant wording; every word earns its place.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a zero-parameter UI-hiding tool, the description is fully complete. It explains what happens to the runtime, which is the one behavioral nuance the agent needs to know. The sibling set (show_cockpit, kill_switch) makes the contrast implicit but sufficient.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The tool has zero parameters, and schema coverage is effectively 100% (empty schema). The description needs to explain no parameters, and the baseline for zero-param tools is 4. It correctly focuses on the action rather than parameter details.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states 'Hide the Alethia cockpit window' with a specific verb and resource. It distinguishes itself from sibling tools like show_cockpit and activate_kill_switch by clarifying that the runtime continues, making the action's scope explicit.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description gives clear context: use this to dismiss the visible window while keeping the runtime operational. It implies the contrast with show_cockpit and non-destructive tools, but does not explicitly name alternatives or exclusions, so it falls short of a 5.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
alethia_propose_testsARead-only
Navigate to a URL, scan the page for interactive elements (headings, buttons, forms, links, destructive actions), and generate a candidate NLP test suite ready to pass to alethia_tell. Returns an array of plain-English test blocks, including an auto-generated "EA1 Safety Gate Verification" block that uses "expect block: " for every destructive control on the page. Use this to bootstrap test coverage for a new page or to discover what the safety gate should be watching.
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | The URL to navigate to and scan (file://, http://localhost, etc.). |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
The description adds significant behavioral context beyond the annotations: it explains the tool scans for destructive actions, auto-generates an 'EA1 Safety Gate Verification' block, and returns an array of test blocks. This complements the readOnlyHint and destructiveHint annotations with concrete output and scanning behavior. No contradiction exists; the annotations indicate a safe read-only operation and the description confirms it only scans and suggests, not executes.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is three sentences, each earning its place: the first states the main action, the second details the return value and key generated block, and the third gives usage guidance. It is front-loaded with the primary verb and resource, with no irrelevant filler. The structure is clean and efficient.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a tool with only one parameter and no output schema, the description is quite complete. It explains what the tool does, what it returns (an array of plain-English test blocks), and gives a concrete example of the safety gate block format. It could have elaborated on error handling or edge cases, but given the simplicity of the tool, the information provided is sufficient.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The schema description coverage is 100%, so the parameter 'url' is fully documented with value examples (file://, http://localhost). The tool description adds minimal extra parameter meaning; it only explains that the URL is navigated to and scanned, which is implicit in the tool's purpose. Since the schema already provides the necessary details, a baseline score of 3 is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool's function: it navigates to a URL, scans for interactive elements, and generates a candidate NLP test suite. It explicitly differentiates from sibling tools by noting the output is 'ready to pass to alethia_tell', making it distinct from the tell, compile, and eval tools. The verb 'generate' paired with the resource 'candidate test suite' is specific and unambiguous.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides explicit usage context: 'Use this to bootstrap test coverage for a new page or to discover what the safety gate should be watching.' It also indirectly references the alternative tool (alethia_tell) as the downstream consumer of the output. However, it does not include an explicit 'when not to use' statement or direct comparison to alternatives like alethia_compile, so it falls short of a perfect 5.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
alethia_screenshotARead-only
Capture a PNG screenshot of the current page and return it as a base64-encoded image. Use this to visually verify what the browser is showing after running test steps with alethia_tell.
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Annotations already declare readOnlyHint=true and destructiveHint=false. The description adds useful behavioral context beyond that, such as capturing the 'current page' and returning a base64-encoded image, which aligns with and reinforces the read-only nature of the operation.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is two sentences: the first states the action and output format, the second provides usage context. It is front-loaded, efficient, and contains no filler or redundancy.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a tool with no parameters and no output schema, the description fully covers the necessary information: what it does, what it returns, and when to use it. There are no significant gaps given the tool's simplicity.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The tool has zero parameters, so the baseline of 4 applies. No parameter description is needed, and the schema coverage is trivially 100%.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description uses a specific verb and resource: 'Capture a PNG screenshot of the current page' and explicitly states the output format (base64-encoded image). It also distinguishes the tool from siblings by mentioning its role after alethia_tell steps.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description explicitly tells when to use the tool: 'after running test steps with alethia_tell' and why: 'to visually verify what the browser is showing'. It does not explicitly name alternatives, but the context is clear enough for an agent to select it appropriately.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
alethia_serve_demoAIdempotent
Start a local HTTP server for the built-in Alethia demo pages and return the base URL. Use this to serve demo pages on localhost so they appear in preview panels (Claude Code, VS Code, etc.). The server runs on a random available port on 127.0.0.1. Call this before alethia_tell to get a localhost URL instead of a file:// path. Returns the base URL and a list of available demo pages.
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Annotations already indicate idempotent and non-destructive behavior. The description adds valuable context about the server running on a random available port on 127.0.0.1 and clarifies the return value (base URL and list of demo pages). No contradiction exists between description and annotations.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is concise, with three sentences that front-load the core action, then provide usage context, technical detail, and return information. Every sentence serves a purpose with no fluff.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a zero-parameter, simple tool, the description is fully complete. It covers purpose, when to use, how it behaves (random port, loopback), and what it returns, even without an output schema. This is more than sufficient for an agent to select and invoke it correctly.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The tool has zero parameters, so the baseline is 4. The description appropriately avoids redundant parameter explanations and instead adds value by describing the server's operational details and return value.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool's purpose: 'Start a local HTTP server for the built-in Alethia demo pages and return the base URL.' It uses a specific verb ('start') and resource ('local HTTP server'), and distinguishes itself from siblings by mentioning its role in serving demo pages and its relationship to alethia_tell.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description explicitly tells when to use this tool: 'Use this to serve demo pages on localhost so they appear in preview panels' and 'Call this before alethia_tell to get a localhost URL instead of a file:// path.' This provides clear context and an explicit sequencing instruction relative to a sibling tool.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
alethia_show_cockpitAIdempotent
Show the Alethia cockpit window — the oversight surface where the target app is driven and each step is highlighted live (green = pass, blue = type, red = EA1 block). Use this to pop the UI into view during a headless-launched session for demos, review, or partner walkthroughs.
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Annotations already indicate idempotentHint=true and destructiveHint=false, so the safety profile is covered. The description adds the headless-session context and the visual highlight behavior, but doesn't disclose additional side effects or return behavior. It does not contradict annotations.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is two sentences, front-loaded with the core action. The first sentence defines the tool and describes the cockpit's visual elements; the second sentence gives usage guidance. No wasted words.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a no-parameter, no-output-schema display tool, the description fully covers what the tool does and when to use it. It is complete within its simple context and complements the sibling tool hide_cockpit.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The tool has zero parameters, so the schema coverage is effectively 100%. No parameter documentation is needed, and the description adds no parameter info, which aligns with the baseline of 4.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool's action: "Show the Alethia cockpit window" – a specific verb and resource. It also explains what the cockpit is (oversight surface with live highlighting) and distinctly contrasts with the sibling tool alethia_hide_cockpit.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description gives explicit usage context: "Use this to pop the UI into view during a headless-launched session for demos, review, or partner walkthroughs." It does not name alternatives or specify when not to use, but the context is clear and practical.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
alethia_statusARead-onlyIdempotent
Health and identity probe. Returns runtime version, the default VITRON-EA1 policy profile in effect, kill switch state, driver statistics (queued plans, run count, audit count), the current page domain, and runtime capabilities. Use this for liveness checks before sending tell() calls, and to verify the runtime is in a known-good state at the start of an agent loop.
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Annotations already declare readOnlyHint=true, idempotentHint=true, and destructiveHint=false. The description adds value by detailing what the probe returns (runtime version, policy profile, kill switch state, etc.) and clarifies it is an identity/health probe, which is consistent with the annotations and adds useful context for the agent.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is two sentences: the first states the purpose and return data, the second gives usage context. It is front-loaded with the most important information, and there is zero waste or repetition.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Since there is no output schema, the description must convey what the tool returns, and it does so thoroughly. It enumerates all key fields and provides operational context (liveness check before tell calls). For a zero-parameter status tool with strong annotations, this is complete.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The input schema has zero parameters, so there is no parameter documentation burden. The description implicitly reinforces that the tool takes no inputs by framing it as a probe, and the baseline for zero-parameter tools is 4, which is appropriate here.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description opens with 'Health and identity probe' and immediately lists the specific return values: runtime version, policy profile, kill switch state, driver statistics, page domain, and capabilities. This clearly distinguishes it from sibling tools like alethia_tell or alethia_compile, which perform actions rather than status checks.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
It explicitly states to use this tool for liveness checks before sending tell() calls and at the start of an agent loop to verify a known-good state. This provides clear context for when to use it relative to siblings, though it does not explicitly name alternative tools.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
alethia_tellA
Execute natural-language E2E test instructions against the page Alethia is currently driving. Returns per-step results, policy audit records, and a SHA-256 integrity hash. Destructive actions (delete, purchase, transfer, etc.) are blocked unconditionally. Sensitive input (passwords, credit cards, SSN) is blocked unless allowSensitiveInput is true. ~13 ms per step on average.
| Name | Required | Description | Default |
|---|---|---|---|
| name | No | Short label for the run (e.g. "signin smoke", "delete-blocked check", "checkout regression"). Strongly recommended — without it the run shows up as "tell" in cockpit history and audit trails, which makes review painful when many runs accumulate. Alternatively, prefix the first line of `instructions` with `name <label>` and the NLP compiler will read it. | |
| instructions | Yes | One or more plain-English test instructions, newline-separated. Example: "navigate to http://localhost:3000\nclick Sign In\nassert the dashboard is visible" | |
| allowSensitiveInput | No | Set to true to allow typing into password, token, credit card, and other sensitive fields. Only use for legitimate auth or payment flow tests. |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
The description discloses significant behavioral traits beyond the annotations: destructive actions are blocked unconditionally, sensitive input is blocked unless allowSensitiveInput is true, it returns per-step results, policy audit records, and a SHA-256 integrity hash, and mentions ~13 ms per step average performance. These details provide substantial transparency about safety constraints, output, and performance, going well beyond the simple boolean hints.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is concise, four sentences long, and front-loaded with the core purpose. Each sentence provides distinct and valuable information: purpose, outputs, safety constraints, and performance. No redundant or filler content is present.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
The description covers the core function, return values (per-step results, policy audit records, integrity hash), and key constraints (destructive block, sensitive input gate, performance). It also implies a prerequisite (the page currently being driven). However, it lacks a bit of detail on what 'policy audit records' contain or how results are delivered (e.g., output format), which would be useful given the absence of an output schema.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, and each parameter (name, instructions, allowSensitiveInput) has a clear description. The tool description adds no extra parameter semantics beyond the schema; it mentions allowSensitiveInput in behavioral context but does not provide additional syntax, formatting, or usage details that aren't already present in the schema.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool's function with a specific verb ('Execute') and resource ('natural-language E2E test instructions against the page Alethia is currently driving'). However, it does not explicitly distinguish from the sibling tool alethia_tell_parallel, which likely performs a similar action in parallel, so full differentiation is missing.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides context for when to use it (running natural-language E2E tests) and mentions blocking of destructive actions and sensitive input, which implies careful use with flags like allowSensitiveInput. However, it does not explicitly state when to use this tool over alternatives like alethia_tell_parallel, and no exclusionary or alternative guidance is given.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
alethia_tell_parallelA
Run multiple test flows concurrently — each against a different URL. Takes an array of test specs, spawns a browser instance per spec, runs them in parallel, and returns all results together. Use this to verify multiple pages simultaneously.
| Name | Required | Description | Default |
|---|---|---|---|
| specs | Yes | Array of test specs. Each has "url" (file:// or http://localhost) and "instructions" (test steps). |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Beyond the annotations (readOnlyHint=false, destructiveHint=false), the description adds concrete behavioral details: it spawns a browser instance per spec, runs them in parallel, and returns all results together. It also hints at resource usage by mentioning spawning per spec. No contradiction with annotations.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is two sentences, front-loaded with the core action, followed by execution details and a use case. Every sentence adds value; no filler or redundancy.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a tool with one well-documented parameter and a clear execution model, the description provides a complete mental model: parallel browser instances, input specs, and aggregated results. It doesn't detail the return format, but no output schema exists and the description gives a reasonable expectation. Given the simplicity, this is nearly complete.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100%, so the schema already defines the specs array with url, instructions, and optional name. The description repeats 'Takes an array of test specs' without adding semantic detail beyond the schema. Baseline 3 applies because the schema carries the param semantics.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description opens with a specific verb+resource: 'Run multiple test flows concurrently — each against a different URL.' It clearly distinguishes from siblings like alethia_tell by emphasizing parallelism and multiple URLs. The purpose is unambiguous and action-oriented.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description explicitly states when to use: 'Use this to verify multiple pages simultaneously.' It implies this is for parallel verification across different URLs, which differentiates it from single-flow tools. It does not name alternatives or exclusions, but the usage context is clear.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
15 tool updates
v0.9.2- First observed
alethia_activate_kill_switch - First observed
alethia_assert_safety - First observed
alethia_audit_nist - First observed
alethia_audit_wcag - First observed
alethia_compile - First observed
alethia_eval - First observed
alethia_export_session - First observed
alethia_hide_cockpit - First observed
alethia_propose_tests - First observed
alethia_screenshot - First observed
alethia_serve_demo - First observed
alethia_show_cockpit - First observed
alethia_status - First observed
alethia_tell - First observed
alethia_tell_parallel
TDQS
Scored across 15 tools
Each tool has a clearly distinct purpose: executing tests, compiling, monitoring, UI control, safety override, capturing state, JS query, audits, session export, parallel execution, demo server, test proposal, safety assertion, and cockpit control. Even related tools like audit_wcag and audit_nist target different standards.
All tools share the 'alethia_' prefix and use snake_case, making the pattern highly predictable. However, a few names (status, screenshot, eval) are nouns or abbreviations rather than verbs, which slightly deviates from a strict verb_noun convention.
With 15 tools, the server sits at the upper boundary of a well-scoped set. Each tool addresses a distinct need in the automation workflow, though some are auxiliary (e.g., cockpit controls, demo server) and could be trimmed without losing core functionality.
The tool set provides comprehensive coverage for the stated purpose: compile/preview, execute, observe (screenshot/eval), audit (WCAG/NIST), safety verification, session export, and parallel execution. There are no obvious dead ends or missing critical operations.
Maintenance
Related MCP Connectors
- gatewayOAuthai.sealgate
MCP gateway with runtime security policy, tool-call-level control, and audit of agent actions.
Zero-secret MCP gateway for AI agents: risk-scored, audited calls with human-in-the-loop approval.
Governed MCP: agent audit, provenance, deterministic checks, and receipt-backed FragGate execution.
Remote MCP for A2A failure replay MCP, structured receipts, audit logs, and reviewer-ready evidence.
Related MCP Servers
- AlicenseNot gradedqualityAmaintenanceMCP server that gates agent tool calls by normalizing intent, denying unknown/unattended destructive actions, and requiring HITL prove approval for high-risk operations. It maintains an append-only hash-chained Action Ledger and exposes gate_check and ledger_verify tools without ever executing tools.MIT
- AlicenseAqualityDmaintenanceEnables policy-governed MCP interactions with deterministic authorization, tenant isolation, minimized PII exposure, and human approval gates for sensitive mutations, while producing structured audit events.3MIT
- AlicenseNot gradedqualityBmaintenanceEnables transparent MCP proxying with a hash-chained effect ledger, classifying agent actions by reversibility, enforcing approval gates, and dry-run previews of sessions.MIT
- AlicenseNot gradedqualityAmaintenanceEnables AI agents and MCP clients to screen proposed actions, enforce deterministic policies and limits, and produce tamper-proof signed audit receipts before any external side effect is executed.0MIT