alethia-mcp
Official@vitronai/alethia
Agent 原生的端到端测试,具备可验证的安全性。 你的 agent 用自然语言驱动真实浏览器,破坏性操作会被一道你能证明其有效的安全门拦截——附带签名审计轨迹,且无需云端。
Install
Claude Code —— 最快路径(插件):
/plugin marketplace add vitron-ai/alethia-mcp
/plugin install alethia@vitronai这会一步完成 MCP 服务器和技能的配置——无需手动执行 npm install 或编辑 MCP 配置。重启或运行 /reload-plugins 即可激活。
Claude Code —— 仅安装技能(无插件管理器):
mkdir -p ~/.claude/skills/alethia && \
curl -fsSL https://raw.githubusercontent.com/vitron-ai/alethia-mcp/main/skills/alethia/SKILL.md \
-o ~/.claude/skills/alethia/SKILL.md重启 Claude Code。下次你让它测试某个页面时,它会发现 Alethia 尚未配置,并引导你自行安装 bridge。
其他用户(Claude Desktop、Cursor、Cline、Continue):
npm install -g @vitronai/alethia然后将其添加到你的客户端的 MCP 配置中:
{
"mcpServers": {
"alethia": {
"command": "alethia-mcp"
}
}
}客户端 | 配置文件 |
Claude Code |
|
Claude Desktop (macOS) |
|
Claude Desktop (Windows) |
|
Claude Desktop (Linux) |
|
Cursor | 设置 → MCP → 添加服务器(仅粘贴内部的 |
Cline / Continue / 其他 | 客户端自己的 MCP 配置文件 |
保存后重启你的客户端。当你的 agent 首次调用 Alethia 工具时,runtime 会自动下载(已签名,约 100 MB)。默认会打开一个 cockpit 窗口供你观察——设置 ALETHIA_HEADLESS=1 可隐藏它;CI 环境会自动隐藏。
升级 bridge: npm install -g @vitronai/alethia@latest。自 0.6.0 起,新 runtime 版本不再需要新的 bridge——它会在每次启动时查询 GitHub Releases。
始终运行最新版本而无需手动升级:
{
"mcpServers": {
"alethia": {
"command": "npx",
"args": ["-y", "@vitronai/alethia@latest"]
}
}
}@latest 后缀很重要——没有它,npx -y 可能会提供过期的缓存版本。权衡:冷缓存时增加 10–30 秒,而且每次启动都会拉取 npm 当前提供的任何版本(对于合规敏感的工作,全局安装是更安全的默认选择,因为它只会在你明确升级时发生变化)。
固定特定 runtime 版本(可复现的 CI、二分定位):
"env": { "ALETHIA_RUNTIME_VERSION": "0.4.0" }安装 Claude Code 技能(可选,教会 Claude 何时使用每个工具):
alethia-mcp --install-skillRelated MCP server: mcp-policy-gateway
你可以要求什么
你不需要直接调用这些工具——只需用自然语言告诉你的 agent,它就会选择合适的工具。
你可以这样要求 | 会发生什么 |
“登录并验证仪表盘能正常加载。” | 驱动浏览器,报告发生了什么变化以及是否有操作被拦截。 |
“为这个页面生成测试——我还没有覆盖到它。” | 扫描页面并起草一个入门测试套件,对找到的每个破坏性控件进行安全检查。 |
“证明安全门能拦截此页面上的破坏性操作。” | 找出所有破坏性操作,并确认安全门逐一拦截——生成每个操作的通过/失败报告。 |
“审计此页面的可访问性。” | 通过 axe-core 进行真正的 WCAG 2.1 AA 审计。 |
“审计此页面的合规性与安全性。” | 对照 8 项 NIST SP 800-53 控制项进行检查。 |
“导出你刚才所做一切的签名证据包。” | 一份防篡改的会话记录——交给审计员即可。 |
“同时检查仪表盘和设置页面。” | 并发运行多个测试,每个页面一个。 |
“截个图。” / “那个列表里有多少项?” | 视觉检查,或回答自然语言无法直接给你的答案(计数、计算样式)。 |
“立刻停止所有操作——好像出问题了。” | 立即停止。只能从 cockpit 本身解除——agent 无法释放自己的紧急停止开关。 |
在密码、令牌或信用卡字段中输入内容会被拦截,除非你将请求描述为真实的登录或支付测试——agent 会为你启用该操作,你无需指定任何标志。
更多可直接粘贴的示例: agent cookbook 包含完整的演练——在未知页面上引导测试、完整的合规检查、并行的多页面检查、实时合作伙伴演示。每一个都是你可以直接粘贴的提示词。
将 Alethia 添加到你的项目
无需按项目安装——一旦配置好 MCP 服务器,任何项目中的任何 agent 都可以使用它。
将
.alethia文件放在仓库视为测试代码的任何位置——例如tests/e2e/,或任何合适的地方。# tests/e2e/login.alethia name login flow navigate to http://127.0.0.1:5173 assert "Sign in" is visible click Sign in type dev@company.com into the email field assert dashboard is visible让 agent 运行它: “针对 http://127.0.0.1:5173 运行 tests/e2e/login.alethia。”
在 CI 中,完全无需 agent 或 MCP 主机即可运行:
alethia run tests/e2e/login.alethia通过时退出码为 0,失败时为 1。可直接使用的工作流:
examples/github-actions.yml。
一个可运行的参考项目(演示应用 + 规范 + CI + 基准测试)位于 vitron-ai/alethia-anvil。
为什么不用 Cypress 或 Playwright?
Cypress / Playwright | Alethia | |
谁编写测试 | 人类,在 | AI agent,使用自然语言 |
证明破坏性操作被拦截 | 人工审查 | 一个提示词——自动生成、机器可读的报告 |
每步速度 | ~200 毫秒(Playwright MCP),~2 秒(Playwright CLI) | ~13 毫秒——亲自复现这些数字 |
证据 | 截图、视频 | 签名证据包 |
网络 | 大多数云仪表盘默认开启遥测 | 可离线部署——零遥测,绑定 127.0.0.1 |
它也不仅仅是一个测试工具——让 agent 检查它正在构建的页面上的 getComputedStyle() 或 offsetWidth,你会直接从 DOM 获得实时、未缓存的答案,而不是经历重新加载和检查的循环。
深入了解: 架构 · 安全门 · 常见问题 · 面向 agent 驱动测试的 UI 模式
CLI 标志
alethia-mcp Run as a stdio MCP server (default)
alethia-mcp run <path> Run an NLP test file from the shell (CI mode)
alethia-mcp run --nlp "..." Run inline NLP from the shell
alethia-mcp run - Read NLP from stdin
alethia-mcp --version Print the version and exit
alethia-mcp --health-check Probe the Alethia runtime and exit 0/1
alethia-mcp --debug Run with debug logging on stderr同时还会安装一个更短的 alethia 别名(同一个二进制文件),因此 run 子命令可以以 alethia run <path> 的形式调用。
环境变量
变量 | 默认值 | 描述 |
|
| runtime 监听的地址 |
|
| 每个请求的超时时间 |
| 未设置(可见) |
|
| 对 | 在目标上逐步高亮。 |
| 未设置(最新) | 将 runtime 固定到特定版本,以实现可复现的 CI |
|
| 自动安装的 runtime 所在位置 |
| 未设置 | 固定 bridge 本身,跳过 npm 自动更新检查 |
| 未设置 | 要求自动下载的 bridge tarball 与此 |
| 未设置 |
|
| 未设置 |
|
bridge 如何保持自身更新
runtime 在首次使用时从已签名的 GitHub releases 自动安装(Ed25519 验证)。bridge 在首次启动时向 GitHub 查询当前版本(缓存 1 小时)——bridge 源码中没有版本固定,因此全局安装的 bridge 会持续拉取随发布推出的最新 runtime。
bridge 也会自动更新自身(自 0.8.0 起):启动时检查 npm,验证 tarball 的 SHA-512,安装到
~/.alethia/bridge/<version>/。未经明确操作不会跨越主版本;新版本只有在完成真实的 MCP 握手后才会被信任,在此之前崩溃的版本会在 3 次尝试后被隔离。随附的 Claude Code 技能以相同方式自动刷新——每次启动时将其与
~/.claude/skills/alethia/SKILL.md进行比较,如果过期则覆盖。
故障排查
“Alethia desktop runtime is not running” ——运行 alethia-mcp --health-check(如果缺失会触发自动安装)。如果仍然失败,请检查到 GitHub 的网络连通性。
"WRITE_HIGH" / "EA1 POLICY BLOCK"(审计日志中) — 一个破坏性操作被阻止了。这是正确的、故障时关闭(fail-closed)的行为——不是需要修复的错误。放宽该策略需要人工配置;代理无法在调用内部自行完成。
"SENSITIVE_INPUT_DENIED" — 检测到密码/令牌/信用卡字段。仅在合法的认证/支付测试中,使用 allowSensitiveInput: true 来覆盖此限制。
MCP 客户端看不到工具 — 运行 alethia-mcp --health-check,检查你的配置格式,重启客户端,并设置 ALETHIA_DEBUG=1 以记录桥接流量日志。
"Server transport closed unexpectedly" / 桥接进程静默退出 — 通常是过期的缓存桥接。如果使用 npx -y @vitronai/alethia 且未加 @latest,请加上它,或运行 rm -rf ~/.npm/_npx。如果使用全局安装,请运行 npm install -g @vitronai/alethia@latest。然后完全退出并重启你的客户端(macOS 上按 Cmd-Q,而不仅仅是关闭窗口)。
"我在 GitHub 上看到了新版本,但我的运行时没有升级" — "当前版本"检查会缓存 1 小时。通过 rm ~/.alethia/.latest-release ~/.alethia/.bridge-registry-cache 清除缓存,然后重启客户端。
安全态势
该运行时在架构上仅限本地:其签名二进制文件拒绝导航到 file://、localhost、127.0.0.1、.local 以及 RFC1918 私有地址范围之外的任何位置。这是一个编译期常量——没有任何标志、环境变量或 UI 开关可以改变它。完整的威胁模型和披露流程:SECURITY.md。滥用举报:team@vitron.ai。
隐私
在架构上仅限本地——不会在您的机器之外收集、传输或存储任何内容。页面内容、截图和测试指令均在本地处理,绝不会发送到任何地方。证据包仅在明确请求时写入您的文件系统。零遥测、零分析、零崩溃报告。如有疑问:team@vitron.ai。
许可证与专利声明
此桥接组件采用 MIT 许可证——参见 LICENSE。Alethia 运行时本身正在申请专利(美国申请号 19/571,437);此桥接组件的 MIT 许可证不授予对运行时的专利许可。商业使用运行时可能需要单独的许可证。许可咨询:team@vitron.ai。
Available Tools
15 toolsalethia_activate_kill_switchADestructive
Halt all current and queued automation immediately. The per-step VITRON-EA1 policy gate stays armed; subsequent tell() calls will be blocked with reason KILL_SWITCH_ACTIVE until reset. Use this when an agent appears to be acting unsafely, when human review is required, or to enforce a hard boundary at the end of a controlled test run.
| Name | Required | Description | Default |
|---|---|---|---|
| reason | No | Optional explanation that lands in the audit trail for later review. |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Beyond the destructiveHint annotation, the description discloses significant behavioral context: the VITRON-EA1 policy gate remains armed, subsequent tell() calls will be blocked with reason KILL_SWITCH_ACTIVE, and this state persists until reset. This gives the agent a clear picture of the tool's side effects and lasting impact.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is three sentences, front-loaded with the primary action, then the behavioral consequence, then the usage guidance. Every sentence provides essential information with no redundancy.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
The description covers the action, immediate effect, post-activation state, reset condition, and specific use cases. For a kill switch with no output schema, this is complete and leaves no major gaps in the agent's understanding.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The schema already fully describes the optional 'reason' parameter as 'Optional explanation that lands in the audit trail for later review.' The tool description does not add any additional semantic detail beyond the schema, so the baseline score of 3 applies.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description begins with 'Halt all current and queued automation immediately,' which is a specific verb and resource that clearly defines the tool's action. It distinguishes from sibling tools like alethia_status or alethia_tell by focusing on the kill switch functionality.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description explicitly lists when to use the tool: when an agent is acting unsafely, when human review is required, or to enforce a hard boundary at the end of a controlled test run. However, it does not mention when not to use it or point to alternative tools, so it falls just short of a 5.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
alethia_assert_safetyARead-only
Navigate to a URL, discover every destructive / write-high action on the page, and verify the VITRON-EA1 policy gate blocks each one. Returns a per-action report with block/allow status. This is the automated policy-verification primitive — proves the safety gate works on a real page without the agent or human having to click each destructive button manually. Use it as a compliance check before releasing an agent-driven workflow against a customer environment.
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | The URL to navigate to and audit. |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Annotations already indicate read-only and non-destructive. The description adds that it returns a per-action report with block/allow status and that it verifies blocks without performing clicks, providing behavioral context beyond the annotations. No contradiction.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Two sentences, each providing distinct value: what it does and when to use it. Every sentence earns its place with no wasted words.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Despite lacking an output schema, the description explicitly states the return format (per-action report with block/allow status). The single parameter is well-documented, and annotations cover the safety profile, making the description complete for this tool.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The schema fully describes the single 'url' parameter, so the description adds little beyond restating that it navigates to a URL. Baseline of 3 is appropriate when schema coverage is complete.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description uses specific verbs ('navigate', 'discover', 'verify') and clearly identifies the resource (every destructive/write-high action on a page) and the VITRON-EA1 policy gate. It distinguishes from sibling audit tools by framing this as policy verification rather than accessibility/NIST audits.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
Explicitly states when to use: 'Use it as a compliance check before releasing an agent-driven workflow against a customer environment.' It also implies it is the automated alternative to manually clicking destructive buttons, providing clear context.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
alethia_audit_nistARead-only
Run a NIST SP 800-53 Rev. 5 web application security controls audit on the current page. Checks 8 controls across 3 families: AC (login lockout, security banners, session timeout), IA (unmasked passwords, weak password constraints, MFA indicators), SI (input validation, error information leakage). Call after navigating with alethia_tell. Returns findings with control IDs and severity levels.
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Annotations already declare readOnlyHint=true and destructiveHint=false, establishing safety. The description adds context beyond this: it operates on 'the current page', checks 8 specified controls across 3 families, and returns findings with control IDs and severity levels. This gives the agent a clear model of what the tool does without contradicting the read-only hint.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is composed of three concise sentences: the first states the core action, the second details the specific controls, and the third gives usage guidance and output expectations. Every sentence earns its place with relevant information and no redundancy.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
With no output schema, the description appropriately mentions 'Returns findings with control IDs and severity levels,' covering return value expectations. It also explains the scope and usage context. It does not describe edge cases or prerequisites beyond navigation, but for a zero-parameter, read-only audit tool, this is a solid and complete description.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The tool has zero parameters, and schema coverage is 100% (vacuously). With 0 params, the baseline is 4. The description explains the tool's behavior and output even though there are no parameters to document, providing sufficient semantic context for invocation.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description opens with a specific verb+resource+scope: 'Run a NIST SP 800-53 Rev. 5 web application security controls audit on the current page.' It clearly states the standard (NIST SP 800-53 Rev. 5), the target (current page), and lists the exact control families (AC, IA, SI) with sample checks. This distinguishes it from the sibling alethia_audit_wcag by specifying a distinct standard and domain.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The instruction 'Call after navigating with alethia_tell' provides an explicit when-to-use context. It also implies the tool is for security audits, differentiating it from accessibility audits (alethia_audit_wcag). However, it does not explicitly mention when-not-to-use or alternative tools by name, so it stops short of a 5.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
alethia_audit_wcagARead-only
Run a WCAG 2.1 AA accessibility audit on the current page, powered by axe-core. Checks alt text, form labels, keyboard access, color contrast, ARIA usage, heading structure, and the rest of the axe-core ruleset — not a fixed checklist. Call after navigating with alethia_tell. Returns findings with rule IDs, impact levels, and issue counts.
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Annotations already declare readOnlyHint=true and destructiveHint=false, but the description adds substantial behavioral context: it operates on the current page, is powered by axe-core, covers a dynamic ruleset rather than a fixed checklist, and returns findings with rule IDs, impact levels, and issue counts. This goes well beyond the annotations.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is three sentences, with the main action front-loaded in the first sentence. Every sentence contributes: what it does, what it checks, and when to call it plus return format. No filler or redundancy.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a zero-parameter, read-only tool with annotations and no output schema, the description fully covers purpose, behavior, usage timing, and return value. It also distinguishes from the NIST audit sibling, making it complete for an agent to select and invoke correctly.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Input schema has zero parameters, so the baseline is 4. The description adds meaning by explaining that the tool operates on the current page with no required inputs, which is useful context. There are no parameter details to elaborate on.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
Description clearly states the tool runs a WCAG 2.1 AA accessibility audit on the current page using axe-core. It lists specific checks (alt text, form labels, keyboard access, etc.) and distinguishes itself from a fixed checklist, which differentiates it from the sibling alethia_audit_nist.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description gives an explicit usage instruction: 'Call after navigating with alethia_tell.' It does not explicitly name alternatives or state when not to use it, but the WCAG-specific scope and context make the appropriate use case clear, especially compared to the NIST audit sibling.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
alethia_compileARead-only
Compile natural-language test instructions to Alethia Action IR text, without executing anything. Returns the compiled IR, per-line confidence scores (0-1), and warnings for any lines the compiler could not parse. Use this to preview what tell() will run, debug coverage gaps, or generate reproducible IR scripts for CI pipelines.
| Name | Required | Description | Default |
|---|---|---|---|
| instructions | Yes | Plain-English instructions to compile (does not execute). |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Annotations already mark the tool as readOnly, and the description adds valuable behavioral context: it 'does not execute anything', returns compiled IR, per-line confidence scores (0-1), and warnings for unparsed lines. This goes beyond annotations by describing the exact output and failure indication.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Three concise sentences: the first states the core action and non-execution, the second lists the return values, and the third gives use cases. Every sentence earns its place with no filler.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a simple compile-only tool with one parameter and no output schema, the description fully explains purpose, behavior, output format (IR, confidence, warnings), and use cases. It is self-contained and leaves no significant gaps.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The input schema already fully describes the only parameter (instructions: 'Plain-English instructions to compile (does not execute).') with 100% coverage. The tool description paraphrases this as 'natural-language test instructions' but adds no new semantic detail, so the baseline of 3 applies.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description starts with a specific verb 'Compile' and defines the resource as 'natural-language test instructions to Alethia Action IR text'. It also explicitly states 'without executing anything', differentiating it from execution-focused sibling tools like alethia_tell.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description explicitly tells when to use the tool: 'preview what tell() will run, debug coverage gaps, or generate reproducible IR scripts for CI pipelines.' This provides clear use cases and implies it should not be used for actual execution.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
alethia_evalA
Evaluate a JavaScript expression in the page under test and return the result. Runs in the context of the navigated page, not the Alethia host UI. Use this for queries the NLP compiler cannot express — counting elements, reading computed styles, checking localStorage, or any DOM inspection that needs raw JS.
| Name | Required | Description | Default |
|---|---|---|---|
| expression | Yes | JavaScript expression to evaluate in the page context. Example: "document.querySelectorAll('li').length" |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With annotations present (readOnlyHint: false, destructiveHint: false), the description adds meaningful context: it runs in the navigated page rather than the host UI and returns the evaluation result. However, it does not explicitly warn that arbitrary JS may have side effects, though this is partially implied by readOnlyHint: false.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Three concise sentences deliver the core purpose, execution context, and usage guidance without redundancy. Information is front-loaded and every sentence earns its place.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool's simplicity (one parameter, no output schema) and strong annotations, the description covers purpose, context, examples, and execution environment. It is fully complete for an agent to select and invoke the tool correctly.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100% and the only parameter 'expression' is well-defined with an example. The description adds usage examples but does not add new parameter-level semantics beyond what the schema already provides, warranting the baseline score.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool evaluates a JavaScript expression in the page under test, using the specific verb 'Evaluate' and identifying the resource. It distinguishes itself from siblings by emphasizing the page context versus the Alethia host UI and positions itself for queries the NLP compiler cannot express.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
Explicitly says 'Use this for queries the NLP compiler cannot express' and provides concrete examples (counting elements, reading computed styles, checking localStorage). It also implicitly excludes use for host UI operations and anything the NLP compiler can handle, giving clear when-to-use and when-not-to-use guidance.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
alethia_export_sessionARead-only
Export the full session recording as a signed evidence pack. Contains every tool call made during this session with timestamps, inputs, outputs, policy decisions, and a SHA-256 integrity hash. Use at the end of an agent loop to produce cryptographic proof of everything the agent did. Designed for compliance review and chain-of-custody.
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
The description adds meaningful behavioral context beyond the readOnlyHint and destructiveHint annotations, detailing exactly what the evidence pack contains ('every tool call... timestamps, inputs, outputs, policy decisions, and a SHA-256 integrity hash'). This enriches the agent's understanding of the tool's output and purpose, though it does not specify the exact format or delivery mechanism of the pack.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is three sentences, front-loaded with the primary action, followed by useful detail about contents and usage. Every sentence contributes distinct information without redundancy or fluff, making it appropriately concise and well-structured.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a tool with no parameters and no output schema, the description covers the essential aspects: what it does, what it includes, when to use it, and its purpose. The annotations cover safety traits, and the description fills in the behavioral and usage context, achieving a high level of completeness.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The tool has zero parameters, so the input schema is trivially complete. The description adds contextual meaning by explaining what the evidence pack will include, which indirectly clarifies the tool's output, even though param semantics are not directly addressed. This meets the baseline for zero-parameter tools.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool's function: 'Export the full session recording as a signed evidence pack.' It specifies the resource (session recording) and unique output (signed evidence pack with timestamps, inputs, outputs, policy decisions, and SHA-256 hash), distinguishing it from sibling tools like alethia_audit_wcag or alethia_status.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides explicit guidance on when to use the tool: 'Use at the end of an agent loop to produce cryptographic proof of everything the agent did.' It also contextualizes the use case ('Designed for compliance review and chain-of-custody'), though it does not explicitly mention when not to use it or name alternatives.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
alethia_hide_cockpitAIdempotent
Hide the Alethia cockpit window. The runtime keeps running and continues to accept tool calls; only the visible window is dismissed.
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
The description adds key behavioral context beyond annotations: the runtime keeps running and continues to accept tool calls, clarifying that this is non-destructive and only affects the UI. This complements the idempotentHint and destructiveHint annotations without contradiction.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Two concise sentences entirely focused on the action and its scope. No fluff or redundant wording; every word earns its place.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a zero-parameter UI-hiding tool, the description is fully complete. It explains what happens to the runtime, which is the one behavioral nuance the agent needs to know. The sibling set (show_cockpit, kill_switch) makes the contrast implicit but sufficient.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The tool has zero parameters, and schema coverage is effectively 100% (empty schema). The description needs to explain no parameters, and the baseline for zero-param tools is 4. It correctly focuses on the action rather than parameter details.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states 'Hide the Alethia cockpit window' with a specific verb and resource. It distinguishes itself from sibling tools like show_cockpit and activate_kill_switch by clarifying that the runtime continues, making the action's scope explicit.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description gives clear context: use this to dismiss the visible window while keeping the runtime operational. It implies the contrast with show_cockpit and non-destructive tools, but does not explicitly name alternatives or exclusions, so it falls short of a 5.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
alethia_propose_testsARead-only
Navigate to a URL, scan the page for interactive elements (headings, buttons, forms, links, destructive actions), and generate a candidate NLP test suite ready to pass to alethia_tell. Returns an array of plain-English test blocks, including an auto-generated "EA1 Safety Gate Verification" block that uses "expect block: " for every destructive control on the page. Use this to bootstrap test coverage for a new page or to discover what the safety gate should be watching.
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | The URL to navigate to and scan (file://, http://localhost, etc.). |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
The description adds significant behavioral context beyond the annotations: it explains the tool scans for destructive actions, auto-generates an 'EA1 Safety Gate Verification' block, and returns an array of test blocks. This complements the readOnlyHint and destructiveHint annotations with concrete output and scanning behavior. No contradiction exists; the annotations indicate a safe read-only operation and the description confirms it only scans and suggests, not executes.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is three sentences, each earning its place: the first states the main action, the second details the return value and key generated block, and the third gives usage guidance. It is front-loaded with the primary verb and resource, with no irrelevant filler. The structure is clean and efficient.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a tool with only one parameter and no output schema, the description is quite complete. It explains what the tool does, what it returns (an array of plain-English test blocks), and gives a concrete example of the safety gate block format. It could have elaborated on error handling or edge cases, but given the simplicity of the tool, the information provided is sufficient.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The schema description coverage is 100%, so the parameter 'url' is fully documented with value examples (file://, http://localhost). The tool description adds minimal extra parameter meaning; it only explains that the URL is navigated to and scanned, which is implicit in the tool's purpose. Since the schema already provides the necessary details, a baseline score of 3 is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool's function: it navigates to a URL, scans for interactive elements, and generates a candidate NLP test suite. It explicitly differentiates from sibling tools by noting the output is 'ready to pass to alethia_tell', making it distinct from the tell, compile, and eval tools. The verb 'generate' paired with the resource 'candidate test suite' is specific and unambiguous.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides explicit usage context: 'Use this to bootstrap test coverage for a new page or to discover what the safety gate should be watching.' It also indirectly references the alternative tool (alethia_tell) as the downstream consumer of the output. However, it does not include an explicit 'when not to use' statement or direct comparison to alternatives like alethia_compile, so it falls short of a perfect 5.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
alethia_screenshotARead-only
Capture a PNG screenshot of the current page and return it as a base64-encoded image. Use this to visually verify what the browser is showing after running test steps with alethia_tell.
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Annotations already declare readOnlyHint=true and destructiveHint=false. The description adds useful behavioral context beyond that, such as capturing the 'current page' and returning a base64-encoded image, which aligns with and reinforces the read-only nature of the operation.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is two sentences: the first states the action and output format, the second provides usage context. It is front-loaded, efficient, and contains no filler or redundancy.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a tool with no parameters and no output schema, the description fully covers the necessary information: what it does, what it returns, and when to use it. There are no significant gaps given the tool's simplicity.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The tool has zero parameters, so the baseline of 4 applies. No parameter description is needed, and the schema coverage is trivially 100%.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description uses a specific verb and resource: 'Capture a PNG screenshot of the current page' and explicitly states the output format (base64-encoded image). It also distinguishes the tool from siblings by mentioning its role after alethia_tell steps.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description explicitly tells when to use the tool: 'after running test steps with alethia_tell' and why: 'to visually verify what the browser is showing'. It does not explicitly name alternatives, but the context is clear enough for an agent to select it appropriately.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
alethia_serve_demoAIdempotent
Start a local HTTP server for the built-in Alethia demo pages and return the base URL. Use this to serve demo pages on localhost so they appear in preview panels (Claude Code, VS Code, etc.). The server runs on a random available port on 127.0.0.1. Call this before alethia_tell to get a localhost URL instead of a file:// path. Returns the base URL and a list of available demo pages.
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Annotations already indicate idempotent and non-destructive behavior. The description adds valuable context about the server running on a random available port on 127.0.0.1 and clarifies the return value (base URL and list of demo pages). No contradiction exists between description and annotations.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is concise, with three sentences that front-load the core action, then provide usage context, technical detail, and return information. Every sentence serves a purpose with no fluff.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a zero-parameter, simple tool, the description is fully complete. It covers purpose, when to use, how it behaves (random port, loopback), and what it returns, even without an output schema. This is more than sufficient for an agent to select and invoke it correctly.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The tool has zero parameters, so the baseline is 4. The description appropriately avoids redundant parameter explanations and instead adds value by describing the server's operational details and return value.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool's purpose: 'Start a local HTTP server for the built-in Alethia demo pages and return the base URL.' It uses a specific verb ('start') and resource ('local HTTP server'), and distinguishes itself from siblings by mentioning its role in serving demo pages and its relationship to alethia_tell.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description explicitly tells when to use this tool: 'Use this to serve demo pages on localhost so they appear in preview panels' and 'Call this before alethia_tell to get a localhost URL instead of a file:// path.' This provides clear context and an explicit sequencing instruction relative to a sibling tool.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
alethia_show_cockpitAIdempotent
Show the Alethia cockpit window — the oversight surface where the target app is driven and each step is highlighted live (green = pass, blue = type, red = EA1 block). Use this to pop the UI into view during a headless-launched session for demos, review, or partner walkthroughs.
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Annotations already indicate idempotentHint=true and destructiveHint=false, so the safety profile is covered. The description adds the headless-session context and the visual highlight behavior, but doesn't disclose additional side effects or return behavior. It does not contradict annotations.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is two sentences, front-loaded with the core action. The first sentence defines the tool and describes the cockpit's visual elements; the second sentence gives usage guidance. No wasted words.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a no-parameter, no-output-schema display tool, the description fully covers what the tool does and when to use it. It is complete within its simple context and complements the sibling tool hide_cockpit.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The tool has zero parameters, so the schema coverage is effectively 100%. No parameter documentation is needed, and the description adds no parameter info, which aligns with the baseline of 4.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool's action: "Show the Alethia cockpit window" – a specific verb and resource. It also explains what the cockpit is (oversight surface with live highlighting) and distinctly contrasts with the sibling tool alethia_hide_cockpit.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description gives explicit usage context: "Use this to pop the UI into view during a headless-launched session for demos, review, or partner walkthroughs." It does not name alternatives or specify when not to use, but the context is clear and practical.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
alethia_statusARead-onlyIdempotent
Health and identity probe. Returns runtime version, the default VITRON-EA1 policy profile in effect, kill switch state, driver statistics (queued plans, run count, audit count), the current page domain, and runtime capabilities. Use this for liveness checks before sending tell() calls, and to verify the runtime is in a known-good state at the start of an agent loop.
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Annotations already declare readOnlyHint=true, idempotentHint=true, and destructiveHint=false. The description adds value by detailing what the probe returns (runtime version, policy profile, kill switch state, etc.) and clarifies it is an identity/health probe, which is consistent with the annotations and adds useful context for the agent.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is two sentences: the first states the purpose and return data, the second gives usage context. It is front-loaded with the most important information, and there is zero waste or repetition.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Since there is no output schema, the description must convey what the tool returns, and it does so thoroughly. It enumerates all key fields and provides operational context (liveness check before tell calls). For a zero-parameter status tool with strong annotations, this is complete.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The input schema has zero parameters, so there is no parameter documentation burden. The description implicitly reinforces that the tool takes no inputs by framing it as a probe, and the baseline for zero-parameter tools is 4, which is appropriate here.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description opens with 'Health and identity probe' and immediately lists the specific return values: runtime version, policy profile, kill switch state, driver statistics, page domain, and capabilities. This clearly distinguishes it from sibling tools like alethia_tell or alethia_compile, which perform actions rather than status checks.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
It explicitly states to use this tool for liveness checks before sending tell() calls and at the start of an agent loop to verify a known-good state. This provides clear context for when to use it relative to siblings, though it does not explicitly name alternative tools.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
alethia_tellA
Execute natural-language E2E test instructions against the page Alethia is currently driving. Returns per-step results, policy audit records, and a SHA-256 integrity hash. Destructive actions (delete, purchase, transfer, etc.) are blocked unconditionally. Sensitive input (passwords, credit cards, SSN) is blocked unless allowSensitiveInput is true. ~13 ms per step on average.
| Name | Required | Description | Default |
|---|---|---|---|
| name | No | Short label for the run (e.g. "signin smoke", "delete-blocked check", "checkout regression"). Strongly recommended — without it the run shows up as "tell" in cockpit history and audit trails, which makes review painful when many runs accumulate. Alternatively, prefix the first line of `instructions` with `name <label>` and the NLP compiler will read it. | |
| instructions | Yes | One or more plain-English test instructions, newline-separated. Example: "navigate to http://localhost:3000\nclick Sign In\nassert the dashboard is visible" | |
| allowSensitiveInput | No | Set to true to allow typing into password, token, credit card, and other sensitive fields. Only use for legitimate auth or payment flow tests. |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
The description discloses significant behavioral traits beyond the annotations: destructive actions are blocked unconditionally, sensitive input is blocked unless allowSensitiveInput is true, it returns per-step results, policy audit records, and a SHA-256 integrity hash, and mentions ~13 ms per step average performance. These details provide substantial transparency about safety constraints, output, and performance, going well beyond the simple boolean hints.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is concise, four sentences long, and front-loaded with the core purpose. Each sentence provides distinct and valuable information: purpose, outputs, safety constraints, and performance. No redundant or filler content is present.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
The description covers the core function, return values (per-step results, policy audit records, integrity hash), and key constraints (destructive block, sensitive input gate, performance). It also implies a prerequisite (the page currently being driven). However, it lacks a bit of detail on what 'policy audit records' contain or how results are delivered (e.g., output format), which would be useful given the absence of an output schema.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, and each parameter (name, instructions, allowSensitiveInput) has a clear description. The tool description adds no extra parameter semantics beyond the schema; it mentions allowSensitiveInput in behavioral context but does not provide additional syntax, formatting, or usage details that aren't already present in the schema.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool's function with a specific verb ('Execute') and resource ('natural-language E2E test instructions against the page Alethia is currently driving'). However, it does not explicitly distinguish from the sibling tool alethia_tell_parallel, which likely performs a similar action in parallel, so full differentiation is missing.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides context for when to use it (running natural-language E2E tests) and mentions blocking of destructive actions and sensitive input, which implies careful use with flags like allowSensitiveInput. However, it does not explicitly state when to use this tool over alternatives like alethia_tell_parallel, and no exclusionary or alternative guidance is given.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
alethia_tell_parallelA
Run multiple test flows concurrently — each against a different URL. Takes an array of test specs, spawns a browser instance per spec, runs them in parallel, and returns all results together. Use this to verify multiple pages simultaneously.
| Name | Required | Description | Default |
|---|---|---|---|
| specs | Yes | Array of test specs. Each has "url" (file:// or http://localhost) and "instructions" (test steps). |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Beyond the annotations (readOnlyHint=false, destructiveHint=false), the description adds concrete behavioral details: it spawns a browser instance per spec, runs them in parallel, and returns all results together. It also hints at resource usage by mentioning spawning per spec. No contradiction with annotations.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is two sentences, front-loaded with the core action, followed by execution details and a use case. Every sentence adds value; no filler or redundancy.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a tool with one well-documented parameter and a clear execution model, the description provides a complete mental model: parallel browser instances, input specs, and aggregated results. It doesn't detail the return format, but no output schema exists and the description gives a reasonable expectation. Given the simplicity, this is nearly complete.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100%, so the schema already defines the specs array with url, instructions, and optional name. The description repeats 'Takes an array of test specs' without adding semantic detail beyond the schema. Baseline 3 applies because the schema carries the param semantics.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description opens with a specific verb+resource: 'Run multiple test flows concurrently — each against a different URL.' It clearly distinguishes from siblings like alethia_tell by emphasizing parallelism and multiple URLs. The purpose is unambiguous and action-oriented.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description explicitly states when to use: 'Use this to verify multiple pages simultaneously.' It implies this is for parallel verification across different URLs, which differentiates it from single-flow tools. It does not name alternatives or exclusions, but the usage context is clear.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
15 tool updates
v0.9.2- First observed
alethia_activate_kill_switch - First observed
alethia_assert_safety - First observed
alethia_audit_nist - First observed
alethia_audit_wcag - First observed
alethia_compile - First observed
alethia_eval - First observed
alethia_export_session - First observed
alethia_hide_cockpit - First observed
alethia_propose_tests - First observed
alethia_screenshot - First observed
alethia_serve_demo - First observed
alethia_show_cockpit - First observed
alethia_status - First observed
alethia_tell - First observed
alethia_tell_parallel
TDQS
Scored across 15 tools
Each tool has a clearly distinct purpose: executing tests, compiling, monitoring, UI control, safety override, capturing state, JS query, audits, session export, parallel execution, demo server, test proposal, safety assertion, and cockpit control. Even related tools like audit_wcag and audit_nist target different standards.
All tools share the 'alethia_' prefix and use snake_case, making the pattern highly predictable. However, a few names (status, screenshot, eval) are nouns or abbreviations rather than verbs, which slightly deviates from a strict verb_noun convention.
With 15 tools, the server sits at the upper boundary of a well-scoped set. Each tool addresses a distinct need in the automation workflow, though some are auxiliary (e.g., cockpit controls, demo server) and could be trimmed without losing core functionality.
The tool set provides comprehensive coverage for the stated purpose: compile/preview, execute, observe (screenshot/eval), audit (WCAG/NIST), safety verification, session export, and parallel execution. There are no obvious dead ends or missing critical operations.
Maintenance
Related MCP Connectors
- gatewayOAuthai.sealgate
MCP gateway with runtime security policy, tool-call-level control, and audit of agent actions.
Zero-secret MCP gateway for AI agents: risk-scored, audited calls with human-in-the-loop approval.
Governed MCP: agent audit, provenance, deterministic checks, and receipt-backed FragGate execution.
Remote MCP for A2A failure replay MCP, structured receipts, audit logs, and reviewer-ready evidence.
Related MCP Servers
- AlicenseNot gradedqualityAmaintenanceMCP server that gates agent tool calls by normalizing intent, denying unknown/unattended destructive actions, and requiring HITL prove approval for high-risk operations. It maintains an append-only hash-chained Action Ledger and exposes gate_check and ledger_verify tools without ever executing tools.MIT
- AlicenseAqualityDmaintenanceEnables policy-governed MCP interactions with deterministic authorization, tenant isolation, minimized PII exposure, and human approval gates for sensitive mutations, while producing structured audit events.3MIT
- AlicenseNot gradedqualityBmaintenanceEnables transparent MCP proxying with a hash-chained effect ledger, classifying agent actions by reversibility, enforcing approval gates, and dry-run previews of sessions.MIT
- AlicenseNot gradedqualityAmaintenanceEnables AI agents and MCP clients to screen proposed actions, enforce deterministic policies and limits, and produce tamper-proof signed audit receipts before any external side effect is executed.0MIT