Skip to main content
Glama

TestChimp

list-tests-awaiting-verification

List SmartTests whose latest executions still need human verification before they earn a verified badge (testId, testName, filePath, scenarioId / scenarioOrdinalId / scenarioTitle, verificationStatus NOT_VERIFIED or VERIFIED_STALE, reportedAtMillis, workflowExecutionId). Optional userId narrows to tests authored for that user (defaults to the OAuth token's user); optional limit. Use after writing E2E tests to prompt the user to verify the executions.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
limitNo
userIdNo

Schema Changelog

Changes observed during successful MCP inspections.

  1. First observed

TDQS

A4.1/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries the full burden, and it does disclose real behavior: the scoping rule ('latest executions'), the two status values that qualify, and the userId default (OAuth token's user). It does not state read-only status explicitly or mention sorting/pagination limits, but 'List' plus the enumerated semantics give solid behavioral context.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Purpose and triggering condition are front-loaded, and the tool is otherwise compact. The long parenthetical field list is dense but earns its place as a return-shape substitute given there is no output schema; the sentence is a bit run-on but not wasteful.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With no annotations and no output schema, the description usefully enumerates returned fields and the filter semantics, so an agent knows what it will get and when. It lacks any pagination or ordering note for a capped list tool, which is the main remaining gap.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the description must compensate. It fully explains userId (narrows to tests authored for that user, defaults to the OAuth token's user), but limit is given only as 'optional limit' with no mention of its 1-500 range or behavior. Half the parameters are enriched, half are not.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

States a specific verb (List) and resource (SmartTests) plus a precise scope: those whose latest executions still need human verification. The parenthetical enumerates the exact verificationStatus values (NOT_VERIFIED or VERIFIED_STALE), which disambiguates it from sibling list-* and mark-tests-for-review tools without opening any schema.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Explicitly tells the agent when to call it: 'Use after writing E2E tests to prompt the user to verify the executions.' That is a genuine triggering condition, though it names no alternatives (e.g. mark-tests-for-review) and states no exclusions.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.