Skip to main content
Glama

Run test case

test_case_run
Destructive

Runs the saved question against the current draft; uses the monthly test allowance.

Past the allowance it fails with setup_limit_reached until resets_at. No durable attempt receipt exists. Case/result evidence shows recorded state after timeout/loss; a rerun is a new attempt. Stored answers are separate from currentness and evaluation.

Input Schema

NameRequiredDescriptionDefault
case_idYesSaved test case ID from test_cases_list or test_case_create.
agent_idYesAgent ID from agents_list or agent_create.

Output Schema

NameRequiredDescriptionDefault
codeNo
answerNo
statusYes
case_idYes
agent_idYes
evidenceNo
recoveryYes
persistenceNo

Schema Changelog

Changes observed during successful MCP inspections.

  1. Changed1 schema field changed
    • addedOutput schema / $defs / TestResult / properties / accepted_at
      Added value: +{
      +  "anyOf": [
      +    {
      +      "format": "date-time",
      +      "type": "string"
      +    },
      +    {
      +      "type": "null"
      +    }
      +  ],
      +  "default": null,
      +  "title": "Accepted At"
      +}
  2. Changed2 schema fields changed
    • addedInput schema / properties / agent_id / description
      Added value: +"Agent ID from agents_list or agent_create."
    • addedInput schema / properties / case_id / description
      Added value: +"Saved test case ID from test_cases_list or test_case_create."
  3. First observed

TDQS

A3.7/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The description goes well beyond the annotations by naming the metered monthly test allowance, the exact failure mode (setup_limit_reached until resets_at), the absence of a durable attempt receipt, and the fact that a rerun is a new attempt. This meaningfully reinforces and explains the non-idempotent, destructive hints. The closing line about stored answers being separate from currentness and evaluation is terser and less actionable.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The core action and the metering constraint are front-loaded and every sentence carries operational weight. Some phrasing is telegraphic jargon ('no durable attempt receipt exists', 'recorded state after timeout/loss') that costs the reader a pass to parse.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With an output schema present, the description need not explain return values, and it does cover the quota, error code, and attempt semantics an agent needs before calling. It stops short of clarifying what 'current draft' refers to or how the result relates to test_case_evaluate.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, and both case_id and agent_id already document their provenance (test_cases_list/test_case_create, agents_list/agent_create). The description adds nothing about parameter meaning, so the baseline 3 applies.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

States a concrete action on a concrete resource: runs the saved question against the current draft. An agent can grasp the operation without opening the schema, but the phrasing ('saved question') drifts from the tool's own naming ('test case') and never distinguishes this execution from the sibling test_case_evaluate.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Usage is implied by 'runs the saved question against the current draft', and the quota/failure conditions tell the agent when a call will not succeed. However, there is no explicit guidance on when to pick this over test_case_evaluate, test_case_read, or test_result_read, and no prerequisite statement.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.

Resources