Skip to main content
Glama

Update the persistent QA test suite

qa_suite_update
Destructive

Add or update repository test suite cases by matching feature, objective, and steps; assign stable TC IDs to new cases and control generated-field overwrites with mergeMode.

Instructions

Add or update cases in the repo test suite: a case matching feature + objective + steps is updated, new ones get stable TC ids. mergeMode decides whether generated fields overwrite curated ones.

Tool call template

Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.

{
  "id": 1,
  "jsonrpc": "2.0",
  "method": "tools/call",
  "params": {
    "arguments": {
      "source": "<source>"
    },
    "name": "qa_suite_update"
  }
}

Input Schema

NameRequiredDescriptionDefault
casesNoCanonical or partial cases (normalized).
sourceYes
mergeModeNo
sessionIdNo
sourceUriNo
projectRootNo

Schema Changelog

Changes observed during successful MCP inspections.

  1. First observedv0.1.0

TDQS

A3.7/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already flag destructiveHint=true and non-idempotent, and the description makes that concrete: matched cases are overwritten and mergeMode governs whether generated fields replace curated ones — the exact data-loss risk. It adds real context beyond the annotations, but the three mergeMode behaviors themselves remain unstated.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two dense sentences, front-loaded with the action and immediately followed by the matching/merge semantics. No filler, no restatement of the title.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a destructive 6-parameter mutation the description covers the critical matching and overwrite behavior, which is the most important part. But with no output schema and a required `source` parameter left undefined, an agent cannot tell what the inputs mean or what a successful call yields.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 17%, so the description must compensate. It does explain mergeMode's role and the normalization/matching key for cases, but the required `source` enum (report, exploration, feature, ticket, manual, generate, suite), plus sessionId, sourceUri and projectRoot, get no explanation at all — a significant gap for a required selector parameter.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

States a concrete verb pair and resource: 'Add or update cases in the repo test suite', plus the matching key (feature + objective + steps) and the TC-id behavior. An agent can distinguish this from a read/export/lint sibling, though it never names an alternative explicitly to contrast with the generate path.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Usage is only implied by the verb 'add or update' — there is no statement of when to prefer this over qa_suite_generate or qa_suite_read, nor of prerequisites (must a suite already exist? must projectRoot be set?). It hints at mergeMode as the decision point but gives no guidance on choosing a mode.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.