Skip to main content
Glama

sumo_qa_validate_test_data

Read-onlyIdempotent

Validates a test data entry by catalogue ID or full object without contacting downstream systems, helping QA catch bad data before use.

Instructions

Validate a test data entry (entry_id from the catalogue, or a full entry dict) without touching downstream systems.

Input Schema

NameRequiredDescriptionDefault
entryNo
entry_idNo

Schema Changelog

Changes observed during successful MCP inspections.

  1. First observedv0.42.0

TDQS

A3.6/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true, idempotentHint=true, destructiveHint=false, and openWorldHint=false, so the safety profile is fully covered by structured data. The description's 'without touching downstream systems' usefully reinforces the no-side-effects guarantee, but it does not disclose what validation actually checks or how failures are surfaced, adding only modest context over the annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

A single sentence with the action and the key constraint front-loaded; every clause earns its place, and the parenthetical efficiently disambiguates the two input modes.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With no output schema, the description should say what a validation result looks like (validity flag, error list, etc.), which it omits. For a two-optional-parameter tool with no schema descriptions, the input side is covered but the outcome side is not.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the description carries the full burden and does explain both parameters: `entry_id` comes from the catalogue, while `entry` is a full dict. That adds real meaning beyond the bare anyOf definitions, though it omits what happens if both are supplied or neither is (precedence/error behavior).

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description pairs the specific verb 'Validate' with the resource 'test data entry' and clarifies the two acceptable input forms (catalogue `entry_id` or a full `entry` dict). It implicitly separates this from mutation siblings by stating it does not touch downstream systems, though no sibling is named explicitly.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The phrase 'without touching downstream systems' implies a dry-run/check-only usage context, which helps an agent choose this over sumo_qa_record_mutation or sumo_qa_register_known_good_test_data. However, it never states when to prefer validation over those tools or what prerequisites exist, leaving the routing decision to inference.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.