Skip to main content
Glama
ohankay

service-test-mcp

by ohankay

validate_scenario

Read-only

Validates scenario YAML files, folders, or inline content for structure, services, assertion syntax, JSONPath, and variables before use, without calling any service.

Instructions

Validate scenario YAML (a file, a folder, or inline 'content'): structure, services, assertion syntax, JSONPath, and variables used before they are defined. Does not call any service.

Input Schema

NameRequiredDescriptionDefault
pathNo
contentNo

Output Schema

NameRequiredDescriptionDefault
resultYes

Schema Changelog

Changes observed during successful MCP inspections.

  1. First observedv1.0.0

TDQS

A3.9/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and openWorldHint=false; the description reinforces this with the concrete claim that no service is called, which is meaningful additional context for a validator. It stops short of saying what a failure looks like, but an output schema exists to cover that.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

A single front-loaded sentence with the input forms in parentheses and a short scoping clause. Nothing is redundant and the enumeration of checks is compact.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With an output schema present, return values need not be explained, and the description covers inputs and scope of validation adequately. The remaining gap is the optional-parameter contract (behavior when both path and content are omitted), which the description leaves silent.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the description has to carry the weight, and it does: 'path' is clarified as accepting a file OR a folder (real meaning the schema lacks), and 'content' as the inline alternative. It does not state that at least one of the two must be supplied, despite zero required parameters.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

States a specific verb ('Validate') and resource ('scenario YAML'), then enumerates the checks performed: structure, services, assertion syntax, JSONPath, and variable ordering. 'Does not call any service' implicitly separates it from run_scenario, though it never names that sibling, so an agent must infer the pairing.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The accepted input shapes (file, folder, inline content) and the no-side-effect nature imply a pre-flight/static-check usage, but there is no explicit 'use this before run_scenario' or statement of when-not to use it. The agent can infer the workflow but is not routed to it.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.