Skip to main content
Glama

run_qa

Generates a QA test protocol listing every Local MCP tool to test, including expected inputs and pass/fail criteria.

Instructions

Returns a QA test protocol listing every LMCP tool to test, with expected inputs and pass/fail criteria.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault

No arguments

Schema Changelog

Changes observed during successful MCP inspections.

  1. Addedv3.0.416

TDQS

B3.4/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries the full burden but does disclose the return payload ('a QA test protocol listing every LMCP tool... with expected inputs and pass/fail criteria'). It does not state that the call is read-only/side-effect-free, nor whether the protocol is static or dynamically generated from the current tool set.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

A single front-loaded sentence that states the resource and the contents of the return value with no filler. Nothing is wasted or buried.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a zero-parameter introspection tool this is close to adequate, and the description covers the return contents in lieu of an output schema. However, it omits the safety profile (read-only vs mutating) and any hint of how the protocol feeds the downstream submit_qa_report step, leaving the workflow slightly underspecified.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The tool takes zero parameters, so the baseline is 4. The description correctly implies no user-supplied arguments are needed, and there is no schema-level parameter meaning left to add.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

States a specific verb and resource: it returns a QA test protocol enumerating every LMCP tool with expected inputs and pass/fail criteria. That is far more informative than a tautology, but it never names its natural partner submit_qa_report, so the boundary between generating a protocol and submitting a report is left implicit.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

There is no explicit when-to-use or when-not-to-use statement, and no alternatives are named. An agent can infer it belongs to a QA workflow alongside submit_qa_report and run_diagnostics, but the description provides no routing guidance of its own.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Deploy Server

Other Tools