Skip to main content
Glama

Agent tool-call test builder

build_agent_tool_tests
Read-onlyIdempotent

Build 1-20 tool invocation checks for an authorized staging agent. Returns tool-tests.json; does not execute tests. One-time application dispatcher capture is required. Run with the free PromptBrake Action; no license is needed. Checks observed calls and typed arguments, not backend effects or independent permission enforcement.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
testsYes

Output Schema

TableJSON Schema
NameRequiredDescriptionDefault
setupYes
pack_jsonYes
limitationsYes
execution_requiredYes

Schema Changelog

Changes observed during successful MCP inspections.

  1. Added

TDQS

A3.7/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With readOnly/idempotent/destructive annotations already covering the safety profile, the description still adds non-obvious behavior: it does not execute the tests it builds, and its checks cover observed calls and typed arguments rather than backend effects or independent permission enforcement. That last sentence usefully bounds what the tool actually verifies.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Four short sentences, front-loaded with what is produced and then the prerequisites and scope limits; every sentence adds a constraint rather than restating the title. Slightly dense but no filler.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

An output schema exists, so return-shape detail is unnecessary, and the description still names the produced file. Combined with the prerequisite statement and the explicit limits on what is not validated, an agent has enough to decide and invoke; the missing piece is sibling differentiation.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Top-level schema description coverage is 0% for the single required `tests` parameter, but the description conveys the cardinality (1-20 checks) and hints at the rule semantics (observed calls vs typed arguments). The nested schema already carries description text for id, name, rule, and prompt, so the description only partially compensates.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description gives a specific verb+resource with scope ("Build 1-20 tool invocation checks for an authorized staging agent") and names the output artifact (tool-tests.json). It does not, however, distinguish itself from the similarly named sibling build_test_pack, leaving the agent to infer the split from the name alone.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

It states preconditions (a one-time dispatcher capture is required, run via the free PromptBrake Action, no license needed) which is real usage context. But it never says when to prefer this tool over build_test_pack or the other siblings, and gives no when-not guidance.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.

Resources