Skip to main content
Glama

create_suite

Create a reusable test suite: a named set of scenarios/personas pinned to a target voice agent you run. Optionally give it a schedule ("weekly" | "daily" | "hourly", plan-gated) so it runs automatically and flags drift.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
nameYes
languageNoBCP-47 language tag, default "en".
scheduleNoCadence for scheduled runs, e.g. "weekly" | "daily" | "hourly".
scenariosNoPersona + goal pairs the suite exercises.
targetAgentYesThe voice agent under test — a system you run. transport "direct" (SIP/WebRTC) has near-zero cost and works on every plan; "pstn" places a real carrier call (pro+ plans) and only to a number you have verified. The hosted demo target is { "transport": "direct", "peerId": "wb-demo-dental" }.

TDQS

A3.7/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description must carry the transparency burden. It discloses that schedules are 'plan-gated' and that the suite 'flags drift', which adds behavioral context. However, it does not mention side effects like persistence, immediate vs. scheduled execution, or verification requirements for PSTN targets (those live in the schema, not the main description).

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is two sentences, front-loaded with the resource definition and optional schedule. It is concise, with no wasted words, and earns a high score for structure.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The description covers the tool's purpose and the optional schedule, but with no output schema it omits what is returned (e.g., suite ID). It also doesn't explain the verification requirement for PSTN targets, which is only in the schema. For a create tool with nested objects, this is adequate but not complete.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 80%, so the baseline is 3. The main description repeats schedule values and mentions scenarios/personas, but it does not add meaning beyond the schema. Since the schema already documents each parameter well, the description does not need to compensate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description names a specific resource ('reusable test suite') and action ('create'), and elaborates with 'named set of scenarios/personas pinned to a target voice agent you run'. This is clearly distinct from sibling tools like run_test or create_monitor, as it emphasizes reusability and optional scheduling.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage for persistent, scheduled test suites ('reusable', 'optionally give it a schedule so it runs automatically'), but it does not explicitly state when to choose this over run_test or create_monitor, nor mention any exclusions. The guidance is implicit rather than explicit.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.

TDQS

A4/5.0
Disambiguation4/5

Most tools are clearly distinct by resource (monitors, suites, flows, numbers, recordings), but run_test and test_flow could be confused since both execute tests, though their scopes differ. The descriptions help disambiguate them.

Naming Consistency5/5

All tool names follow a consistent verb_noun snake_case pattern (create_, get_, list_, run_, verify_, etc.), with no camelCase or mixed conventions. Even compound names like get_monitor_health and verify_number_confirm remain predictable.

Tool Count4/5

At 16 tools, the set is slightly above the optimal 3-15 range, but the breadth of the voice-agent testing/monitoring domain justifies each tool's existence. It feels well-scoped rather than bloated.

Completeness2/5

The tool set lacks update/delete operations for most entities (monitors, suites, flows) and omits a get_run tool to retrieve individual live test results, leaving significant gaps that agents cannot work around. This will cause failures in lifecycle management and live-run result retrieval.

Resources