Skip to main content
Glama

Get Test Setup

get_test_setup
Read-onlyIdempotent

Get the current test setup: title, task (the concrete action the tester performs), scenario (the situational framing shown to testers), and configured post-test questions. Use IDs from list_test_blocks to target a block/run; omission uses the documented defaults. Legacy tests also supported.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
runIdNo
testIdYes
blockIdNoSelect one block from list_test_blocks. Omit to infer a sole relevant block; list_insights defaults to all AI blocks. Omit for legacy tests.

Output Schema

TableJSON Schema
NameRequiredDescriptionDefault
dataNo
taskNo
retryNo
runIdNo
scopeNo
titleNo
statusNo
testIdNo
blockIdNo
messageNo
nextStepNo
scenarioNo
postTestQuestionsNo

Schema Changelog

Changes observed during successful MCP inspections.

  1. Added

TDQS

A3.8/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint, idempotentHint, and non-destructive, so the safety profile is covered. The description adds genuine context beyond that: what the payload contains, that omitting IDs yields documented defaults, and that legacy tests are supported. It does not cover auth requirements or how runId/testId interact, which keeps it below a 5.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two tight sentences with the returned-field list front-loaded and the targeting/omission rule following. Every clause carries information; nothing is padded. Slightly dense in the parenthetical definitions but not wasteful.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

An output schema exists, so return values need not be explained, yet the description still names the key fields for selection purposes. For a read-only, idempotent, closed-world tool with three parameters, the description plus annotations plus output schema cover what an agent needs to call it correctly.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 33%: only blockId carries a schema description, while runId and testId are pattern-only. The description partially compensates by explaining that block/run targeting uses IDs from list_test_blocks and that omission uses defaults, but it never clarifies the required testId or the relationship between runId and testId. Adequate but with clear gaps.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description gives a specific verb+resource (get the current test setup) and enumerates exactly what is returned: title, task, scenario, and configured post-test questions. That field list distinguishes it from sibling readers like get_test, get_test_definition, and get_test_summary. It stops short of naming an alternative explicitly, so sibling differentiation is implied rather than stated.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

It says to use IDs from list_test_blocks to target a block/run and that omission falls back to documented defaults, which is real usage context. However, it never says when to prefer this tool over get_test, get_test_definition, or get_test_summary, and gives no prerequisites or exclusions. Usage is implied rather than routed.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.

Resources