Skip to main content
Glama

Create UT

create_ut

Create a usability test as a PREPARING draft (title required; optional background, hypotheses, recruitmentCriteria). It starts with an empty scenario — build it out with add_use_case / add_task, then a person reviews the draft and starts sessions in the app. Defaults to your personal workspace — pass workspaceId (from list_workspaces) to create it in a team workspace where you are a member.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
titleYes
backgroundNo
hypothesesNo
workspaceIdNoTarget workspace id. Defaults to your personal workspace.
recruitmentCriteriaNo

TDQS

A4.6/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations only provide readOnlyHint=false. The description adds meaningful behavioral context: the created UT is a PREPARING draft, begins with an empty scenario, requires member access for team workspaces, and follows a specific lifecycle (draft → build → review → start sessions). This goes beyond the minimal annotation and helps the agent understand side effects and prerequisites.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single paragraph with three concise sentences. It front-loads the core purpose, then adds essential workflow and workspace details. Every sentence adds value—no fluff or repetition.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a create tool with no output schema, the description covers the draft state, required/optional fields, workflow, and workspace selection. A minor gap is the lack of explicit mention of what the response contains (e.g., new UT ID), but the workflow implies subsequent interactions. Overall, it is sufficiently complete for operational use.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is only 20% (workspaceId). The description compensates by mentioning all optional parameters (background, hypotheses, recruitmentCriteria) and clarifying workspaceId's default behavior and where to obtain it (from list_workspaces). It does not deeply explain each string field, but names are self-explanatory and the added context is valuable.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states 'Create a usability test as a PREPARING draft' with a specific verb (create), resource (usability test), and state (PREPARING draft). It also lists required and optional fields, distinguishing it from sibling tools like add_task or update_ut by outlining the next steps in the workflow.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines5/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides explicit workflow guidance: 'It starts with an empty scenario — build it out with add_use_case / add_task, then a person reviews the draft and starts sessions in the app.' It also explains when to pass workspaceId (for team workspaces) and references list_workspaces as the source, giving clear when-to-use context and alternatives.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.

TDQS

A4.1/5.0
Disambiguation5/5

Every tool targets a distinct resource and action. Even get_ut, which returns comprehensive data, doesn't replace the specialized get_session, get_transcript, or get_quantitative_report for detailed views. No two tools have overlapping purposes.

Naming Consistency4/5

All names follow a verb_noun pattern with underscores (e.g., add_task, get_ut, list_workspaces). The main inconsistency is using 'create' for UTs (create_ut) but 'add' for child entities (add_use_case, add_task), and having a separate update_scenario instead of folding it into update_ut, but the convention is still predictable.

Tool Count4/5

With 18 tools, the set is slightly above the typical 3-15 well-scoped range, but the domain of usability testing requires distinct operations for drafting (use cases, tasks, scenario), reading results (reports, sessions, transcripts), and comparison. Each tool has a clear role, so the count feels reasonable rather than excessive.

Completeness4/5

The tool surface covers the core lifecycle: create, read, update, and delete for tasks/use cases, plus comprehensive retrieval of results and notes. Minor gaps include no delete_ut (UTs cannot be removed) and no explicit status change or cloning mechanism, but these are likely intentional app-side actions, so the surface is not severely incomplete.

Resources