Skip to main content
Glama

Create test run

create_test_run

Create a test run in a QA project by including all cases, specific case IDs, or module-based cases. Assign the run to a user and attach it to a milestone to organize test execution.

Instructions

Create a test run in a project. scope selects which test cases are included:

  • all: every test case in the project

  • cases: specific test cases (caseIds required)

  • modules: cases from specific modules (moduleKeys required; optional mode filter)

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
modeNoOnly include cases of this mode (scope `modules`)
tagsNoTag name grouping the cases (scope `cases`)
scopeYesWhich cases to include
caseIdsNoCase IDs to include (scope `cases`)
testRunYesTitle of the test run
assignToYesUser key to assign the run to (see get_test_run_metadata)
moduleKeysNoModule keys to include (scope `modules`)
projectKeyYesProject key
milestoneKeyYesRelease (milestone) key to attach the run to
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries the transparency burden and does state the mutation effect: creating a test run and selecting test cases by scope. However, it does not disclose return behavior, output format, permissions, idempotency, or error conditions, leaving notable gaps.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is compact and well-structured: one clear purpose sentence followed by a minimal checklist of scope behaviors. Every line adds meaningful value and the central scope logic is front-loaded.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the nine parameters and lack of annotations, the description plus schema make a basic invocation constructible. However, with no output schema and no annotations, the description omits expected return values, prerequisites, and alternative-tool routing, which are important for full completeness.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the baseline is 3. The description adds explicit dependency mapping beyond the schema by clarifying that caseIds are required for scope=cases and moduleKeys plus an optional mode are required for scope=modules, which helps construct valid requests.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description opens with 'Create a test run in a project', naming a specific action and resource, then clarifies the three scope modes. This clearly distinguishes it from siblings like create_test_case and clone_test_run.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The scope bullet list gives useful guidance on when to use each scope option, such as caseIds for scope=cases and moduleKeys for scope=modules. However, it never names alternatives or exclusion conditions, so an agent must infer how this tool relates to clone_test_run or create_test_case.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Install Server

Other Tools

Latest Blog Posts

MCP directory API

We provide all the information about MCP servers via our MCP API.

curl -X GET 'https://glama.ai/api/mcp/v1/servers/Darshitpipariya/qa-touch-mcp'

If you have feedback or need assistance with the MCP directory API, please join our Discord server