Skip to main content
Glama

get_suite_test_results

Read-only

Retrieves test points for an Azure DevOps test suite, showing each test case per configuration with tester, last outcome, and summary counts.

Instructions

Test points of a suite: each test case per configuration with tester and last outcome (Passed / Failed / Blocked / NotApplicable / NotRun), plus a summary count.

Tool call template

Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.

{
  "id": 1,
  "jsonrpc": "2.0",
  "method": "tools/call",
  "params": {
    "arguments": {
      "plan_id": "<plan_id>",
      "suite_id": "<suite_id>"
    },
    "name": "get_suite_test_results"
  }
}

Input Schema

NameRequiredDescriptionDefault
plan_idYes
projectNo
suite_idYes

Schema Changelog

Changes observed during successful MCP inspections.

  1. First observedv0.2.0

TDQS

B3/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and destructiveHint=false, so the safety profile is covered. The description adds useful return-content detail (outcome enum values, tester, summary count), but says nothing about pagination, result size, or permissions.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

A single compact sentence that front-loads the resource and enumerates the return fields without filler. Efficient, though the parenthetical outcome list is slightly dense.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With no output schema, the description does carry some of the return-value burden by listing outcomes and the summary count. However, for a tool requiring plan_id and suite_id with zero schema coverage, the missing parameter explanations leave a real gap.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0% and none of the three parameters (plan_id, suite_id, project) are explained in the description. The phrase 'of a suite' loosely implies suite_id, but plan_id and the optional project parameter are left entirely undocumented.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description names a specific resource (test points of a suite) and enumerates the returned content: each test case per configuration, tester, last outcome, and a summary count. It is clear what the tool does, but it does not differentiate itself from siblings such as get_test_case or list_test_suites.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

There is no guidance on when to use this tool versus alternatives like get_test_case or list_test_suites, and no prerequisites or exclusions are stated. The agent must infer usage from the name alone.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.