Skip to main content
Glama

ensemble_compare

Compare ensemble or selected result artifacts by metric and report date to rank cases, identify differences, and allow partial comparisons when some cases fail.

Instructions

ensemble_compare

Tool call template

Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.

{
  "id": 1,
  "jsonrpc": "2.0",
  "method": "tools/call",
  "params": {
    "arguments": {
      "request": "<request>"
    },
    "name": "ensemble_compare"
  }
}

Input Schema

NameRequiredDescriptionDefault
requestYesTool arguments object (all fields documented; Z is positive upward).

Schema Changelog

Changes observed during successful MCP inspections.

  1. First observedv0.1.0

TDQS

D1.5/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already disclose readOnlyHint=false, idempotentHint=false and destructiveHint=false, which tells the agent this is a mutating, non-repeatable operation. The description adds nothing beyond that – notably it never says a comparison job is created and how its handle is returned, which matters for a non-idempotent tool (the schema's idempotency_key hints at job creation but the description never confirms it).

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness1/5

Is the description appropriately sized, front-loaded, and free of redundancy?

A single word that merely repeats the tool name – under-specification rather than conciseness. Nothing is front-loaded because nothing is stated.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness1/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

This is a complex nested-schema tool with mutual exclusivity between results and ensemble, an execution policy block, and no output schema, yet the description explains none of it. For a comparison-job tool with non-idempotent behavior, the one-word description leaves the agent unprepared to call it correctly.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%: the nested 'request' object documents dates, metric, results/ensemble mutual exclusivity, execution policy and idempotency_key in detail. Per the baseline rule, a fully documented schema supports a 3 even though the description contributes nothing about parameters.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose1/5

Does the description clearly state what the tool does and how it differs from similar tools?

Tautological: description restates name/title.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines1/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

There is no when-to-use guidance, no prerequisites, and no pointer to alternatives despite five-plus sibling tools that overlap in the ensemble/compare space. An agent must infer everything from the schema alone.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.