Skip to main content
Glama

compare

Read-onlyIdempotent

Run 2-10 named scenarios side by side to identify the winner by expected value and see each scenario's delta versus the best.

Instructions

Run 2-10 named scenarios side by side and return the winner plus each scenario's deltas versus the best one. The winner is the scenario with the highest expected value; every entry reports its recommended_action, expected_value, probability_of_loss, and delta_vs_best. Each scenario's request uses the simulate payload shape; runs and seed are forwarded for reproducibility. Use recommend for a ranked recommendation over actions instead. Synchronous deterministic compute; nothing is persisted. Which to use: 2-10 named scenarios evaluated side by side with the winner by expected value; use recommend for a ranked pick with rationale, or simulate for one scenario.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
runsNoScenario count per simulation; forwarded to each run.
seedNoSimulation seed for reproducible results.
scenariosYesNamed scenarios, each {name, request} with request in the simulate payload shape; 2-10 items.

Schema Changelog

Changes observed during successful MCP inspections.

  1. Changed3 schema fields changedv0.1.3
    • addedInput schema / properties / runs / description
      Added value: +"Scenario count per simulation; forwarded to each run."
    • changedInput schema / properties / scenarios / description
      Previous value: -"Named scenarios forwarded to POST /v1/compare."New value: +"Named scenarios, each {name, request} with request in the simulate payload shape; 2-10 items."
    • addedInput schema / properties / seed / description
      Added value: +"Simulation seed for reproducible results."
  2. First observedv0.1.0

TDQS

A4.5/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true, idempotentHint=true, and destructiveHint=false, covering safety. The description adds valuable behavior beyond annotations: 'Synchronous deterministic compute; nothing is persisted' and that runs/seed are forwarded. It doesn't discuss auth/error cases, but annotations lower the burden and the added context is meaningful.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is front-loaded with the core purpose and then provides behavioral, parameter, and sibling-routing details. There is some redundancy between the early 'Use recommend...' sentence and the final 'Which to use...' sentence, but each sentence still adds information (the final one explicitly mentions simulate as an alternative), so it remains efficient.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

There is no output schema, so the description compensates by naming the returned fields ('recommended_action, expected_value, probability_of_loss, and delta_vs_best') and the winner rule. It covers input constraints, reproducibility, and side effects. Small gaps remain around error behavior and exact response shape, but the tool is simple enough that the description is largely complete.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so the baseline is 3. The description adds meaning beyond the schema by stating that 'Each scenario's request uses the simulate payload shape' and that 'runs and seed are forwarded for reproducibility', which clarifies how parameters relate to the simulation and to sibling tools.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description uses a specific verb and resource ('Run 2-10 named scenarios side by side') and clearly states the output ('winner plus each scenario's deltas versus the best one'). It also names sibling tools explicitly ('use recommend...', 'simulate for one scenario'), so an agent can distinguish compare from recommend and simulate.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines5/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description gives explicit when-to-use guidance: '2-10 named scenarios evaluated side by side with the winner by expected value'. It also provides alternatives and exclusions: 'use recommend for a ranked pick with rationale, or simulate for one scenario'.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Deploy Server

Other Tools