Skip to main content
Glama

compare

Read-onlyIdempotent

Run 2-10 named scenarios side by side to identify the highest expected value option, with each scenario's deltas versus the best one.

Instructions

Run 2-10 named scenarios side by side and return the winner plus each scenario's deltas versus the best one. The winner is the scenario with the highest expected value; every entry reports its recommended_action, expected_value, probability_of_loss, and delta_vs_best. Each scenario's request uses the simulate payload shape; runs and seed are forwarded for reproducibility. Use recommend for a ranked recommendation over actions instead. Synchronous deterministic compute; nothing is persisted.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
runsNoScenario count per simulation; forwarded to each run.
seedNoSimulation seed for reproducible results.
scenariosYesNamed scenarios, each {name, request} with request in the simulate payload shape; 2-10 items.

Schema Changelog

Changes observed during successful MCP inspections.

  1. Changed3 schema fields changedv0.1.3
    • addedInput schema / properties / runs / description
      Added value: +"Scenario count per simulation; forwarded to each run."
    • changedInput schema / properties / scenarios / description
      Previous value: -"Named scenarios forwarded to POST /v1/compare."New value: +"Named scenarios, each {name, request} with request in the simulate payload shape; 2-10 items."
    • addedInput schema / properties / seed / description
      Added value: +"Simulation seed for reproducible results."
  2. First observedv0.1.0

TDQS

A4.5/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true, idempotentHint=true, and destructiveHint=false, covering safety. The description adds meaningful behavioral context: 'Synchronous deterministic compute; nothing is persisted.' This goes beyond annotations by specifying the execution model (synchronous, deterministic) and persistence behavior. It also mentions that runs and seed are forwarded for reproducibility, which is useful. No contradiction with annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is three sentences, each earning its place: the first states the core function and output, the second details the winner criterion and per-entry fields, and the third gives the alternative and behavior. Information is front-loaded (main purpose first) with no filler. It is appropriately sized for the tool's complexity.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a tool with 3 parameters, full schema coverage, and annotations that already cover safety, the description is complete. It explains the output structure (recommended_action, expected_value, probability_of_loss, delta_vs_best), the winner criterion (highest expected value), the request shape (simulate payload), and the usage alternative. There is no output schema, but the description sufficiently describes return fields. Nothing an agent needs to call it correctly is missing.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100% – all three parameters (runs, seed, scenarios) have descriptions in the schema. The description adds little new parameter meaning beyond reiterating that runs and seed are forwarded and that scenarios use the simulate payload shape, both already stated in the schema. Since the schema already documents parameters well, the baseline of 3 applies; the description doesn't compensate beyond that.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description opens with a specific verb and resource: 'Run 2-10 named scenarios side by side and return the winner plus each scenario's deltas versus the best one.' It clearly states the output (winner and per-scenario deltas) and distinguishes itself from the sibling recommend by explicitly naming it as the alternative for ranked recommendations. This is precise and unambiguous.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines5/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description explicitly tells the agent when NOT to use this tool: 'Use recommend for a ranked recommendation over actions instead.' This is a clear exclusion with a named alternative. It also implies the primary use case (comparing 2-10 scenarios) without leaving the decision to inference. The guidance is direct and actionable.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Deploy Server

Other Tools