Skip to main content
Glama

ReliaSim

Show Gain and Loss results

run_gain_loss
Read-onlyIdempotent

Gain/Loss experiment — disable each interrupt one at a time, measure production recovered. Reveals the ACTUAL impact of each failure mode (Gain ≠ Loss: removing one lets others fire more often). Available on bs1-leds, bs3-leds, bs4-ct, bs4-leds. Use when the user asks 'what if we fixed X?' / 'which interrupt matters most if we actually fixed it?' / 'show me the Pareto'. ANTI-FABRICATION: per-interrupt recovered-production numbers come from real ReliaSim engine runs. Quote VERBATIM; the Gain ≠ Loss interaction is exactly the kind of figure LLMs are prone to fabricate — don't.

Tool call template

This tool declares no required parameters. Add optional parameters from the input schema as needed.

{
  "id": 1,
  "jsonrpc": "2.0",
  "method": "tools/call",
  "params": {
    "arguments": {},
    "name": "run_gain_loss"
  }
}

Input Schema

NameRequiredDescriptionDefault
chapterNoWhich curriculum chapter the tool should answer about. Format: `bs<1-5>-<ct|leds>`. Both tracks run on the same real plant data — `ct` = Constraint-Level (interrupts rolled up to one Weibull per machine, 5 total) and `leds` = LEDS-Level (interrupts drilled down to named failure modes, 36 total). Defaults to bs1-ct when omitted.bs1-ct

Schema Changelog

Changes observed during successful MCP inspections.

  1. Changed1 schema field changed
    • changedInput schema / properties / chapter / enum
      Previous value: -[
      -  "bs1-ct",
      -  "bs2-ct",
      -  "bs3-ct",
      -  "bs4-ct",
      -  "bs1-leds",
      -  "bs2-leds",
      -  "bs3-leds",
      -  "bs4-leds"
      -]New value: +[
      +  "bs1-ct",
      +  "bs2-ct",
      +  "bs3-ct",
      +  "bs4-ct",
      +  "bs1-leds",
      +  "bs2-leds",
      +  "bs3-leds",
      +  "bs4-leds",
      +  "cmp-buffer-reliability",
      +  "cmp-shared-palletizer"
      +]
  2. First observed

TDQS

A3.6/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint, idempotentHint, destructiveHint=false and closed-world, so the safety profile is covered. The description adds genuinely useful behavior: the Gain ≠ Loss interaction (removing one interrupt lets others fire more often) and the anti-fabrication requirement to quote engine output verbatim. However, its chapter-availability claim ('Available on bs1-leds, bs3-leds, bs4-ct, bs4-leds') conflicts with the schema enum, which accepts all ten chapters, creating a behavioral contradiction about which inputs are valid.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The core mechanism is front-loaded in the first sentence, followed by trigger questions and a targeted anti-fabrication note, all of which earn their place. Some phrasing ('Reveals the ACTUAL impact', the all-caps emphasis) is stylistic padding but does not obscure the use case.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a one-parameter, no-output-schema tool the description conveys enough: what is computed, what the results represent (per-interrupt recovered production), and how to report them. The gap is the unresolved chapter availability mismatch, which could cause an agent to reject valid enum values or call with an unsupported one.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, and the enum description already explains ct vs leds tracks, so the schema does the heavy lifting and baseline 3 applies. The description does not explain the chapter parameter at all, and its narrower availability list disagrees with the enum's ten options, adding ambiguity rather than meaning.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states a concrete verb+resource and the mechanism: 'disable each interrupt one at a time, measure production recovered,' which tells an agent this is a per-failure-mode removal experiment rather than a generic report. It doesn't explicitly name how it differs from sibling tools like find_bottleneck or run_buffer_tradeoff, so differentiation is inferred from the example questions rather than stated.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

It gives three concrete trigger questions ('what if we fixed X?', 'which interrupt matters most if we actually fixed it?', 'show me the Pareto') that clearly delimit when this tool is right. It stops short of naming alternatives or stating when NOT to use it, which is why it isn't a 5.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.

Resources