Skip to main content
Glama

AI Blocks

Register or close an experiment

record_outcome_experiment
Read-onlyIdempotent

Register a test before it goes live (action register: change, metric, baseline, window, minimum volume, guardrails), then close it (action close: observed, volume, guardrail results, verdict). Low volume forces INCONCLUSIVE; a broken guardrail is never a WIN. Returns a line for experiments.jsonl, a learning candidate and an anonymised outcome report the owner may choose to share.

Input Schema

NameRequiredDescriptionDefault
engagementYesThe complete engagement.json from the last outcome tool result, unchanged.
experimentYesregister before the change goes live; close with what was observed.
engagement_sha256Yesengagement_sha256 from the last outcome tool result. A different value means the engagement changed.

Output Schema

NameRequiredDescriptionDefault
schemaYes

Schema Changelog

Changes observed during successful MCP inspections.

  1. First observed

TDQS

A3.9/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Beyond the annotations, the description discloses validation rules that materially change how results must be interpreted ("Low volume forces INCONCLUSIVE; a broken guardrail is never a WIN") and enumerates outputs: an experiments.jsonl line, a learning candidate, and an anonymised report the owner may choose to share, implying no automatic disclosure. The one gap is that "Returns a line for experiments.jsonl" plus "Register/close" reads like state mutation while readOnlyHint=true, so the agent is left to infer that nothing is persisted server-side.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two sentences, front-loaded with the two actions, then the invariant rules, then the returns—a sensible ordering with no filler. The parenthetical field enumerations partly duplicate schema content and add density, keeping it from a 5.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a nested oneOf tool with an output schema, the description covers the decision-relevant essentials: both modes, the two outcome rules, and the shape of what comes back. The remaining ambiguity is whether the experiments.jsonl line is written or merely returned, which matters given readOnlyHint=true and would be worth one clarifying clause.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100% and the schema itself documents engagement, engagement_sha256 (hash-mismatch meaning) and the register/close oneOf branch. The description's field lists restate what the schema already requires per action rather than adding format, ordering, or precedence rules (e.g. what direction or target default to). Baseline 3 is appropriate when structured fields carry the semantics.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states a concrete verb and resource and splits the tool into two named modes ("action register" with change, metric, baseline, window, min volume, guardrails; "action close" with observed, volume, guardrail results, verdict), so an agent knows exactly what can be recorded. It does not name or distinguish the close-relative siblings such as read_back_outcome_experiment or record_outcome_decision, so a 4 rather than a 5.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

"Register a test before it goes live ... then close it" gives explicit lifecycle sequencing: register first, close when observations exist, with the action const in the schema binding each mode. There is no statement of when-not to use this tool or which sibling to choose for adjacent tasks (e.g. recording a decision), so it falls short of full alternative routing.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.

Resources