Skip to main content
Glama

abtests_update

Destructive

Edit a test (config is draft-only), set autonomy (owner/admin) or dismiss a proactive suggestion.

Tool call template

Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.

{
  "id": 1,
  "jsonrpc": "2.0",
  "method": "tools/call",
  "params": {
    "arguments": {
      "workspace": "<workspace>",
      "action": "<action>",
      "idempotency_key": "<idempotency_key>"
    },
    "name": "abtests_update"
  }
}

Input Schema

NameRequiredDescriptionDefault
goalNo
modeNo
nameNo
testNo
actionYes
autonomyNo
workspaceYes
hypothesisNo
suggestionNo
traffic_splitNo
stop_conditionNo
idempotency_keyYes

Schema Changelog

Changes observed during successful MCP inspections.

  1. First observed

TDQS

B3.1/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare destructiveHint=true and readOnlyHint=false, and the description usefully adds the draft-only precondition plus an owner/admin authorization requirement. It does not disclose what the destructive outcome actually is (e.g., overwritten config, discarded draft, irreversible dismissal), which is the key unknown for a destructive tool.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

A single front-loaded sentence with no filler, and the draft-only caveat is placed inline where it matters. The parenthetical stacking makes it dense but nothing is wasted.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a destructive 12-parameter tool with nested objects, enums, and no output schema, one sentence is far too thin. The agent gets no mapping from action values to which parameter subsets are required, which is essential given three distinct modes in one tool.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0% across 12 parameters, so the description carries the full burden and largely fails. It hints at the action/autonomy/suggestion fields but says nothing about traffic_split, stop_condition, goal, hypothesis, mode, test, or idempotency_key, leaving most of the contract undocumented.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

States three concrete operations (edit test config, set autonomy, dismiss suggestion) against a named resource, which is specific enough to distinguish it from abtests_create/get/list. It does not explicitly contrast with abtests_set_status, the closest sibling, so the boundary remains partly inferred.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Adds two real usage constraints: config edits are draft-only and set_autonomy requires owner/admin. However, it never says when to pick this over abtests_set_status for state changes or abtests_prepare before editing, and the action enum values are not explained as selection criteria.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.

Resources