Skip to main content
Glama

Update custom benchmark

update_custom_benchmark
Destructive

Add/remove members or rename a custom benchmark. Creates a NEW immutable version (the previous version stays fully reproducible) and returns the exact change-impact on the median/quartiles/index. Pass benchmark_id.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
addNo
removeNo
renameNo
benchmark_idYesYour cb_ token

Schema Changelog

Changes observed during successful MCP inspections.

  1. Added

TDQS

A4.2/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare the mutation profile (readOnly=false, destructive=true, idempotent=false), and the description adds genuinely non-obvious behavior: a NEW immutable version is created, the previous version remains fully reproducible, and the response reports change-impact on median/quartiles/index. It does not, however, mention authorization requirements or failure modes (e.g., invalid member ids).

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Three short sentences, each carrying distinct information (operation, side-effect semantics, return content, required param), with the core action front-loaded. No filler.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With no output schema, the description usefully describes the return value and the versioning side effect, and it flags the required argument. It is nearly complete for a 4-param mutation tool, lacking only error/permission behavior.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is only 25% (just benchmark_id), so the description must compensate; it maps the three intent parameters to their purpose (add/remove members, rename) and explicitly says to pass benchmark_id. The remaining gap is value format — it never says whether add/remove take member ids, names, or tokens.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

States specific verbs (add/remove members, rename) on a specific resource (a custom benchmark), and its immutability/versioning framing clearly distinguishes it from create_custom_benchmark, get_custom_benchmark, and delete_custom_benchmark without the agent needing to open any schema.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Usage is implied rather than stated: requiring `benchmark_id` signals this operates on an existing benchmark (not creation), but there is no explicit when-to-use, when-not-to-use, or named alternative for editing vs. recreating vs. deleting. The agent can infer the niche but is not routed.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.

Resources