Skip to main content
Glama

Replace Case Queue Eval Rubrics

replaceCaseQueueEvalRubrics
Destructive

Replace the entire case-level evaluation rubric set on a queue's current version (1 to N rubrics, N being 12 by default and 25 on teams with the newer rubric generator enabled). Existing rubrics are removed and the supplied list becomes the new set. An empty list is refused — whole-case evaluation regenerates rubrics for an empty set at the next settlement, so a cleared set would not stay cleared; remove individual rubrics instead. Targets the queue's current version (build-set), which exists once its first Agent-processed case settles — this fails with 409 before then. Cases already judged keep their original verdicts.

Input Schema

NameRequiredDescriptionDefault
rubricsYesThe complete case-level rubric set for the queue's current version (at least 1 rubric). Replaces every existing rubric.
queue_idYesThe queue's unique identifier

Schema Changelog

Changes observed during successful MCP inspections.

  1. Changed1 schema field changed
    • changedInput schema / properties / rubrics / maxItems
      Previous value: -12New value: +25
  2. Added

TDQS

A4.9/5.0
Behavior5/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already flag destructiveHint=true, readOnlyHint=false and idempotentHint=false, but the description adds what the annotations cannot: existing rubrics are removed and replaced, why an empty list is rejected (regeneration at settlement), and that already-judged cases keep their verdicts. This is rich, non-duplicative behavioral context.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Front-loaded with the core action, then the destructive consequence, then the empty-list caveat, then the version precondition. Every sentence carries a distinct piece of operational information; none is filler.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a destructive mutation tool with no output schema, the description covers the mutation semantics, failure modes (409, empty-list refusal), limits, and side effects on already-judged cases. Nothing an agent needs to call it safely is missing.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% and both parameters are documented in the schema, so much of the value is already structured. The description nevertheless adds meaning beyond the schema: the effective rubric count range (1 to 12 by default, 25 with the newer generator) and the semantics of 'empty list' for the rubrics array.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

States a specific verb and resource: replacing the entire case-level rubric set on a queue's current version. The scope ('entire set', 'current version / build-set') clearly separates it from the sibling create/update/delete single-rubric tools and from replaceEvalRubrics at the non-case level.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines5/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

It gives the when-to-use (whole-set replacement), an explicit when-not with an alternative action ('An empty list is refused... remove individual rubrics instead'), and a precondition for use ('fails with 409 before its first Agent-processed case settles'). Routing is fully inferable without opening another schema.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.

Resources