Skip to main content
Glama

Update Eval Rubric

updateEvalRubric
Destructive

Edit a single Agent-specific evaluation rubric's title and/or description. The edit produces a NEW rubric (with a new id and slug) so previously scored Runs stay attributed to the original criterion; the response contains the new rubric.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
titleNoShort, human-readable Pass/Fail rubric title.
agentIdYesThe agent's unique identifier (Assignment ID)
rubricIdYesThe custom rubric's unique identifier
descriptionNoA 1-2 sentence Pass condition phrased as a question.
selected_automation_revision_idNoThe automation revision this edit is being made at. Pass a draft and the edit is folded into that draft itself; pass the active revision and the edit lands on a draft branched from it. A historic revision is rejected — it cannot be activated from without an explicit rebase. A revision belonging to a different automation is ignored, and the edit targets the automation the addressed agent belongs to. Omit to target the automation's active revision.

Schema Changelog

Changes observed during successful MCP inspections.

  1. First observed

TDQS

A3.7/5.0
Behavior5/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The description goes well beyond the annotations by disclosing the critical non-obvious behavior: the edit creates a NEW rubric with a new id and slug, previously scored Runs remain attributed to the original criterion, and the response contains the new rubric. This is exactly the kind of behavioral nuance an agent needs and complements the destructiveHint annotation without contradicting it.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, well-structured sentence. It front-loads the core action and then efficiently explains the most important consequences: new id/slug, preservation of past Run attribution, and the response containing the new rubric. There is no redundant or filler content.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the lack of an output schema, the description does a good job of noting that the response contains the new rubric and explaining the versioning side effect. Combined with the fully documented schema, the agent has enough context to invoke the tool. It falls slightly short of complete because it does not summarize the selected_automation_revision_id draft/active behavior, though the schema covers it.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so all parameters are already well documented, including the complex selected_automation_revision_id behavior. The description mentions title and/or description at a high level but does not add new parameter meaning beyond what the schema already provides, so the baseline score of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action: edit a single Agent-specific evaluation rubric's title and/or description. It identifies the resource and the fields affected, so an agent can understand what the tool does. However, it does not explicitly differentiate this tool from related siblings such as createEvalRubric, replaceEvalRubrics, or updateCaseQueueEvalRubric.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies the tool is for editing an existing rubric, but it gives no explicit guidance on when to use it versus creating, replacing, or deleting a rubric. No exclusions, prerequisites, or alternative tool mentions are provided, leaving the agent to infer appropriate usage from the tool name and context.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.

Resources