Create Eval Rubric
createEvalRubricAdd one Agent-specific evaluation rubric to a build. A build may hold at most 5 custom rubrics by default (25 on teams with the newer rubric generator enabled); this fails with 409 once the build's ceiling is reached, and the error message states it. Defaults to the Agent's live build; pass build_id to target a specific revision.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"agentId": "<agentId>",
"title": "<title>",
"description": "<description>"
},
"name": "createEvalRubric"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| title | Yes | Short, human-readable Pass/Fail rubric title. | |
| agentId | Yes | The agent's unique identifier (Assignment ID) | |
| build_id | No | Add the rubric to this build (revision). Defaults to the agent's live build when omitted. | |
| description | Yes | A 1-2 sentence Pass condition phrased as a question. | |
| selected_automation_revision_id | No | The automation revision this edit is being made at. Pass a draft and the edit is folded into that draft itself; pass the active revision and the edit lands on a draft branched from it. A historic revision is rejected — it cannot be activated from without an explicit rebase. A revision belonging to a different automation is ignored, and the edit targets the automation the addressed agent belongs to. Omit to target the automation's active revision. |