commit_evaluator
Commit a tested evaluator draft to create a read-only version, enabling subsequent pipeline creation for UI rendering.
Instructions
Commit the current draft of a grader, creating a new read-only version.
IMPORTANT: Only commit AFTER a successful test_evaluator run. After committing, use create_evaluation_pipeline to wrap the grader in a V2 pipeline that renders in the UI.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"evaluator_id": "<evaluator_id>"
},
"name": "commit_evaluator"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| evaluator_id | Yes | Evaluator ID to commit. | |
| version_description | No | Commit message describing what changed in this version. |