Create rubric
create_rubricStore a reusable scoring rubric and return its ID for later evaluation runs, including criteria, weights, scales, aggregation, gates, grades, and pass thresholds.
Instructions
Store a rubric and get back its id for reuse. Criteria need id/name; optional weight, scale, anchors (= rubric levels for decision models), judge ({type: decision|human|benchmark|llm|panel}; default decision/typesafe). Aggregation supports weighted_mean, weighted_sum, mean, median, min, max, geometric_mean, formula; gates; grades; passThreshold.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"rubric": "<rubric>"
},
"name": "create_rubric"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| rubric | Yes |