llm_judge_run
Run an LLM-as-a-judge template against a tenant workflow execution and persist its annotations.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"templateId": "<templateId>",
"executionId": "<executionId>"
},
"name": "llm_judge_run"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| stepId | No | Optional workflow step UUID | |
| templateId | Yes | Evaluation template UUID | |
| executionId | Yes | Workflow execution UUID |