Evaluate response quality
evaluate_response_qualityScores a prompt and model reply with a local heuristic rubric, returning JSON quality_score, passed, and criteria without calling a model.
Instructions
Score a prompt and reply with a local heuristic rubric. Does not call a model. Use run_calibration_test to generate replies first. Read-only. Returns JSON with quality_score, passed and criteria.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"prompt": "<prompt>",
"response": "<response>"
},
"name": "evaluate_response_quality"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| prompt | Yes | Original prompt text. | |
| category | No | Rubric category such as general, analysis or coding. Default general. | general |
| response | Yes | Model reply to score. |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| result | Yes |