score_solution
Evaluate solution performance against consistency checks by providing objective scores between 0.0 and 1.0 with optional reasoning.
Instructions
Score a solution against a specific consistency check.
Use this tool to evaluate how well a solution performs against each consistency check. Scores should be between 0.0 (poor) and 1.0 (excellent).
The LLM should evaluate the solution content against the consistency check description and provide an objective score.
Input Schema
TableJSON Schema
| Name | Required | Description | Default |
|---|---|---|---|
| solutionId | Yes | ID of the solution to score | |
| checkId | Yes | ID of the consistency check to evaluate against | |
| score | Yes | Score between 0.0 and 1.0 | |
| reasoning | No | Optional explanation of the scoring rationale |