evaluate_prompt
Evaluates structured prompt summaries to detect learnable moments. Auto-logs high-confidence signals and suggests improvements for medium-confidence ones.
Instructions
Evaluate a structured prompt summary for learnable moments. Runs heuristic detectors on the summary, auto-logs high-confidence signals, and returns suggestions for medium-confidence ones.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"step": "<step>",
"prompt_type": "<prompt_type>",
"outcome": "<outcome>",
"components": "<components>",
"files_touched": "<files_touched>"
},
"name": "evaluate_prompt"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| step | Yes | Current plan step number | |
| text | No | Salient gist of the interaction | |
| outcome | Yes | Outcome category of the prompt/response cycle | |
| components | Yes | Components involved in the interaction | |
| error_text | No | Error message if outcome is bug_fixed (optional) | |
| prompt_type | Yes | Who issued the prompt being evaluated | |
| files_touched | Yes | Files modified or discussed | |
| rejected_action | No | What the human said not to do | |
| corrected_action | No | What the human said to do instead |