evaluate_prompt
Evaluates structured prompt summaries to detect learnable moments. Auto-logs high-confidence signals and suggests improvements for medium-confidence ones.
Instructions
Evaluate a structured prompt summary for learnable moments. Runs heuristic detectors on the summary, auto-logs high-confidence signals, and returns suggestions for medium-confidence ones.
Input Schema
TableJSON Schema
| Name | Required | Description | Default |
|---|---|---|---|
| step | Yes | Current plan step number | |
| text | No | Salient gist of the interaction | |
| outcome | Yes | Outcome category of the prompt/response cycle | |
| components | Yes | Components involved in the interaction | |
| error_text | No | Error message if outcome is bug_fixed (optional) | |
| prompt_type | Yes | Who issued the prompt being evaluated | |
| files_touched | Yes | Files modified or discussed | |
| rejected_action | No | What the human said not to do | |
| corrected_action | No | What the human said to do instead |