ouroboros_evaluate
Evaluate an execution session's output against acceptance criteria using a three-stage pipeline: mechanical checks, semantic compliance, and optional multi-model consensus.
Instructions
Evaluate an Ouroboros execution session using the three-stage evaluation pipeline. Stage 1 performs mechanical verification (lint, build, test). Stage 2 performs semantic evaluation of AC compliance and goal alignment. Stage 3 runs multi-model consensus if triggered by uncertainty or manual request.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| artifact | Yes | The execution output/artifact to evaluate | |
| session_id | Yes | The execution session ID to evaluate | |
| working_dir | No | Project root used to resolve Stage 1 mechanical verification commands and Stage 2 source-file visibility. Commands are read from .ouroboros/mechanical.toml; when the file is missing, the evaluator makes one AI detect call that inspects manifests (package.json, pyproject.toml, Cargo.toml, Makefile, ...) and authors the toml. Stage 1 skips every check when no toml is produced — it never guesses. | |
| seed_content | No | Original seed YAML for goal/constraints extraction | |
| artifact_type | No | Type of artifact: code, docs, config. Default: code | code |
| trigger_consensus | No | Force Stage 3 consensus evaluation. Default: False | |
| acceptance_criteria | No | Multiple acceptance criteria for checklist evaluation. When two or more items are provided, each AC is evaluated independently and the results are aggregated into a pass/fail checklist (#366). Overrides acceptance_criterion. | |
| acceptance_criterion | No | Specific acceptance criterion to evaluate against |