Get REPS Baseline Material
get_reps_baselineRead-onlyIdempotent
Discover and fetch REPS agent-evaluation baseline material—scenario banks, drivers, checks, and eval configs—for assessing AI agents across reasoning, execution, performance, and security.
Instructions
Serve REPS agent-evaluation baseline material (scenario banks, drivers, checks, eval configs).
REPS is Okareo's agent-evaluation workbench: per-pillar baseline
material for evaluating AI agents across R-reasoning, E-execution,
P-performance, and S-security, plus shared explore/ probes and a
profile/ example. The material is published as tagged releases of
the okareo-tools repo; this tool serves the latest release so reps
skills need no local copy of the tree.
Two modes:
- Discovery (omit `path`): list what files exist in the served
release — the full tree, or one area via `pillar`. File lists
change between releases, so always discover before fetching.
- Fetch (provide `path`): return one file's exact content as
published in the release. Use paths verbatim from discovery,
e.g. 'S-security/scenarios/verification-gate.jsonl'.
Every response carries the release tag it was served from (e.g.
'v0.5.1') — record it in evaluation reports as baseline
provenance. `stale: true` means the last release check failed and
the content may lag the newest release.
Args:
pillar: Optional discovery filter. One of: R-reasoning,
E-execution, P-performance, S-security, explore, profile.
Omit to list the entire baseline tree (which also includes
shared material outside these areas).
path: Optional file path (relative to the baseline tree, as
returned by discovery). Provide to fetch that file's
content; omit for discovery.
version: Optional release tag. Currently only the served tag
is available; any other value returns an error naming what
IS available. Omit to accept the served release.
Input Schema
TableJSON Schema
| Name | Required | Description | Default |
|---|---|---|---|
| path | No | ||
| pillar | No | ||
| version | No |
Output Schema
TableJSON Schema
| Name | Required | Description | Default |
|---|---|---|---|
| result | Yes |