lbb_reviews
Retrieve read-only review questions from workflows, agents, and people, including details and grouped patterns, to support human-in-the-loop decisions.
Instructions
Review items, read only: questions for a person (human in the loop) that workflows, integrations, agents and people file. Kinds and their decisions: change (accept an ontology change, identities or facts: accept, reject, cant_tell), value (confirm one value of a property, question.property and question.value: accept, correct with the right value, reject, cant_tell; accept and correct commit the value), choice (pick one of question.options: choose with option, cant_tell), grade (grade question.output on the scale question.options: choose with option, cant_tell), answer (answer question.prompt in words: accept with the text in note, cant_tell). Status is open, answered or withdrawn. Scope is live (default) or test: a test item writes nothing. list returns one page as the server sends it ({object, data, has_more, next_cursor}), the latest update first: pass next_cursor as cursor, with the same filters, for the next page. get reads one item (rev_…) with its question, evidence, answer and effects. patterns groups the live items that ask one decision, the largest first. Evals files the questions of model checks (origin_id evals:checks), calibration sessions (evals:calibration), golden queries (evals:golden) and the values the two arms of an experiment differ on (evals:datasets) as grade and choice items; eval_id keeps the items of one record (for evals:datasets, the dataset), and their answer is the record's label. An item of evals:datasets asks whether one value is right or wrong, and the origin names the dataset item, the property and the value. File, answer, comment on or withdraw items with lbb_reviews_manage.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| id | No | get: the item's id, rev_… (or the sg_… of a change). | |
| key | No | list: the items filed under this producer key, or these keys (at most 100). | |
| run | No | list: the items of the run that asked. | |
| kind | No | list: one kind, or a list of kinds. | |
| type | No | patterns: only the patterns of this kind of suggestion. | |
| graph | No | Graph to target; defaults to the connection's graph | |
| limit | No | list: items per page, at most 5, 20 or 100 by detail (compact, standard, full) and by default that many, so the page comes back whole. | |
| scope | No | list: live (the default) or test. | |
| action | Yes | ||
| cursor | No | list: the next_cursor of the page before. | |
| detail | No | Response detail level. Defaults to compact. | |
| status | No | list, patterns: only the items in this state. | |
| eval_id | No | list, patterns: the items Evals filed for one record (eval.id): a calibration session, a model call's check, a golden, a dataset. | |
| workflow | No | list: the items of the workflow that asked. | |
| origin_id | No | list, patterns: the producer's id, for example starter:areas. |