lbb_model_choice
Model choice, read only: which model each use of a model on the graph runs, and trials that test other models against the graph's ground truth (the checked calls: a person's review, else the judge's verdict).
Instructions
Model choice, read only: which model each use of a model on the graph runs, and trials that test other models against the graph's ground truth (the checked calls: a person's review, else the judge's verdict). options shows per use the model it runs now (current), LBB's model (default), a switch (switched), its checked calls, and the models a trial can test with their efforts, prices and whether the server holds their key; available=false with a reason when trials cannot run. trials lists the trials, newest first, each with its report: calls compared, both models' right share, mean score (0 to 1), cost per call and median time, the difference with its 95% interval (delta, ci_low, ci_high), outcome (too_few, better, same, worse) and qualifies (meets the bar: at least 20 calls, at most 5 points worse at the low end, no more failures, cheaper or better). trial reads one trial with its compared calls; trial_call reads one call with both answers and the ground truth. switches lists the switched uses. Start, stop, switch or revert with lbb_model_choice_manage.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| job | No | trials: only the trials of this use. | |
| graph | No | Graph to target; defaults to the connection's graph | |
| limit | No | trials: at most this many, newest first (default 20). | |
| action | Yes | ||
| detail | No | Response detail level. Defaults to compact. | |
| call_id | No | trial_call: a call id from the trial's calls. | |
| trial_id | No | trial / trial_call: the trial id. |