Run an LLM cutover audit
run_cutover_auditMeasures how often a cheaper model (Sage 2) agrees with your current LLM on your samples, the confidence threshold for routing, and the monthly cost now vs a hybrid. Returns the full report as JSON.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| mode | Yes | yesno: a yes/no decision per text. extract: fields pulled out of each text. | |
| usage | No | ||
| fields | No | extract only. Up to 12 fields: {"name": {"type": "string|number|integer|boolean|date|money", "definition": "..."}} | |
| target | No | Agreement you need on the calls the cheap model keeps. | |
| current | Yes | Your current model: {"model": "<id from GET /api/models>", "effort": "<level>"} or custom prices {"in": USD per 1M input tokens, "out": USD per 1M output tokens}. | |
| samples | Yes | Real inputs with the answer your CURRENT model gave. Array of objects or a JSONL/CSV string. yesno: {"text","label":"yes|no"}; extract: {"text","expected":{...}}. Each text ≤ 4000 chars. Min 5. Max 10 anonymous, 25 free on the website, 500 yesno / 200 extract with a pass. | |
| question | No | yesno only. The yes/no question your current model answers, e.g. "Is this ticket about billing?" |