test_prompt
Start a test of one prompt across several models. Spends credit, never more than max_spend_usd by estimate. Returns at once with a test_id: call get_test for the results. Cases and checks are drafted if left out.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| name | No | A short name, like Support triage. | |
| cases | No | Realistic inputs, up to 12. | |
| checks | No | Yes/no statements a good answer meets. | |
| models | No | Model IDs from list_models, up to 6. Default: a starting mix. | |
| prompt | Yes | The user prompt, with {{variables}}. | |
| system | No | The system prompt, if any. | |
| max_spend_usd | No | Limit for this test. Default 1. Models are left out, dearest first, to fit. |