Run a benchmark
run_benchmarkSave a task (YAML, see get_task_format) to the user's OpenMark account and run it on the given models with real API calls. Returns a job_id; poll get_results. Spends the user's credits.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| models | Yes | Model ids from list_models | |
| task_yaml | Yes | The full task YAML (a JSON object with the same fields also works) | |
| upload_uid | No | From prepare_attachments, when tests use attachments | |
| stability_runs | No | Passes per model; 2+ shows which models are consistent |