Create run
create_runLaunch an evaluation run for a specific agent, persona, and test set, with optional tags to filter results and configuration for iterations and concurrency.
Instructions
Launch an evaluation for an agent, persona, and test set. Optional tags support result filtering.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"agent_id": "<agent_id>",
"persona_id": "<persona_id>",
"test_set_id": "<test_set_id>"
},
"name": "create_run"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| tags | No | Tags for categorizing and filtering the run (max 20 tags, 200 chars each). | |
| options | No | Run configuration options | |
| agent_id | Yes | The unique ID of the agent to evaluate. | |
| metadata | No | Custom metadata for tracking purposes | |
| metric_ids | No | Optional list of metric IDs to evaluate. Uses agent defaults if omitted. | |
| persona_id | Yes | The unique ID of the persona to use. | |
| test_set_id | Yes | The unique ID of the test set to run against. |