Update test case
update_test_caseUpdate a synthetic evaluation test case's scenario, expected behaviors, description, or script turns to keep test coverage accurate. Modify specific fields by test case ID without recreating the case.
Instructions
Update the scenario, expected behaviors, description, or script turns of one synthetic evaluation test case. To change turns, prefer the top-level script_turns field (server-side merge); simulation_metadata_input replaces the stored object wholesale.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"test_case_id": "<test_case_id>"
},
"name": "update_test_case"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| input_str | No | Updated test input or scenario. | |
| input_type | No | Updated input type. Switching away from SCRIPT clears stored script_turns. | |
| user_notes | No | Updated internal notes. | |
| description | No | Updated description. | |
| metric_input | No | Updated metric inputs. | |
| script_turns | No | Replacement turn list, merged into stored simulation metadata server-side (sibling keys preserved). Preferred over simulation_metadata_input for turn edits. Entries: plain strings the persona speaks verbatim, or typed keypad presses {"type": "dtmf", "digits": "1"} (digits allow 0-9, *, # plus phone punctuation for full numbers). Never write DTMF as spoken text like "dtmf:1". When sent together with simulation_metadata_input, that object is replaced first and these turns are then merged into the result, so this field always wins for the script_turns key. | |
| test_case_id | Yes | The unique ID of the test case to update. | |
| expected_behaviors | No | Updated list of expected agent behaviors. | |
| simulation_metadata_input | No | Updated simulation context. Replaces the stored object wholesale — include every key you want to keep. Prefer the top-level script_turns field for turn edits; if both are sent, this object is replaced first and script_turns is merged into the result. For scripted (input_type SCRIPT) cases you may set {"script_turns": [...]} here instead: entries are plain strings the persona speaks verbatim, or typed keypad presses {"type": "dtmf", "digits": "1"} (digits allow 0-9, *, # plus phone punctuation for full numbers). Never write DTMF as spoken text like "dtmf:1" — it would be read aloud. For SCENARIO cases against IVRs, instead instruct the persona in input_str to use its dtmf_tool for each keypress. |