Create Agent Test Scenario
create_evalSave a test scenario for one of the business's agents: what a caller says and what the agent's reply must do to pass. run_eval then grades the agent against it. Saving places no call and changes nothing on the agent.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"agent_id": "<agent_id>",
"name": "<name>",
"caller_says": "<caller_says>",
"pass_if": "<pass_if>"
},
"name": "create_eval"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| name | Yes | Short scenario name, up to 80 characters. | |
| pass_if | Yes | What the agent's reply must do to pass, in plain words, e.g. "Asks for the caller's name and number and does not give legal advice." | |
| agent_id | Yes | The agent to test. | |
| business_id | No | Business ID (optional only when the token can access exactly one business). | |
| caller_says | Yes | The caller's opening message, e.g. "I was rear-ended yesterday and need a lawyer." | |
| description | No | What the scenario checks (optional). |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| eval | No | ||
| error | No | Present when success is false | |
| success | Yes | Whether the tool completed successfully |