atlas_start_custom_eval_batch
Start scoring several candidates with a custom evaluation model (5 credits per candidate). Returns batch_id: check atlas_get_custom_eval_batch_status(batch_id), then atlas_get_custom_eval_batch_results(batch_id). Runs in the background: usually a few minutes, longer for large batches.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"custom_model_id": "<custom_model_id>",
"candidate_ids": "<candidate_ids>",
"context_id": "<context_id>"
},
"name": "atlas_start_custom_eval_batch"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| context_id | Yes | From atlas_list_contexts | |
| template_id | No | ||
| detail_level | No | standard | |
| candidate_ids | Yes | From atlas_list_candidates | |
| custom_model_id | Yes | From atlas_list_custom_eval_models |