create_experiment
Create controlled experiments for comparison studies by pairing a pilot configuration with a hypothesis and measurement plan. Enforces association-not-causation evidence standards, allowing causal claims only with proper design.
Instructions
Create an experiment configuration for controlled comparison studies. Experiments pair a pilot configuration with a hypothesis and measurement plan. Use create_pilot_configuration first to build the config, then pass it here. Experiments enforce the ASSOCIATION-not-CAUSATION evidence standard — controlled experiments may upgrade evidence to CAUSATION only with proper design. REQUIRES AUTHORIZATION — contact pilots@mos2es.org for pilot access. In the synthetic demo, this returns an authorization notice.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"name": "<name>"
},
"name": "create_experiment"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| name | Yes | Experiment name (e.g., 'Q3 Claude vs ChatGPT operator comparison', 'Context window expansion pilot — Team Alpha') | |
| configuration | No | Pilot configuration object (JSON) — see list_pilot_options for available metrics, eval families, and benchmark classes. Can be generated by create_pilot_configuration. |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| tool | Yes | Tool name that was called | |
| error | Yes | Error type if authorization fails (e.g., 'authorization_required') | |
| status | No | Initial status of the experiment (e.g., 'draft', 'configured') | |
| message | Yes | Human-readable status message | |
| created_at | No | ISO timestamp of creation (on success) | |
| experiment_id | No | ID of the created experiment (on success) |