Read an A/B test result
read_ab_test_resultRead the result of an A/B test. You get each version's conversion rate and lift, whether the difference is statistically significant, the confidence interval, and the chance each version really beats the original. It also warns you about the things that make a test result lie. Those include too few conversions, traffic that didn't split the way it should (a sample ratio mismatch), stopping the moment it looked good, and testing too many versions at once. It answers questions like "did my test win?", "is this significant?", "which version won?" or "should I keep it running?"
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"versions": "<versions>"
},
"name": "read_ab_test_result"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| question | No | The reader question the versions answered in different ways. | |
| versions | Yes | Each version with its visitors and conversions. Put the original, the control, first. | |
| confidence | No | ||
| intended_split | No | How you meant to split the traffic, like [50, 50]. The default is an even split. |