Plan an A/B test
plan_ab_testPlan an A/B test for marketing copy. It takes the current conversion rate, the smallest lift worth detecting and the daily traffic, and returns how many visitors each version needs and how many days to run. It also frames the test as two different answers to the same reader question, so the result teaches you something you can reuse, and not just that "B won". It answers questions like how long to run a test, how much traffic it needs, whether a test is worth running, or what to test next.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"baseline_conversion_rate_percent": "<baseline_conversion_rate_percent>",
"minimum_detectable_lift_percent": "<minimum_detectable_lift_percent>",
"daily_visitors": "<daily_visitors>"
},
"name": "plan_ab_test"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| power | No | ||
| question | No | The reader question both versions answer, each in its own way. | |
| versions | No | How many versions, counting the original. | |
| version_a | No | How version A answers it. | |
| version_b | No | How version B answers it. | |
| confidence | No | ||
| daily_visitors | Yes | How many visitors a day enter the test, across all versions. | |
| minimum_detectable_lift_percent | Yes | The smallest relative lift worth detecting, in percent. 20 means a 20% lift, like going from 3% to 3.6%. | |
| baseline_conversion_rate_percent | Yes | The current conversion rate, in percent, so 3 means 3% and 0.8 means 0.8%. |