Skip to main content
Glama

MisarMail MCP Server

create_ab_test

Create one A/B test variant on a campaign. The real API stores a single variant per call, so build a test by calling this once per variant (e.g. twice for a plain A/B split) using the same campaign_id and distinct variant labels. Each variant gets send_percent of the audience; auto_select_winner (with winner_wait_hours) can pick and send the winner automatically, or use select_ab_test_winner to do it manually.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
subjectNoSubject line for subject tests
variantYesVariant label, e.g. 'A' or 'B' (max 5 chars)
body_htmlNoBody HTML for content tests
from_nameNoSender name for from_name tests
preheaderNoPreheader text for preheader tests
test_typeNoWhat this variant differs on (default: content)
campaign_idYesCampaign to test (UUID)
send_time_aNoISO timestamp for this variant's send_time slot A
send_time_bNoISO timestamp for this variant's send_time slot B
send_percentNoPercent of the audience that receives this variant (1-99, default 50)
winner_wait_hoursNoHours to wait before auto-selecting a winner (1-168, default 4)
auto_select_winnerNoAutomatically select and send the winner after winner_wait_hours (default false)

Schema Changelog

Changes observed during successful MCP inspections.

  1. Changed17 schema fields changed
    • addedInput schema / properties / auto_select_winner
      Added value: +{
      +  "description": "Automatically select and send the winner after winner_wait_hours (default false)",
      +  "type": "boolean"
      +}
    • addedInput schema / properties / body_html
      Added value: +{
      +  "description": "Body HTML for content tests",
      +  "type": "string"
      +}
    • changedInput schema / properties / campaign_id / description
      Previous value: -"Campaign to test"New value: +"Campaign to test (UUID)"
    • addedInput schema / properties / from_name
      Added value: +{
      +  "description": "Sender name for from_name tests",
      +  "type": "string"
      +}
    • addedInput schema / properties / preheader
      Added value: +{
      +  "description": "Preheader text for preheader tests",
      +  "type": "string"
      +}
    • removedInput schema / properties / sample_percentage
      Removed value: -{
      -  "description": "Percent of the audience used for the test (default 20)",
      -  "type": "number"
      -}
    • addedInput schema / properties / send_percent
      Added value: +{
      +  "description": "Percent of the audience that receives this variant (1-99, default 50)",
      +  "type": "number"
      +}
    • addedInput schema / properties / send_time_a
      Added value: +{
      +  "description": "ISO timestamp for this variant's send_time slot A",
      +  "type": "string"
      +}
    • addedInput schema / properties / send_time_b
      Added value: +{
      +  "description": "ISO timestamp for this variant's send_time slot B",
      +  "type": "string"
      +}
    • addedInput schema / properties / subject
      Added value: +{
      +  "description": "Subject line for subject tests",
      +  "type": "string"
      +}
    • addedInput schema / properties / test_type
      Added value: +{
      +  "description": "What this variant differs on (default: content)",
      +  "enum": [
      +    "content",
      +    "subject",
      +    "send_time",
      +    "from_name",
      +    "preheader"
      +  ],
      +  "type": "string"
      +}
    • removedInput schema / properties / type
      Removed value: -{
      -  "description": "What to test",
      -  "enum": [
      -    "subject",
      -    "content",
      -    "send_time",
      -    "from_name"
      -  ],
      -  "type": "string"
      -}
    • addedInput schema / properties / variant
      Added value: +{
      +  "description": "Variant label, e.g. 'A' or 'B' (max 5 chars)",
      +  "type": "string"
      +}
    • removedInput schema / properties / variants
      Removed value: -{
      -  "description": "Test variants (2–5)",
      -  "items": {
      -    "properties": {
      -      "from_name": {
      -        "description": "Sender name for from_name tests",
      -        "type": "string"
      -      },
      -      "html": {
      -        "description": "Body content for content tests",
      -        "type": "string"
      -      },
      -      "label": {
      -        "description": "Variant label, e.g. A / B",
      -        "type": "string"
      -      },
      -      "send_at": {
      -        "description": "ISO timestamp for send_time tests",
      -        "type": "string"
      -      },
      -      "subject": {
      -        "description": "Subject line for subject tests",
      -        "type": "string"
      -      }
      -    },
      -    "type": "object"
      -  },
      -  "type": "array"
      -}
    • removedInput schema / properties / winner_metric
      Removed value: -{
      -  "description": "Metric used to pick the winner (default open_rate)",
      -  "enum": [
      -    "open_rate",
      -    "click_rate",
      -    "conversion_rate"
      -  ],
      -  "type": "string"
      -}
    • addedInput schema / properties / winner_wait_hours
      Added value: +{
      +  "description": "Hours to wait before auto-selecting a winner (1-168, default 4)",
      +  "type": "number"
      +}
    • changedInput schema / required
      Previous value: -[
      -  "campaign_id",
      -  "type",
      -  "variants"
      -]New value: +[
      +  "campaign_id",
      +  "variant"
      +]
  2. First observed

TDQS

A4.5/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations only supply the generic safety profile (not read-only, non-destructive, non-idempotent, open-world). The description adds substantive behavioral context annotations cannot express: the one-variant-per-call write model, send_percent splitting of the audience, and that winner selection can be automatic after winner_wait_hours. It does not spell out auth requirements or what the response contains, keeping it short of a 5.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Three tightly packed sentences, front-loaded with the core action before the multi-call mechanic and the winner-selection option. No filler, though the density is high and could be marginally tighter.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a 12-parameter mutation tool with no output schema, the description covers the critical call pattern and the automated vs manual winner path that the schema cannot express. Return-value behavior is undocumented, but with no output schema the burden is lower.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the baseline is 3. The description goes beyond the schema by explaining how parameters interact across calls (same campaign_id, distinct variant labels) and by clarifying the audience-splitting role of send_percent, which the schema's per-field wording doesn't convey.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

States a specific verb+resource (create one A/B test variant on a campaign) and immediately clarifies the non-obvious cardinality: the API stores a single variant per call. This distinguishes it cleanly from create_campaign, list_ab_tests and select_ab_test_winner.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines5/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Gives explicit procedural guidance (call once per variant with the same campaign_id and distinct variant labels; twice for a plain A/B split) and names the alternative path for winner selection ('or use select_ab_test_winner to do it manually'), with the auto_select_winner/winner_wait_hours condition attached.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.