BRAINIAC A/B Testing & Experimentation Statistics
Server Details
Paid A/B Testing & Experimentation Statistics API via x402. Unpaid tool calls return 402.
- Status
- Healthy
- Uptime
- 100.0% over the last 24 hours
- Last Tested
- Transport
- Streamable HTTP · MCP 2025-11-25
- URL
- ChatGPT
- –
- Claude
- –
TDQS
Scored across 15 tools
Each tool targets a clearly distinct experimentation method: frequentist A/B testing, Bayesian A/B, sequential testing, bandit allocation, CUPED, delta-method ratios, guardrails, and related diagnostics. Although several tools analyze experiment results, their descriptions make the statistical purpose and input/output scope sufficiently distinct. An agent should be able to select the correct method without major ambiguity.
All tools use the same `experimentation_` prefix followed by a hyphenated method name, giving a highly predictable pattern. The naming is consistent across the entire tool set and mirrors the endpoint paths.
Fifteen tools is well-scoped for a specialized experimentation statistics server covering multiple analysis families. Each tool corresponds to a distinct statistical procedure, and the count does not feel bloated for the stated domain.
The surface covers core experimentation workflows: sample sizing, assignment/bucketing, flag evaluation, frequentist and Bayesian analysis, sequential testing, guardrails, segmentation, CUPED, ratio metrics, SRM, multiple testing, novelty effects, holdouts, and bandits. Minor gaps may exist around experiment lifecycle management or integrated reporting, but for a pure statistics-computation server the coverage is strong.
Available Tools
15 toolsexperimentation_ab-test-frequentistRun a frequentist A/B test scorecardARead-onlyIdempotentInspect
Two-arm A/B scorecard for conversion (two-proportion z) or continuous (Welch t) metrics: absolute and relative lift, confidence intervals, p-value and significance. Pure computation on supplied aggregates. Price $0.02 USDC. POST /api/v1/experimentation/ab-test-frequentist. An unpaid call returns the x402 payment terms and does not run.
Inputs: control (required), treatment (required), metricType (required), alpha, +1 more. Returns: test, pValue, sources, statistic, +8 more
experimentation_bandit-allocateCompute multi-armed bandit traffic weightsARead-onlyIdempotentInspect
Next-period traffic weights from arm outcomes: Thompson-sampling probabilities by deterministic quadrature, or UCB1 indices, with an exploration floor. Price $0.03 USDC. POST /api/v1/experimentation/bandit-allocate. An unpaid call returns the x402 payment terms and does not run.
Inputs: arms (required), policy (required), prior, minShare. Returns: policy, sources, weights, limitations
experimentation_bayesian-abCompare A/B arms with a Bayesian Beta-Binomial modelARead-onlyIdempotentInspect
Posterior, probability to beat control, probability of being best, expected loss and equal-tailed credible intervals for 2-10 conversion arms. Deterministic: exact Miller sum or quadrature, no Monte Carlo. Price $0.03 USDC. POST /api/v1/experimentation/bayesian-ab. An unpaid call returns the x402 payment terms and does not run.
Inputs: arms (required), prior, credibleLevel. Returns: arms, method, control, sources, +2 more
experimentation_bucket-assignAssign units to experiment groups deterministicallyARead-onlyIdempotentInspect
Stateless SHA-256 bucketing of unit ids into an experiment with traffic gating, ordered group shares and an optional layer, documented so any SDK can reproduce it. Price $0.01 USDC. POST /api/v1/experimentation/bucket-assign. An unpaid call returns the x402 payment terms and does not run.
Inputs: unitIds (required), experiment (required), layer. Returns: sources, algorithm, assignments, limitations
experimentation_cuped-adjustApply CUPED variance reduction and test the adjusted effectARead-onlyIdempotentInspect
CUPED adjustment with a pre-experiment covariate on unit-level data: theta, variance reduction, and Welch tests on raw and adjusted values. Price $0.03 USDC. POST /api/v1/experimentation/cuped-adjust. An unpaid call returns the x402 payment terms and does not run.
Inputs: units (required), alpha. Returns: raw, theta, groups, sources, +4 more
experimentation_delta-method-ratioEstimate a ratio metric with the delta methodARead-onlyIdempotentInspect
Confidence interval for a ratio metric whose analysis unit differs from the randomisation unit, plus the treatment-vs-control difference and relative lift. Accepts unit rows or aggregates. Price $0.03 USDC. POST /api/v1/experimentation/delta-method-ratio. An unpaid call returns the x402 payment terms and does not run.
Inputs: arms (required), alpha. Returns: arms, sources, difference, relativeCi, +2 more
experimentation_flag-rule-evaluateEvaluate a feature-flag rule setARead-onlyIdempotentInspect
Evaluate ordered feature-flag rules (attribute operators, semver comparison, deterministic percentage rollout) for one user context and explain which rule matched. Price $0.01 USDC. POST /api/v1/experimentation/flag-rule-evaluate. An unpaid call returns the x402 payment terms and does not run.
Inputs: flag (required), context (required). Returns: trace, value, reason, sources, +2 more
experimentation_guardrail-checkCheck A/B guardrail metrics for non-inferiorityARead-onlyIdempotentInspect
One-sided non-inferiority tests of guardrail metrics against caller-supplied relative or absolute margins, with bounds and an overall pass flag. Price $0.02 USDC. POST /api/v1/experimentation/guardrail-check. An unpaid call returns the x402 payment terms and does not run.
Inputs: metrics (required), alpha. Returns: allPass, metrics, sources, limitations
experimentation_holdout-impactMeasure cumulative impact against a long-term holdoutARead-onlyIdempotentInspect
Exposed-versus-holdout impact with confidence interval and p-value, plus diluted population-level impact for partial exposure. Price $0.01 USDC. POST /api/v1/experimentation/holdout-impact. An unpaid call returns the x402 payment terms and does not run.
Inputs: exposed (required), holdout (required), metricType (required), alpha, +1 more. Returns: ci, pValue, sources, dilutedCi, +5 more
experimentation_multiple-testing-correctAdjust p-values for multiple testingARead-onlyIdempotentInspect
Bonferroni, Holm and Benjamini-Hochberg adjusted p-values and reject decisions across metrics or arms, returned in input order. Price $0.01 USDC. POST /api/v1/experimentation/multiple-testing-correct. An unpaid call returns the x402 payment terms and does not run.
Inputs: pValues (required), alpha, methods. Returns: alpha, results, sources, limitations
experimentation_novelty-effect-detectDetect novelty or primacy effects in daily liftARead-onlyIdempotentInspect
OLS trend test on daily lift with early-versus-late means, classifying the pattern as novelty, primacy or stable. Price $0.01 USDC. POST /api/v1/experimentation/novelty-effect-detect. An unpaid call returns the x402 payment terms and does not run.
Inputs: daily (required), alpha, liftType, earlyDays. Returns: t, pValue, pattern, slopeSe, +7 more
experimentation_sample-ratio-mismatchDetect A/B sample ratio mismatchARead-onlyIdempotentInspect
Chi-square goodness-of-fit test of observed arm counts against expected traffic shares, with an exact binomial p-value for tiny two-arm counts and generic causes when a mismatch is flagged. Price $0.01 USDC. POST /api/v1/experimentation/sample-ratio-mismatch. An unpaid call returns the x402 payment terms and does not run.
Inputs: arms (required), threshold. Returns: df, srm, arms, hints, +5 more
experimentation_sample-size-mdeCalculate A/B sample size or minimum detectable effectARead-onlyIdempotentInspect
Required users per arm and duration for a target minimum detectable effect, or the MDE for a fixed sample, for proportion or mean metrics with power, multi-arm Bonferroni and unequal allocation. Price $0.01 USDC. POST /api/v1/experimentation/sample-size-mde. An unpaid call returns the x402 payment terms and does not run.
Inputs: metricType (required), mde, arms, alpha, +10 more. Returns: days, nByArm, totalN, formula, +4 more
experimentation_segment-liftMeasure A/B lift per segment with FDR controlARead-onlyIdempotentInspect
Per-segment conversion lift with Benjamini-Hochberg adjusted p-values, a Cochran Q heterogeneity test and suppression of small segments. Price $0.02 USDC. POST /api/v1/experimentation/segment-lift. An unpaid call returns the x402 payment terms and does not run.
Inputs: segments (required), alpha, minUsersPerArm. Returns: sources, segments, suppressed, limitations, +1 more
experimentation_sequential-testCompute sequential testing boundaries or an always-valid p-valueARead-onlyIdempotentInspect
Lan-DeMets group-sequential boundaries (O'Brien-Fleming or Pocock spending) for planned looks with a stop/continue decision, or an always-valid mSPRT p-value for continuous monitoring. Price $0.04 USDC. POST /api/v1/experimentation/sequential-test. An unpaid call returns the x402 payment terms and does not run.
Inputs: mode (required), tau2, alpha, estimate, +4 more. Returns: sources, decision, spending, boundaries, +2 more
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
Loading tool schema changelog…
Related MCP Connectors
Paid Statistics & Quality Engineering API via x402. Unpaid tool calls return 402.
Paid Predictive & Customer Analytics API via x402. Unpaid tool calls return 402.
Paid Equity Analytics API via x402. Unpaid tool calls return 402.
Paid Web & Page Intelligence API via x402. Unpaid tool calls return 402.
Related MCP Servers
- AlicenseBqualityBmaintenanceEnables users to access a free catalog and samples plus 17 pay-per-call tools, settled in USDC on Base via x402, for web reading, source-bounded summarization, Rioplatense Spanish translation, market and Argentine data, developer utilities, text comparison, and x402-related queries.1959 npmMIT
- AlicenseNot gradedqualityCmaintenanceExposes four x402 pay-per-call capabilities — deterministic text analysis, 0–100 gaming hook scoring, EN↔FA translation QA scoring, and live game metadata — as MCP tools that return live 402 payment requirements for settlement in USDC on Base when invoked unpaid.MIT
- AlicenseNot gradedqualityDmaintenanceEnables MCP-capable agents to call 40 paid API tools—including OCR, PDF, image, tabular, and web utilities—by paying per request via x402 micropayments on Base, with no API key, subscription, or signup required.MIT
- AlicenseBqualityCmaintenanceEnables agents to compute exact Uniswap v3 Q64.96 tick math, quotes, and liquidity fees, simulate MEV sandwich vulnerability, model multi-hop flashloan arbitrage profits, and project Base L2 blob gas costs. Tools are metered per call in USDC via an x402 HTTP 402 challenge settled on Base L2, so an agent can verify net profitability before executing a trade.5MIT
Glama MCP Gateway
Add one secure layer between your agents and this server.