Skip to main content
Glama

BRAINIAC A/B Testing & Experimentation Statistics

Server Details

Paid A/B Testing & Experimentation Statistics API via x402. Unpaid tool calls return 402.

If you are the author of this connector, you can claim ownership. Claimed connector authors can inspect health checks, view analytics, and manage their listing.
Status
Healthy
Uptime
100.0% over the last 24 hours
Last Tested
Transport
Streamable HTTP · MCP 2025-11-25
URL
ChatGPT
–
Claude
–

TDQS

A4/5.0

Scored across 15 tools

Disambiguation5/5

Each tool targets a clearly distinct experimentation method: frequentist A/B testing, Bayesian A/B, sequential testing, bandit allocation, CUPED, delta-method ratios, guardrails, and related diagnostics. Although several tools analyze experiment results, their descriptions make the statistical purpose and input/output scope sufficiently distinct. An agent should be able to select the correct method without major ambiguity.

Naming Consistency5/5

All tools use the same `experimentation_` prefix followed by a hyphenated method name, giving a highly predictable pattern. The naming is consistent across the entire tool set and mirrors the endpoint paths.

Tool Count5/5

Fifteen tools is well-scoped for a specialized experimentation statistics server covering multiple analysis families. Each tool corresponds to a distinct statistical procedure, and the count does not feel bloated for the stated domain.

Completeness4/5

The surface covers core experimentation workflows: sample sizing, assignment/bucketing, flag evaluation, frequentist and Bayesian analysis, sequential testing, guardrails, segmentation, CUPED, ratio metrics, SRM, multiple testing, novelty effects, holdouts, and bandits. Minor gaps may exist around experiment lifecycle management or integrated reporting, but for a pure statistics-computation server the coverage is strong.

Available Tools

15 tools
experimentation_ab-test-frequentistRun a frequentist A/B test scorecardA
Read-onlyIdempotent
Inspect

Two-arm A/B scorecard for conversion (two-proportion z) or continuous (Welch t) metrics: absolute and relative lift, confidence intervals, p-value and significance. Pure computation on supplied aggregates. Price $0.02 USDC. POST /api/v1/experimentation/ab-test-frequentist. An unpaid call returns the x402 payment terms and does not run.

Inputs: control (required), treatment (required), metricType (required), alpha, +1 more. Returns: test, pValue, sources, statistic, +8 more

experimentation_bandit-allocateCompute multi-armed bandit traffic weightsA
Read-onlyIdempotent
Inspect

Next-period traffic weights from arm outcomes: Thompson-sampling probabilities by deterministic quadrature, or UCB1 indices, with an exploration floor. Price $0.03 USDC. POST /api/v1/experimentation/bandit-allocate. An unpaid call returns the x402 payment terms and does not run.

Inputs: arms (required), policy (required), prior, minShare. Returns: policy, sources, weights, limitations

experimentation_bayesian-abCompare A/B arms with a Bayesian Beta-Binomial modelA
Read-onlyIdempotent
Inspect

Posterior, probability to beat control, probability of being best, expected loss and equal-tailed credible intervals for 2-10 conversion arms. Deterministic: exact Miller sum or quadrature, no Monte Carlo. Price $0.03 USDC. POST /api/v1/experimentation/bayesian-ab. An unpaid call returns the x402 payment terms and does not run.

Inputs: arms (required), prior, credibleLevel. Returns: arms, method, control, sources, +2 more

experimentation_bucket-assignAssign units to experiment groups deterministicallyA
Read-onlyIdempotent
Inspect

Stateless SHA-256 bucketing of unit ids into an experiment with traffic gating, ordered group shares and an optional layer, documented so any SDK can reproduce it. Price $0.01 USDC. POST /api/v1/experimentation/bucket-assign. An unpaid call returns the x402 payment terms and does not run.

Inputs: unitIds (required), experiment (required), layer. Returns: sources, algorithm, assignments, limitations

experimentation_cuped-adjustApply CUPED variance reduction and test the adjusted effectA
Read-onlyIdempotent
Inspect

CUPED adjustment with a pre-experiment covariate on unit-level data: theta, variance reduction, and Welch tests on raw and adjusted values. Price $0.03 USDC. POST /api/v1/experimentation/cuped-adjust. An unpaid call returns the x402 payment terms and does not run.

Inputs: units (required), alpha. Returns: raw, theta, groups, sources, +4 more

experimentation_delta-method-ratioEstimate a ratio metric with the delta methodA
Read-onlyIdempotent
Inspect

Confidence interval for a ratio metric whose analysis unit differs from the randomisation unit, plus the treatment-vs-control difference and relative lift. Accepts unit rows or aggregates. Price $0.03 USDC. POST /api/v1/experimentation/delta-method-ratio. An unpaid call returns the x402 payment terms and does not run.

Inputs: arms (required), alpha. Returns: arms, sources, difference, relativeCi, +2 more

experimentation_flag-rule-evaluateEvaluate a feature-flag rule setA
Read-onlyIdempotent
Inspect

Evaluate ordered feature-flag rules (attribute operators, semver comparison, deterministic percentage rollout) for one user context and explain which rule matched. Price $0.01 USDC. POST /api/v1/experimentation/flag-rule-evaluate. An unpaid call returns the x402 payment terms and does not run.

Inputs: flag (required), context (required). Returns: trace, value, reason, sources, +2 more

experimentation_guardrail-checkCheck A/B guardrail metrics for non-inferiorityA
Read-onlyIdempotent
Inspect

One-sided non-inferiority tests of guardrail metrics against caller-supplied relative or absolute margins, with bounds and an overall pass flag. Price $0.02 USDC. POST /api/v1/experimentation/guardrail-check. An unpaid call returns the x402 payment terms and does not run.

Inputs: metrics (required), alpha. Returns: allPass, metrics, sources, limitations

experimentation_holdout-impactMeasure cumulative impact against a long-term holdoutA
Read-onlyIdempotent
Inspect

Exposed-versus-holdout impact with confidence interval and p-value, plus diluted population-level impact for partial exposure. Price $0.01 USDC. POST /api/v1/experimentation/holdout-impact. An unpaid call returns the x402 payment terms and does not run.

Inputs: exposed (required), holdout (required), metricType (required), alpha, +1 more. Returns: ci, pValue, sources, dilutedCi, +5 more

experimentation_multiple-testing-correctAdjust p-values for multiple testingA
Read-onlyIdempotent
Inspect

Bonferroni, Holm and Benjamini-Hochberg adjusted p-values and reject decisions across metrics or arms, returned in input order. Price $0.01 USDC. POST /api/v1/experimentation/multiple-testing-correct. An unpaid call returns the x402 payment terms and does not run.

Inputs: pValues (required), alpha, methods. Returns: alpha, results, sources, limitations

experimentation_novelty-effect-detectDetect novelty or primacy effects in daily liftA
Read-onlyIdempotent
Inspect

OLS trend test on daily lift with early-versus-late means, classifying the pattern as novelty, primacy or stable. Price $0.01 USDC. POST /api/v1/experimentation/novelty-effect-detect. An unpaid call returns the x402 payment terms and does not run.

Inputs: daily (required), alpha, liftType, earlyDays. Returns: t, pValue, pattern, slopeSe, +7 more

experimentation_sample-ratio-mismatchDetect A/B sample ratio mismatchA
Read-onlyIdempotent
Inspect

Chi-square goodness-of-fit test of observed arm counts against expected traffic shares, with an exact binomial p-value for tiny two-arm counts and generic causes when a mismatch is flagged. Price $0.01 USDC. POST /api/v1/experimentation/sample-ratio-mismatch. An unpaid call returns the x402 payment terms and does not run.

Inputs: arms (required), threshold. Returns: df, srm, arms, hints, +5 more

experimentation_sample-size-mdeCalculate A/B sample size or minimum detectable effectA
Read-onlyIdempotent
Inspect

Required users per arm and duration for a target minimum detectable effect, or the MDE for a fixed sample, for proportion or mean metrics with power, multi-arm Bonferroni and unequal allocation. Price $0.01 USDC. POST /api/v1/experimentation/sample-size-mde. An unpaid call returns the x402 payment terms and does not run.

Inputs: metricType (required), mde, arms, alpha, +10 more. Returns: days, nByArm, totalN, formula, +4 more

experimentation_segment-liftMeasure A/B lift per segment with FDR controlA
Read-onlyIdempotent
Inspect

Per-segment conversion lift with Benjamini-Hochberg adjusted p-values, a Cochran Q heterogeneity test and suppression of small segments. Price $0.02 USDC. POST /api/v1/experimentation/segment-lift. An unpaid call returns the x402 payment terms and does not run.

Inputs: segments (required), alpha, minUsersPerArm. Returns: sources, segments, suppressed, limitations, +1 more

experimentation_sequential-testCompute sequential testing boundaries or an always-valid p-valueA
Read-onlyIdempotent
Inspect

Lan-DeMets group-sequential boundaries (O'Brien-Fleming or Pocock spending) for planned looks with a stop/continue decision, or an always-valid mSPRT p-value for continuous monitoring. Price $0.04 USDC. POST /api/v1/experimentation/sequential-test. An unpaid call returns the x402 payment terms and does not run.

Inputs: mode (required), tau2, alpha, estimate, +4 more. Returns: sources, decision, spending, boundaries, +2 more

Tool Schema Changelog

Recent tool additions, removals, and schema changes observed during successful MCP inspections.

Loading tool schema changelog…

    Related MCP Connectors

    Related MCP Servers

    • A
      license
      B
      quality
      B
      maintenance
      Enables users to access a free catalog and samples plus 17 pay-per-call tools, settled in USDC on Base via x402, for web reading, source-bounded summarization, Rioplatense Spanish translation, market and Argentine data, developer utilities, text comparison, and x402-related queries.
      19
      59 npm
      MIT
    • A
      license
      Not graded
      quality
      C
      maintenance
      Exposes four x402 pay-per-call capabilities — deterministic text analysis, 0–100 gaming hook scoring, EN↔FA translation QA scoring, and live game metadata — as MCP tools that return live 402 payment requirements for settlement in USDC on Base when invoked unpaid.
      MIT
    • A
      license
      Not graded
      quality
      D
      maintenance
      Enables MCP-capable agents to call 40 paid API tools—including OCR, PDF, image, tabular, and web utilities—by paying per request via x402 micropayments on Base, with no API key, subscription, or signup required.
      MIT
    • A
      license
      B
      quality
      C
      maintenance
      Enables agents to compute exact Uniswap v3 Q64.96 tick math, quotes, and liquidity fees, simulate MEV sandwich vulnerability, model multi-hop flashloan arbitrage profits, and project Base L2 blob gas costs. Tools are metered per call in USDC via an x402 HTTP 402 challenge settled on Base L2, so an agent can verify net profitability before executing a trade.
      5
      MIT
    Try in Browser

    Glama MCP Gateway

    Add one secure layer between your agents and this server.

    Resources