Skip to main content
Glama
getsimba-ai

Simba MCP Server

Official
by getsimba-ai

Recommend Incrementality Tests

recommend_incrementality_tests
Read-onlyIdempotent

Rank channels for incrementality tests using stored posterior marginal returns. Prioritize experiments without refitting models or changing budgets.

Instructions

Rank channels for experiment investigation using stored posterior marginal returns. Read-only: no fit, test creation or budget changes. Returns {method, basis, score_unit, currency, budget, hurdle, spend_basis, period, approximation_warnings, items, excluded}. Each item carries channel, score, components (mean, sigma, stake, spend_share, crossing_probability, optional contraction), reason_codes, last_test_end, hypothesis and an unavailable design_hint. The score is a normal-approximation local binary perfect-information value, not expected test benefit, experiment budget, portfolio value or forecast lift. budget is a positive exposure scale (default sum of current spend); weights are the mean-active-period spend mix, which need not represent one common calendar period. hurdle is the non-negative marginal-return alternative (default 1). limit is 1-50. Missing posterior means or intervals are explicitly excluded. limited_variance_contraction means contraction from zero to below 0.1; posterior_variance_expanded means negative contraction. Neither proves prior domination. Cross-channel dependence is not modelled. Requires read:results. Test history is unavailable because stored registry records do not establish compatible model/geographical coverage. Requires backend support for test-priorities.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
limitNo
budgetNo
hurdleNo
model_hashYes

Output Schema

TableJSON Schema
NameRequiredDescriptionDefault

No arguments

Schema Changelog

Changes observed during successful MCP inspections.

  1. Addedv0.16.0

TDQS

A4.4/5.0
Behavior5/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnly/idempotent/non-destructive, and the description still adds substantial behavioral context: the auth scope required, the backend capability gate, explicit exclusion of missing posteriors, the meaning of limited_variance_contraction vs posterior_variance_expanded, and the disclaimer that cross-channel dependence is not modelled and test history is unavailable. This is well beyond what the annotations provide and contradicts nothing.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness3/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Purpose is front-loaded correctly, but the middle is a dense run-on enumerating return keys and warning codes that the output schema already carries, producing a wall of text where a shorter semantic gloss would suffice. Every clause is informative but the listing is not optimally sized.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Covers auth requirements, backend gating, exclusion behavior, score interpretation and known modelling limitations, so an agent can judge appropriateness. It leans on prose to restate return fields already in the output schema and omits any meaning for model_hash, which slightly undercuts completeness.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

With 0% schema coverage the description must compensate, and it does for three of four params: limit is bounded 1-50, budget is a positive exposure scale defaulting to current spend, and hurdle is the non-negative marginal-return alternative defaulting to 1. model_hash, the only required parameter, is never explained, leaving one gap.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Opens with a specific verb+resource+basis: 'Rank channels for experiment investigation using stored posterior marginal returns.' It also contrasts itself against siblings by stating it does 'no fit, test creation or budget changes', which separates it from create_incrementality_test and run_pipeline without opening their schemas.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

States the read-only framing and that it requires read:results and backend support for test-priorities, which tells the agent when the call can succeed. It implies but never explicitly names the alternative (create_incrementality_test) or the condition that selects it, so routing is left partly to inference.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Deploy Server

Other Tools