Skip to main content
Glama

get_experiment_results

Read-only

Measure how an experiment's groups perform on up to 5 metrics, with statistics. Each metric is computed per enrolled unit over the experiment's run, counting only events after the unit was assigned: conversion (share of units that fired the event), count_per_unit (events per unit), or sum_per_unit (a numeric argument or property summed per unit, e.g. revenue per player). Each non-control group is compared to the control with a two-sided test: relative lift, its 95% CI, p-value, and a verdict (significant_positive / significant_negative / inconclusive / insufficient_data). Also reports a sample-ratio check. Use list_event_types / get_property_values to find event and argument names first. Load the understand-experiments skill (load_skill("understand-experiments")) first.

Input Schema

NameRequiredDescriptionDefault
rangeNoNarrow the window. Always clamped to the experiment's own run.
metricsYes
projectIdYesThe project (application) id to scope this call to. Use list_projects to discover valid ids.
environmentYesThe environment name to scope this call to (e.g. 'production'). Use list_projects to discover the names available to this token.
experimentIdYes
controlGroupIdNoThe group every other group is compared to. Defaults to the first group.

Schema Changelog

Changes observed during successful MCP inspections.

  1. First observed

TDQS

A4.6/5.0
Behavior5/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations only declare readOnlyHint and openWorldHint; the description adds substantial computation semantics beyond that — counting starts only after unit assignment, denominators are enrolled units over the experiment's run, non-control groups are compared with a two-sided test yielding lift, 95% CI, p-value and one of four verdicts, plus a sample-ratio check. That is exactly the kind of behavior an agent needs to trust the output.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Front-loaded with the purpose, then prerequisites, then result shape; no sentence is filler. It is one dense block though — the metric-kind enumeration would scan better as a list, which is the only structural weakness.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With no output schema, the description takes on the burden of describing results and does so completely (lift, CI, p-value, verdict values, sample-ratio check), and it covers result-window semantics for the range parameter. Nothing an agent needs to call this correctly is missing.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The hardest parameter, `metrics`, is fully disambiguated: all three `kind` variants are defined, and `sum_per_unit`'s `value` (argument vs property) is explained with a concrete example ('revenue per player'). The remaining parameters (range, projectId, environment, controlGroupId) already carry schema descriptions, so the description's silence there is acceptable at 67% coverage.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Starts with a specific verb and resource: 'Measure how an experiment's groups perform on up to 5 metrics, with statistics.' The scope (per-group, up to 5 metrics, statistical comparison vs control) is precise enough to distinguish it from get_experiment or preview_experiment without opening any schema.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Gives explicit prerequisites: resolve event/argument names via list_event_types / get_property_values first, and load the understand-experiments skill before calling. It does not, however, contrast this tool with named siblings such as preview_experiment or execute_query, so the when-not path is left implicit.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.

Resources