Skip to main content
Glama

Update A/B Test

update_ab_test

Update a native A/B test, including active state, variants, traffic, and conversion goal. Creates a Saved Version before the change.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
nameNoOptional new name
app_idYesThe app ID
test_idYesA/B test ID
variantsNoOptional replacement variants. Traffic must total 100.
is_activeNoOptional active state
page_nameNoOptional new base route page
goal_event_typeNoOptional conversion goal type
goal_event_filterNoOptional conversion goal filter

TDQS

A3.9/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already mark readOnlyHint=false, confirming mutation. The description adds a valuable side effect: 'Creates a Saved Version before the change.' This goes beyond the annotations by disclosing that the operation snapshots the prior state, which is useful for rollback awareness. No contradictions.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two succinct clauses, with the primary purpose front-loaded and the important side effect stated in a follow-up sentence. No wasted words, and it conveys all necessary high-level information efficiently.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a mutation tool with 8 parameters, nested objects, and no output schema, the description is adequate but leaves some gaps. It does not explicitly state that it is a partial update (only provided fields change), nor does it mention the response format or async behavior. The schema covers parameter constraints, so this is a moderate level of completeness.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with clear descriptions for each parameter. The description lists 'active state, variants, traffic, and conversion goal,' which maps to is_active, variants, and goal_event_type/goal_event_filter. It adds marginal reinforcement but does not introduce information beyond what the schema already provides.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states a specific verb ('Update') and resource ('native A/B test'), and enumerates the main fields it affects (active state, variants, traffic, conversion goal). This naturally distinguishes it from the create_ab_test, delete_ab_test, and read-only sibling tools like list_ab_tests or get_ab_test_stats.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The verb 'Update' implies this is for modifying an existing A/B test given an existing test_id, and is not for creation (create_ab_test) or deletion (delete_ab_test). However, the description gives no explicit exclusion or alternative references, so usage guidance is only implied rather than stated.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.

TDQS

B3.4/5.0
Disambiguation4/5

Most tools have clearly distinct purposes with detailed descriptions, but there are some overlapping pairs like read_app_file/read_app_files and create_entity_records vs seed_entity, which could cause misselection. Singular/plural variants and compatibility tools introduce minor ambiguity, but the majority are well-separated.

Naming Consistency4/5

Tool names predominantly follow a consistent verb_noun pattern (e.g., create_app, get_entities, delete_secret). There are some variations like 'agency_create_client' and 'seed_entity' that deviate slightly, but the overall convention is predictable and readable.

Tool Count2/5

With 82 tools, the server is far above the typical range and feels overwhelming. Even for a full platform API, the count is extreme and likely increases selection complexity. A more curated set would improve navigability without sacrificing capability.

Completeness5/5

The tool surface is exceptionally comprehensive, covering app lifecycle, file operations, entity CRUD, versioning, A/B testing, secrets, integrations, domains, agents, scheduling, policies, and member management. No obvious missing operations for the platform's scope; it even includes validation and workflow guidance tools.

Resources