Skip to main content
Glama

SplitLaunch

Server Details

MCP server for agent-run URL A/B testing. Create projects, allowlist domains, launch URL experiments, track conversions, and retrieve performance reports for customer-owned sites.

Status
Healthy
Last Tested
Transport
Streamable HTTP
URL

Glama MCP Gateway

Connect through Glama MCP Gateway for full control over tool access and complete visibility into every call.

MCP client
Glama
MCP server

Full call logging

Every tool call is logged with complete inputs and outputs, so you can debug issues and audit what your agents are doing.

Tool access control

Enable or disable individual tools per connector, so you decide what your agents can and cannot do.

Managed credentials

Glama handles OAuth flows, token storage, and automatic rotation, so credentials never expire on your clients.

Usage analytics

See which tools your agents call, how often, and when, so you can understand usage patterns and catch anomalies.

100% free. Your data is private.

Tool Definition Quality

Score is being calculated. Check back soon.

Available Tools

18 tools
billing_portalAInspect

Create a billing portal link for subscription management. Use only after the user asks to manage billing.

ParametersJSON Schema
NameRequiredDescriptionDefault
returnUrlNoOptional return URL accepted by the public API contract. SplitLaunch may use the dashboard billing return path.
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already mark readOnlyHint as false, indicating mutation. The description adds 'create a link' but doesn't detail side effects or return value. No contradiction with annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two sentences, no fluff, front-loaded purpose followed by usage condition. Every sentence earns its place.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple tool with one optional parameter and no output schema, the description covers the basics. However, it lacks details like prerequisite conditions (e.g., existing subscription) or what the link does.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% for the single optional parameter. The description restates the schema's description without adding additional meaning or usage guidance beyond the public API contract.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool creates a billing portal link for subscription management, using a specific verb and resource. It distinguishes from sibling tools which focus on domains, experiments, projects, and reports.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description explicitly says 'Use only after the user asks to manage billing,' providing a clear condition for use. It doesn't mention alternatives, but sibling tools are unrelated to billing.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

domains_addAInspect

Allowlist a customer-owned hostname so SplitLaunch pixel and redirect experiments can run safely on that domain.

ParametersJSON Schema
NameRequiredDescriptionDefault
hostnameYesHostname only, e.g. example.com, not a full URL.
projectIdNoOptional project ID. Omit only when the API key is project-scoped or the account has a clear default project.
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations indicate non-readOnly, non-destructive. Description adds that the domain must be customer-owned, implying ownership verification is needed. However, it does not disclose idempotency or error behavior (e.g., duplicate handling). Adds moderate value beyond annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single, front-loaded sentence with no wasted words. Every word earns its place.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Simple tool with no output schema. Description covers the action and purpose but omits post-conditions (e.g., what the response contains). Adequate for a simple mutation.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the schema already documents parameters. The description adds no extra meaning beyond what the schema provides. Baseline score applies.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Clearly states the action ('Allowlist a customer-owned hostname') and the purpose ('so SplitLaunch pixel and redirect experiments can run safely'). Distinguishes from sibling tools like domains_list by specifying the intent.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Provides clear context (for pixel and redirect experiments) but lacks explicit when-not-to-use or alternatives. Context implies usage domain.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

domains_listA
Read-onlyIdempotent
Inspect

List customer-owned domains allowlisted for pixel and redirect safety on a SplitLaunch project.

ParametersJSON Schema
NameRequiredDescriptionDefault
projectIdNoOptional project ID. Omit only when the API key is project-scoped or the account has a clear default project.
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true, destructiveHint=false, and idempotentHint=true. The description adds context about pixel and redirect safety but no additional behavioral traits beyond what annotations provide.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, clear sentence with no superfluous information. Every part is relevant.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the simple tool with one optional parameter and no output schema, the description is mostly adequate. However, it could mention pagination or the structure of the returned list for completeness.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The schema has 100% parameter description coverage for the single parameter 'projectId'. The tool description does not add any new meaning beyond the schema's parameter description.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states it lists domains that are allowlisted for pixel and redirect safety. It uses a specific verb ('list') and resource ('domains'), and distinguishes from sibling 'domains_add'.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description does not explicitly state when to use this tool or alternatives. It is implied for listing domains, but no guidance on when not to use it or when to prefer other tools like 'domains_add'.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

experiments_createAInspect

Create a draft external URL A/B test with control URL, variation URL, traffic split, and optional targeting filters. Prefer draft review before setting an experiment to running.

ParametersJSON Schema
NameRequiredDescriptionDefault
nameYes
projectIdNoOptional project ID. Omit only when the API key is project-scoped or the account has a clear default project.
targetingNoOptional exact-match targeting filters. Use only documented pixel metadata keys such as utm_source, utm_medium, utm_campaign, device, browser, or geo fields when available.
controlUrlYes
variationUrlYes
urlPatternRulesNoOptional URL pattern rules for advanced URL matching. Prefer simple controlUrl/variationUrl first.
trafficAllocationNoTraffic sent to the variation. Accepts 0-1 or 0-100; default is 50%.
preserveRedirectParamsNoDefault: true.
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=false and destructiveHint=false, so the description adds the 'draft' context and a usage recommendation. No behavioral traits beyond the schema are disclosed, but no contradictions exist.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description consists of two concise sentences: one for purpose and one for usage guidance. No unnecessary information, and it is well front-loaded.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the complexity (8 parameters, nested objects, no output schema), the description covers the core purpose and provides one usage hint. It lacks details on return values, draft lifecycle, and how to later set the experiment running, but sibling tools handle those aspects.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The description mentions control URL, variation URL, traffic split, and optional targeting filters, mapping to several parameters. With 63% schema coverage, it adds contextual meaning but does not cover all 8 parameters (e.g., name, projectId, preserveRedirectParams).

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool creates a draft external URL A/B test, specifying key components (control URL, variation URL, traffic split, optional targeting). This distinguishes it from sibling tools like experiments_update or experiments_list.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description advises preferring draft review before setting the experiment to running, providing context for when to use this tool. However, it does not explicitly mention alternatives like experiments_set_status for activation or experiments_update for modifications.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

experiments_listA
Read-onlyIdempotent
Inspect

List experiments for a SplitLaunch project, optionally filtered by lifecycle status.

ParametersJSON Schema
NameRequiredDescriptionDefault
pageNoDefault: 1.
statusNo
perPageNoDefault: 25. Maximum: 100.
projectIdNoOptional project ID. Omit only when the API key is project-scoped or the account has a clear default project.
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true, idempotentHint=true, destructiveHint=false, so the agent knows it's a safe read operation. The description adds no further behavioral context (e.g., pagination, ordering, or what happens if projectId is omitted).

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, clearly front-loaded with the core purpose. No redundant or extraneous information.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The description covers the basic purpose but lacks details about pagination (though schema has page/perPage), default ordering, and output format. Given no output schema, the agent might need more context to interpret results.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 75%, so parameters are mostly documented. The description references the status filter but does not add meaning beyond the schema (e.g., no explanation of page, perPage, or projectId behavior).

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Clearly states the action (list), resource (experiments), scope (for a SplitLaunch project), and optional filter (lifecycle status). Distinguishes from sibling tools like experiments_create and experiments_update by focusing on listing.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies when to use (list experiments with optional status filter) but provides no explicit guidance on alternatives or when not to use. No mention of sibling tools like goals_list or reports_*.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

experiments_set_statusA
Destructive
Inspect

Move an experiment through draft, running, paused, and ended states. Only call after the user approves launching, pausing, or ending the experiment.

ParametersJSON Schema
NameRequiredDescriptionDefault
statusYes
projectIdNoOptional project ID. Omit only when the API key is project-scoped or the account has a clear default project.
experimentIdYes
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate destructiveHint=true, so the description's statement about moving through states confirms mutation but adds little extra behavioral context (e.g., side effects on metrics or other data).

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two sentences with no unnecessary words. Information is front-loaded and efficient.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's destructive nature and 3 parameters, the description omits important details such as valid status transitions, preconditions, and return value. Lacks completeness for a mutation tool without output schema.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is only 33% (only projectId has a description). The description does not explain any parameters, missing a chance to clarify the status enum or experimentId format.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool moves an experiment through specific states (draft, running, paused, ended), distinguishing it from sibling tools like experiments_create or experiments_list.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides a clear when-to-use condition ('only call after user approves...'), but does not mention when not to use or alternatives like experiments_update for non-status changes.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

experiments_updateAInspect

Update an existing experiment's URLs, allocation, targeting filters, URL rules, or name. Use only after confirming the intended experiment.

ParametersJSON Schema
NameRequiredDescriptionDefault
nameNo
projectIdNoOptional project ID. Omit only when the API key is project-scoped or the account has a clear default project.
targetingNoOptional exact-match targeting filters. Use only documented pixel metadata keys such as utm_source, utm_medium, utm_campaign, device, browser, or geo fields when available.
controlUrlNo
experimentIdYes
variationUrlNo
urlPatternRulesNoOptional URL pattern rules for advanced URL matching. Prefer simple controlUrl/variationUrl first.
trafficAllocationNo
preserveRedirectParamsNo
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate the tool is not read-only, destructive, or idempotent. The description adds a safety note about confirming the experiment but does not disclose behavioral traits like partial update behavior, permissions required, or side effects.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is two sentences, front-loaded with the action, and contains no filler. Every word contributes meaning.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a tool with 9 parameters, 1 required, no output schema, and nested objects, the description is too brief. It omits details like partial vs. full update, optional fields (e.g., projectId, preserveRedirectParams), and expected behavior, leaving the agent underspecified.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

With only 33% schema description coverage, the description lists high-level parameter categories (URLs, allocation, etc.) but does not add specific meaning, format details, or constraints for the many undocumented parameters. It fails to compensate for the schema's lack of descriptions.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'Update' and specifies the resources: URLs, allocation, targeting filters, URL rules, or name. It distinguishes this from sibling tools like experiments_create and experiments_set_status by focusing on updating existing experiments and advising confirmation before use.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The phrase 'Use only after confirming the intended experiment' offers a caution but does not provide explicit when-to-use or when-not-to-use guidance compared to alternatives like experiments_set_status. The context is clear but lacks depth.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

goals_createBInspect

Create or reactivate a conversion goal that the browser pixel or agent-side workflow can fire.

ParametersJSON Schema
NameRequiredDescriptionDefault
nameYes
valueNoOptional default monetary value for this goal.
eventNameYes
projectIdNoOptional project ID. Omit only when the API key is project-scoped or the account has a clear default project.
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Description adds the concept of 'reactivation' beyond annotations, but annotations already indicate it's not read-only or destructive. The description could disclose side effects or permission requirements.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single concise sentence. While it lacks structure like bullet points or front-loading, it is appropriately brief for such a simple tool.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The description is minimal and does not mention return values, error conditions, or how the created goal can be referenced later. Given no output schema, more context is needed.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 50%, but the tool description provides no additional context for the parameters. It does not clarify the optional 'value' or 'projectId' fields beyond what the schema already states.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Clearly states the action ('Create or reactivate') and the resource ('conversion goal'), and provides context about its use ('browser pixel or agent-side workflow'). Distinguishes from sibling tools like goals_list which only lists goals.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit guidance on when to use this tool versus alternatives. Does not mention when not to use or which sibling tools are appropriate for different scenarios.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

goals_listC
Read-onlyIdempotent
Inspect

List conversion goals available for SplitLaunch experiments and reports.

ParametersJSON Schema
NameRequiredDescriptionDefault
activeNo
projectIdNoOptional project ID. Omit only when the API key is project-scoped or the account has a clear default project.
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true, idempotentHint=true, and destructiveHint=false, so the description adds no behavioral context beyond stating it lists goals. It does not mention pagination, limits, or what happens with missing parameters.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness3/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single concise sentence, but it is too brief and omits important details like filtering or output structure. It could be improved without becoming verbose.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the lack of an output schema and the presence of two optional parameters, the description should explain what is returned and how filtering works. It does not, leaving the agent with insufficient information.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

With 50% schema description coverage (only projectId has a note), the description fails to explain the 'active' parameter or provide additional context for the parameters. No parameter details are included in the description.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'list' and the resource 'conversion goals' with the specific context of SplitLaunch experiments and reports, making it easy to distinguish from sibling tools like goals_create or experiments_list.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides no guidance on when to use this tool versus alternatives, such as other listing tools or goals_create. It lacks context about prerequisites or preferred scenarios.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

projects_createAInspect

Create a SplitLaunch project/client workspace, allocate a public pixel ID, and optionally allowlist initial customer-owned domains. Requires an account-level API key.

ParametersJSON Schema
NameRequiredDescriptionDefault
nameYes
allowedDomainsNoOptional hostnames to allowlist, e.g. example.com. Do not send full page URLs here.
attributionModelNoOptional attribution model. Default: last_touch.
reportingTimezoneNoOptional IANA timezone. Default: UTC.
attributionWindowDaysNoOptional attribution window in days.
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations indicate mutating behavior (readOnlyHint=false), which aligns with description. Adds context beyond annotations: details about pixel ID allocation, domain allowlisting, and API key requirement. No contradiction.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence covering main action and key details. Front-loaded with purpose. Could be slightly more concise but no wasted words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

No output schema, and description does not mention return values. Provides enough context for agent to understand high-level effect but lacks guidance on what the tool returns after creation.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 80% (4/5 parameters have descriptions). Description does not add additional parameter-level details beyond what schema provides. Baseline of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states the verb 'Create' and resource 'SplitLaunch project/client workspace', specifying actions like allocating a public pixel ID and optionally allowlisting domains. It effectively distinguishes from sibling tools such as projects_get, projects_list, and projects_update.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Implies usage context: creating a project workspace. Mentions requirement for account-level API key, providing authentication guidance. However, does not explicitly state when not to use this tool or differentiate from alternatives like projects_update.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

projects_getA
Read-onlyIdempotent
Inspect

Return the selected SplitLaunch project, public pixel ID, allowed domains, attribution settings, and masked API-key context.

ParametersJSON Schema
NameRequiredDescriptionDefault
projectIdNoOptional project ID. Omit only when the API key is project-scoped or the account has a clear default project.
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already mark the tool as read-only and idempotent. The description adds value by specifying the exact return fields (public pixel ID, allowed domains, etc.), which helps the agent understand the output beyond the annotations. No contradictions, but could mention error behavior or permission requirements.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

A single sentence that efficiently lists the return values without any redundancy. It is front-loaded and all information is relevant.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's simplicity (one optional parameter, no output schema), the description covers the main purpose and return fields. However, it could mention that omitting projectId only works when the API key is project-scoped, which is partially covered in the parameter description but not in the main description.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% as the only parameter (projectId) is described in the schema. The description does not add any additional semantics or clarifications about the parameter beyond what the schema provides, so baseline score applies.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool returns a specific project with detailed fields (public pixel ID, allowed domains, attribution settings, masked API-key context). It uses a specific verb 'Return' and identifies the resource as a 'selected SplitLaunch project', effectively distinguishing it from the sibling 'projects_list' which likely returns all projects.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit guidance on when to use this tool versus alternatives like 'projects_list' or when to omit the project ID. The parameter description in the schema provides some context, but the tool description itself lacks usage context, leaving the agent without clear direction.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

projects_listA
Read-onlyIdempotent
Inspect

List SplitLaunch projects available to the authenticated account, including each public pixel ID.

ParametersJSON Schema
NameRequiredDescriptionDefault
pageNoDefault: 1.
perPageNoDefault: 25. Maximum: 100.
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and destructiveHint=false. The description adds that the tool lists projects 'available to the authenticated account' and includes 'each public pixel ID,' providing useful behavioral context beyond the annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

A single front-loaded sentence that efficiently conveys the tool's purpose and a key output detail. No redundant or extra words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple list tool with well-documented pagination parameters in the schema, the description adequately explains the action and return value (list of projects with pixel IDs). No output schema is present, but the description covers the essential output detail.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with both page and perPage described. The description adds no parameter-level information, so baseline score of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool lists SplitLaunch projects available to the authenticated account and specifies it includes public pixel IDs. This distinguishes it from sibling tools like projects_get (single project) and projects_create (create).

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The purpose implies when to use this tool (to list projects), but it does not explicitly compare to alternatives or state when not to use it. The context signals provide no additional guidance.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

projects_updateAInspect

Update project name, allowed domains, or attribution settings. Use only after the user approves changing project configuration.

ParametersJSON Schema
NameRequiredDescriptionDefault
nameNo
projectIdNoOptional project ID. Omit only when the API key is project-scoped or the account has a clear default project.
allowedDomainsNoOptional full replacement list of allowed hostnames for the project.
attributionModelNo
attributionWindowDaysNo
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate readOnlyHint=false and destructiveHint=false. The description adds the approval constraint but does not disclose other behaviors like error handling, side effects, or return value. This is adequate but not exceptional.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence of ~15 words, front-loaded with the action and resource. Every word earns its place with zero fluff.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given 5 parameters, no output schema, and minimal annotations, the description omits crucial details: what the tool returns, that all parameters are optional, and how partial updates work (e.g., replacement vs merge for allowedDomains).

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is only 40% (2 of 5 parameters have schema descriptions). The tool description groups parameters into categories ('name, allowed domains, or attribution settings') but provides no additional per-parameter meaning, leaving 60% of parameters undocumented.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool updates project settings (name, allowed domains, attribution), with a specific verb 'Update' and resource 'project'. It distinguishes from siblings like projects_create, projects_get, and projects_list.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description includes an explicit prerequisite: 'Use only after the user approves changing project configuration.' This provides clear context on when to invoke the tool, though it does not mention alternatives.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

reports_experiment_channelsA
Read-onlyIdempotent
Inspect

Return acquisition-channel performance using collected UTMs, click IDs, referrers, browser context, and variant assignments.

ParametersJSON Schema
NameRequiredDescriptionDefault
toNoOptional ISO-8601 end date/time or YYYY-MM-DD date.
fromNoOptional ISO-8601 start date/time or YYYY-MM-DD date.
goalNoOptional conversion event name to filter report results.
projectIdNoOptional project ID. Omit only when the API key is project-scoped or the account has a clear default project.
experimentIdYes
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations (readOnlyHint, idempotentHint, destructiveHint) already indicate safety. The description adds context about the data sources used, which is valuable beyond annotations. No contradictions.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence that is front-loaded with the purpose and includes key details. No unnecessary words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool has 5 parameters and no output schema, the description explains the function and data sources. However, it omits output format or pagination, but since it is read-only and idempotent, this is acceptable.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 80%, so the schema already explains parameters. The tool description does not add any parameter-specific details beyond what is in the schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool returns acquisition-channel performance, listing specific data sources (UTMs, click IDs, referrers, etc.), which distinguishes it from sibling reports like reports_experiment_chart or reports_experiment_details.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit guidance on when to use this tool versus alternatives. The description implies it is for channel performance analysis, but lacks when-not-to-use or alternative recommendations.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

reports_experiment_chartA
Read-onlyIdempotent
Inspect

Return time-series experiment conversion data for agent analysis and summaries.

ParametersJSON Schema
NameRequiredDescriptionDefault
toNoOptional ISO-8601 end date/time or YYYY-MM-DD date.
fromNoOptional ISO-8601 start date/time or YYYY-MM-DD date.
goalNoOptional conversion event name to filter report results.
intervalNoDefault: day.
projectIdNoOptional project ID. Omit only when the API key is project-scoped or the account has a clear default project.
experimentIdYes
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true, idempotentHint=true, destructiveHint=false, so the agent knows it's a safe read operation. The description adds context about time-series and conversion data but does not disclose additional behavioral traits beyond annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single concise sentence that conveys the core purpose without unnecessary words, making it easy to parse.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With 6 parameters and no output schema, the description briefly covers the purpose but does not explain the return format. However, for a chart report tool, the purpose is sufficiently clear for agent use.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 83%, so the schema already documents most parameters adequately. The description does not add meaning beyond what the schema provides, meriting a baseline score of 3.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool returns time-series experiment conversion data for agent analysis and summaries. It specifies the resource (experiment conversion data), format (time-series), and purpose, distinguishing it from sibling report tools.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description does not provide explicit guidance on when to use this tool versus alternatives like reports_experiment_channels or reports_experiment_details. It implies use for time-series conversion data but lacks when-not-to-use or exclusions.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

reports_experiment_detailsA
Read-onlyIdempotent
Inspect

Return experiment totals by variant: exposures, visitors, conversions, revenue, and conversion rate.

ParametersJSON Schema
NameRequiredDescriptionDefault
toNoOptional ISO-8601 end date/time or YYYY-MM-DD date.
fromNoOptional ISO-8601 start date/time or YYYY-MM-DD date.
goalNoOptional conversion event name to filter report results.
projectIdNoOptional project ID. Omit only when the API key is project-scoped or the account has a clear default project.
experimentIdYes
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true, idempotentHint=true, destructiveHint=false. The description adds the return metrics but does not elaborate on behavioral details like date range filtering or goal filtering beyond what the schema explains. No contradiction.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

A single sentence that efficiently conveys the tool's action and returned data. No filler or redundant information.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given no output schema, the description covers the main return but omits important contextual details such as the effect of optional date range and goal parameters on results, and the necessity of experimentId.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 80%, with good parameter descriptions. The description adds context that results are per variant, which is not explicit in the schema. However, it does not significantly enhance understanding of the parameters beyond their schema descriptions.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states it returns experiment totals by variant, listing specific metrics (exposures, visitors, conversions, revenue, conversion rate). This distinguishes it from sibling report tools like reports_experiment_channels and reports_experiment_chart.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit guidance on when to use this tool versus alternatives, such as when to use reports_experiment_channels for channel breakdowns. The description simply states what it returns without usage context.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

splitlaunch_healthcheckA
Read-onlyIdempotent
Inspect

Verify SplitLaunch MCP connectivity and return the authenticated API-key context without exposing the secret key.

ParametersJSON Schema
NameRequiredDescriptionDefault

No parameters

Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already provide readOnlyHint, idempotentHint, and destructiveHint. The description adds valuable context: it returns the API-key context without exposing the secret key, which informs the agent of the response content and safety measures. This goes beyond what annotations convey.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence of 12 words, containing all necessary information without any fluff. Every word is meaningful.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple healthcheck tool with no parameters and annotations providing safety profile, the description completes the picture by specifying what the response contains (authenticated API-key context) and a safety guarantee (no secret key exposed). Without an output schema, this is sufficient.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The tool has no parameters, and the input schema is empty with 100% coverage. The description does not need to explain parameters. Baseline for 0 parameters is 4.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool's purpose: 'Verify SplitLaunch MCP connectivity and return the authenticated API-key context without exposing the secret key.' It uses specific verbs ('Verify', 'return') and specifies the resource ('SplitLaunch MCP connectivity', 'API-key context'). This distinguishes it from sibling tools which deal with billing, domains, experiments, etc.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit when-to-use or when-not-to-use guidance is given. However, the purpose is clear enough that an agent can infer it's for health checks. The lack of alternatives or exclusions keeps the score at a midpoint.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

usage_summary
Read-onlyIdempotent
Inspect

Return billing usage such as sessions, events, exposures, and active experiments for the selected project.

ParametersJSON Schema
NameRequiredDescriptionDefault
toNoOptional YYYY-MM-DD usage end date.
fromNoOptional YYYY-MM-DD usage start date.
projectIdNoOptional project ID. Omit only when the API key is project-scoped or the account has a clear default project.

Discussions

No comments yet. Be the first to start the discussion!

Try in Browser

Your Connectors

Sign in to create a connector for this server.

Resources