Skip to main content
Glama

Plan a validation test

validation_plan
Read-onlyIdempotent

Pick the cheapest test that can prove one assumption about an idea wrong within the days available, from a library of 18 named tests (for example Five Past-Behavior Interviews, Pay Link Pre-sale, Smoke Test Landing Page, Letter of Intent Round, Concierge MVP, Wizard of Oz, Feasibility Spike, Hand-Seeded Supply, Unit Cost Teardown, Regulatory Read and One Call). Tests are filtered by the buyer type, the price, the audience, reachable buyers, budget and whether someone can build, then ranked by strength of evidence against cost and days. Returns the sample, steps, a pass line, a kill line and an inconclusive rule set before the test runs, the decision date, a backup test, and every ruled-out test with the reason. Defaults to the riskiest assumption; pass assumption to choose another.

Input Schema

NameRequiredDescriptionDefault
ideaYesThe idea in plain words: what it does and for whom.
billingNoone_time, monthly, annual or per_use. Default one_time.
evidenceNoWhat has been learned so far.
who_paysNoThe person who pays, by role and niche, for example "owners of 2 to 10 truck plumbing companies".
who_usesNoThe person who uses it, if different from who pays.
price_usdNoIntended price in US dollars.
assumptionNoThe assumption to test. Default: the riskiest one the classifier finds.
buyer_typeNoOverride the detected buyer type.
start_dateNoISO date the work starts. Default today (UTC).
has_audienceNoTrue if there is an existing list, following or customer base to test with.
product_typeNoOverride the detected product type.
audience_sizeNo
has_prototypeNoTrue if a working version is already in users' hands.
days_availableNoDays until a decision is needed. Default 7.
test_budget_usdNoCash available for the validation test. Default 0.
reachable_buyersNoHow many named buyers can be contacted this week.
technical_builderNoFalse if nobody on the team can build the hardest part. Default true.
current_alternativeNoWhat they use or do about the problem today, for example "spreadsheets and texts", "Jobber", or "nothing".
runs_another_businessNoTrue if the founder is building this alongside a business they already run.

Schema Changelog

Changes observed during successful MCP inspections.

  1. First observed

TDQS

A3.7/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnly/idempotent/non-destructive, so the safety profile is covered. The description goes beyond them usefully: it discloses the filter dimensions (buyer type, price, audience, reachable buyers, budget, buildability), the ranking criterion (evidence strength vs cost and days), and the full return contract (sample, steps, pass line, kill line, inconclusive rule, decision date, backup test, ruled-out tests with reasons).

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness3/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The purpose is front-loaded and the output contract is valuable, but the middle sentence is a very long run-on that crams the whole 18-test library (with 11 examples) into a parenthetical. The test-name enumeration is bloat the agent does not need in order to invoke the tool.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

There is no output schema, so the description must carry the return contract, and it does so thoroughly (sample, steps, pass line, kill line, inconclusive rules, decision date, backup test, ruled-out tests). Combined with 95% schema coverage on 19 parameters and annotations covering safety, nothing essential for correct invocation is missing.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 95%, so the schema already documents each of the 19 parameters, including defaults. The description restates the filter inputs and the riskiest-assumption default without adding syntax or per-parameter meaning beyond the schema, which is exactly the baseline-3 case.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

States a concrete verb+resource (pick/plan a validation test from a named library) and specifies the selection logic (cheapest test that can falsify one assumption within days available). It enumerates 11 of the 18 library tests for concreteness. It never differentiates itself from siblings like kill_or_continue or cut_mvp, so it stops short of a 5.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Usage is implied rather than stated: the agent can infer it should call this when it needs to choose a validation experiment under day/budget constraints, and the 'Defaults to the riskiest assumption; pass assumption to choose another' line hints at preconditions. But there is no explicit when-to-use/when-not and no routing to or away from sibling tools.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.

Resources