Skip to main content
Glama

Launch usability test

launch_usability_test

Starts the AI usability test for a proposal from propose_usability_test or revise_usability_test. Intended to run only after the user has reviewed the plan and explicitly approved launching it, because it spends AI-tester runs and creates a new project. A proposal launches once: calling it again (for example after the user launched from the plan view) returns that test with alreadyLaunched: true. Requires the latest proposalId: each revise replaces earlier ids, and an outdated id fails with PROPOSAL_NOT_FOUND. Optional last-minute edits: add or remove tasks or questions, swap personas. Returns the testId, the final personas and plan, and a startedMessage with the expected duration (usually several minutes). Results come from wait_for_results. Another batch on an existing project is run with relaunch_usability_test, which avoids a duplicate project.

Input Schema

NameRequiredDescriptionDefault
editsNo
proposalIdYes

Output Schema

NameRequiredDescriptionDefault
testIdNoThe created project/test id.
audienceNoThe resolved audience envelope echoed back so the caller can report exactly what was applied.
personasNo
taskPlanNo
projectUrlNoThe test's project in the TheySaid app — share it when the user asks where the test is.
taskDetailsNo
learningGoalsNo
startedMessageNoExpectation-setting line for how long the run takes.
alreadyLaunchedNoTrue when this proposal was already launched: the original test is returned and nothing new runs.
questionDetailsNo

Schema Changelog

Changes observed during successful MCP inspections.

  1. Changed4 schema fields changed
    • changedInput schema / properties / edits / anyOf
      Previous value: -[
      -  {
      -    "properties": {
      -      "addLearningGoals": {
      -        "anyOf": [
      -          {
      -            "items": {
      -              "type": "string"
      -            },
      -            "type": "array"
      -          },
      -          {
      -            "type": "null"
      -          }
      -        ]
      -      },
      -      "addQuestions": {
      -        "anyOf": [
      -          {
      -            "items": {
      -              "type": "string"
      -            },
      -            "type": "array"
      -          },
      -          {
      -            "type": "null"
      -          }
      -        ]
      -      },
      -      "addTasks": {
      -        "anyOf": [
      -          {
      -            "items": {
      -              "type": "string"
      -            },
      -            "type": "array"
      -          },
      -          {
      -            "type": "null"
      -          }
      -        ]
      -      },
      -      "audience": {
      -        "anyOf": [
      -          {
      -            "properties": {
      -              "ageMax": {
      -                "anyOf": [
      -                  {
      -                    "type": "number"
      -                  },
      -                  {
      -                    "type": "null"
      -                  }
      -                ]
      -              },
      -              "ageMin": {
      -                "anyOf": [
      -                  {
      -                    "type": "number"
      -                  },
      -                  {
      -                    "type": "null"
      -                  }
      -                ]
      -              },
      -              "biologicalSex": {
      -                "anyOf": [
      -                  {
      -                    "type": "string"
      -                  },
      -                  {
      -                    "type": "null"
      -                  }
      -                ]
      -              },
      -              "companyIndustry": {
      -                "anyOf": [
      -                  {
      -                    "type": "string"
      -                  },
      -                  {
      -                    "type": "null"
      -                  }
      -                ]
      -              },
      -              "companySize": {
      -                "anyOf": [
      -                  {
      -                    "type": "string"
      -                  },
      -                  {
      -                    "type": "null"
      -                  }
      -                ]
      -              },
      -              "knowledgebase": {
      -                "anyOf": [
      -                  {
      -                    "type": "string"
      -                  },
      -                  {
      -                    "type": "null"
      -                  }
      -                ]
      -              },
      -              "motivation": {
      -                "anyOf": [
      -                  {
      -                    "type": "string"
      -                  },
      -                  {
      -                    "type": "null"
      -                  }
      -                ]
      -              },
      -              "numTesters": {
      -                "anyOf": [
      -                  {
      -                    "type": "number"
      -                  },
      -                  {
      -                    "type": "null"
      -                  }
      -                ]
      -              },
      -              "personality": {
      -                "anyOf": [
      -                  {
      -                    "items": {
      -                      "properties": {
      -                        "dimension": {
      -                          "type": "string"
      -                        },
      -                        "max": {
      -                          "type": "number"
      -                        },
      -                        "min": {
      -                          "type": "number"
      -                        }
      -                      },
      -                      "required": [
      -                        "dimension",
      -                        "min",
      -                        "max"
      -                      ],
      -                      "type": "object"
      -                    },
      -                    "type": "array"
      -                  },
      -                  {
      -                    "type": "null"
      -                  }
      -                ]
      -              },
      -              "titles": {
      -                "anyOf": [
      -                  {
      -                    "type": "string"
      -                  },
      -                  {
      -                    "type": "null"
      -                  }
      -                ]
      -              },
      -              "useProxy": {
      -                "anyOf": [
      -                  {
      -                    "type": "boolean"
      -                  },
      -                  {
      -                    "type": "null"
      -                  }
      -                ]
      -              },
      -              "voice": {
      -                "anyOf": [
      -                  {
      -                    "properties": {
      -                      "similarityBoost": {
      -                        "anyOf": [
      -                          {
      -                            "type": "number"
      -                          },
      -                          {
      -                            "type": "null"
      -                          }
      -                        ]
      -                      },
      -                      "speakerBoost": {
      -                        "anyOf": [
      -                          {
      -                            "type": "boolean"
      -                          },
      -                          {
      -                            "type": "null"
      -                          }
      -                        ]
      -                      },
      -                      "speed": {
      -                        "anyOf": [
      -                          {
      -                            "type": "number"
      -                          },
      -                          {
      -                            "type": "null"
      -                          }
      -                        ]
      -                      },
      -                      "stability": {
      -                        "anyOf": [
      -                          {
      -                            "type": "number"
      -                          },
      -                          {
      -                            "type": "null"
      -                          }
      -                        ]
      -                      },
      -                      "style": {
      -                        "anyOf": [
      -                          {
      -                            "type": "number"
      -                          },
      -                          {
      -                            "type": "null"
      -                          }
      -                        ]
      -                      },
      -                      "voiceIds": {
      -                        "anyOf": [
      -                          {
      -                            "items": {
      -                              "type": "string"
      -                            },
      -                            "type": "array"
      -                          },
      -                          {
      -                            "type": "null"
      -                          }
      -                        ]
      -                      }
      -                    },
      -                    "type": "object"
      -                  },
      -                  {
      -                    "type": "null"
      -                  }
      -                ]
      -              },
      -              "worldview": {
      -                "anyOf": [
      -                  {
      -                    "type": "string"
      -                  },
      -                  {
      -                    "type": "null"
      -                  }
      -                ]
      -              }
      -            },
      -            "type": "object"
      -          },
      -          {
      -            "type": "null"
      -          }
      -        ]
      -      },
      -      "personaIds": {
      -        "anyOf": [
      -          {
      -            "items": {
      -              "type": "string"
      -            },
      -            "type": "array"
      -          },
      -          {
      -            "type": "null"
      -          }
      -        ]
      -      },
      -      "removeLearningGoalIndexes": {
      -        "anyOf": [
      -          {
      -            "items": {
      -              "type": "number"
      -            },
      -            "type": "array"
      -          },
      -          {
      -            "type": "null"
      -          }
      -        ]
      -      },
      -      "removeQuestionIndexes": {
      -        "anyOf": [
      -          {
      -            "items": {
      -              "type": "number"
      -            },
      -            "type": "array"
      -          },
      -          {
      -            "type": "null"
      -          }
      -        ]
      -      },
      -      "removeTaskIndexes": {
      -        "anyOf": [
      -          {
      -            "items": {
      -              "type": "number"
      -            },
      -            "type": "array"
      -          },
      -          {
      -            "type": "null"
      -          }
      -        ]
      -      }
      -    },
      -    "type": "object"
      -  },
      -  {
      -    "type": "null"
      -  }
      -]New value: +[
      +  {
      +    "properties": {
      +      "addLearningGoals": {
      +        "anyOf": [
      +          {
      +            "items": {
      +              "type": "string"
      +            },
      +            "type": "array"
      +          },
      +          {
      +            "type": "null"
      +          }
      +        ]
      +      },
      +      "addQuestionSpecs": {
      +        "anyOf": [
      +          {
      +            "items": {
      +              "properties": {
      +                "followUps": {
      +                  "anyOf": [
      +                    {
      +                      "type": "number"
      +                    },
      +                    {
      +                      "type": "null"
      +                    }
      +                  ]
      +                },
      +                "options": {
      +                  "anyOf": [
      +                    {
      +                      "items": {
      +                        "type": "string"
      +                      },
      +                      "type": "array"
      +                    },
      +                    {
      +                      "type": "null"
      +                    }
      +                  ]
      +                },
      +                "required": {
      +                  "anyOf": [
      +                    {
      +                      "type": "boolean"
      +                    },
      +                    {
      +                      "type": "null"
      +                    }
      +                  ]
      +                },
      +                "scale": {
      +                  "anyOf": [
      +                    {
      +                      "properties": {
      +                        "highLabel": {
      +                          "anyOf": [
      +                            {
      +                              "type": "string"
      +                            },
      +                            {
      +                              "type": "null"
      +                            }
      +                          ]
      +                        },
      +                        "lowLabel": {
      +                          "anyOf": [
      +                            {
      +                              "type": "string"
      +                            },
      +                            {
      +                              "type": "null"
      +                            }
      +                          ]
      +                        },
      +                        "max": {
      +                          "type": "number"
      +                        },
      +                        "min": {
      +                          "type": "number"
      +                        }
      +                      },
      +                      "required": [
      +                        "min",
      +                        "max"
      +                      ],
      +                      "type": "object"
      +                    },
      +                    {
      +                      "type": "null"
      +                    }
      +                  ]
      +                },
      +                "text": {
      +                  "type": "string"
      +                },
      +                "type": {
      +                  "anyOf": [
      +                    {
      +                      "enum": [
      +                        "open_ended",
      +                        "multiple_choice",
      +                        "rating",
      +                        "ranking"
      +                      ],
      +                      "type": "string"
      +                    },
      +                    {
      +                      "type": "null"
      +                    }
      +                  ]
      +                }
      +              },
      +              "required": [
      +                "text"
      +              ],
      +              "type": "object"
      +            },
      +            "type": "array"
      +          },
      +          {
      +            "type": "null"
      +          }
      +        ]
      +      },
      +      "addQuestions": {
      +        "anyOf": [
      +          {
      +            "items": {
      +              "type": "string"
      +            },
      +            "type": "array"
      +          },
      +          {
      +            "type": "null"
      +          }
      +        ]
      +      },
      +      "addTasks": {
      +        "anyOf": [
      +          {
      +            "items": {
      +              "type": "string"
      +            },
      +            "type": "array"
      +          },
      +          {
      +            "type": "null"
      +          }
      +        ]
      +      },
      +      "audience": {
      +        "anyOf": [
      +          {
      +            "properties": {
      +              "ageMax": {
      +                "anyOf": [
      +                  {
      +                    "type": "number"
      +                  },
      +                  {
      +                    "type": "null"
      +                  }
      +                ]
      +              },
      +              "ageMin": {
      +                "anyOf": [
      +                  {
      +                    "type": "number"
      +                  },
      +                  {
      +                    "type": "null"
      +                  }
      +                ]
      +              },
      +              "biologicalSex": {
      +                "anyOf": [
      +                  {
      +                    "type": "string"
      +                  },
      +                  {
      +                    "type": "null"
      +                  }
      +                ]
      +              },
      +              "companyIndustry": {
      +                "anyOf": [
      +                  {
      +                    "type": "string"
      +                  },
      +                  {
      +                    "type": "null"
      +                  }
      +                ]
      +              },
      +              "companySize": {
      +                "anyOf": [
      +                  {
      +                    "type": "string"
      +                  },
      +                  {
      +                    "type": "null"
      +                  }
      +                ]
      +              },
      +              "knowledgebase": {
      +                "anyOf": [
      +                  {
      +                    "type": "string"
      +                  },
      +                  {
      +                    "type": "null"
      +                  }
      +                ]
      +              },
      +              "motivation": {
      +                "anyOf": [
      +                  {
      +                    "type": "string"
      +                  },
      +                  {
      +                    "type": "null"
      +                  }
      +                ]
      +              },
      +              "numTesters": {
      +                "anyOf": [
      +                  {
      +                    "type": "number"
      +                  },
      +                  {
      +                    "type": "null"
      +                  }
      +                ]
      +              },
      +              "personality": {
      +                "anyOf": [
      +                  {
      +                    "items": {
      +                      "properties": {
      +                        "dimension": {
      +                          "type": "string"
      +                        },
      +                        "max": {
      +                          "type": "number"
      +                        },
      +                        "min": {
      +                          "type": "number"
      +                        }
      +                      },
      +                      "required": [
      +                        "dimension",
      +                        "min",
      +                        "max"
      +                      ],
      +                      "type": "object"
      +                    },
      +                    "type": "array"
      +                  },
      +                  {
      +                    "type": "null"
      +                  }
      +                ]
      +              },
      +              "titles": {
      +                "anyOf": [
      +                  {
      +                    "type": "string"
      +                  },
      +                  {
      +                    "type": "null"
      +                  }
      +                ]
      +              },
      +              "useProxy": {
      +                "anyOf": [
      +                  {
      +                    "type": "boolean"
      +                  },
      +                  {
      +                    "type": "null"
      +                  }
      +                ]
      +              },
      +              "voice": {
      +                "anyOf": [
      +                  {
      +                    "properties": {
      +                      "similarityBoost": {
      +                        "anyOf": [
      +                          {
      +                            "type": "number"
      +                          },
      +                          {
      +                            "type": "null"
      +                          }
      +                        ]
      +                      },
      +                      "speakerBoost": {
      +                        "anyOf": [
      +                          {
      +                            "type": "boolean"
      +                          },
      +                          {
      +                            "type": "null"
      +                          }
      +                        ]
      +                      },
      +                      "speed": {
      +                        "anyOf": [
      +                          {
      +                            "type": "number"
      +                          },
      +                          {
      +                            "type": "null"
      +                          }
      +                        ]
      +                      },
      +                      "stability": {
      +                        "anyOf": [
      +                          {
      +                            "type": "number"
      +                          },
      +                          {
      +                            "type": "null"
      +                          }
      +                        ]
      +                      },
      +                      "style": {
      +                        "anyOf": [
      +                          {
      +                            "type": "number"
      +                          },
      +                          {
      +                            "type": "null"
      +                          }
      +                        ]
      +                      },
      +                      "voiceIds": {
      +                        "anyOf": [
      +                          {
      +                            "items": {
      +                              "type": "string"
      +                            },
      +                            "type": "array"
      +                          },
      +                          {
      +                            "type": "null"
      +                          }
      +                        ]
      +                      }
      +                    },
      +                    "type": "object"
      +                  },
      +                  {
      +                    "type": "null"
      +                  }
      +                ]
      +              },
      +              "worldview": {
      +                "anyOf": [
      +                  {
      +                    "type": "string"
      +                  },
      +                  {
      +                    "type": "null"
      +                  }
      +                ]
      +              }
      +            },
      +            "type": "object"
      +          },
      +          {
      +            "type": "null"
      +          }
      +        ]
      +      },
      +      "personaIds": {
      +        "anyOf": [
      +          {
      +            "items": {
      +              "type": "string"
      +            },
      +            "type": "array"
      +          },
      +          {
      +            "type": "null"
      +          }
      +        ]
      +      },
      +      "removeLearningGoalIndexes": {
      +        "anyOf": [
      +          {
      +            "items": {
      +              "type": "number"
      +            },
      +            "type": "array"
      +          },
      +          {
      +            "type": "null"
      +          }
      +        ]
      +      },
      +      "removeQuestionIndexes": {
      +        "anyOf": [
      +          {
      +            "items": {
      +              "type": "number"
      +            },
      +            "type": "array"
      +          },
      +          {
      +            "type": "null"
      +          }
      +        ]
      +      },
      +      "removeTaskIndexes": {
      +        "anyOf": [
      +          {
      +            "items": {
      +              "type": "number"
      +            },
      +            "type": "array"
      +          },
      +          {
      +            "type": "null"
      +          }
      +        ]
      +      }
      +    },
      +    "type": "object"
      +  },
      +  {
      +    "type": "null"
      +  }
      +]
    • addedOutput schema / properties / questionDetails / items / properties / options / description
      Added value: +"Multiple-choice options or ranking items."
    • addedOutput schema / properties / questionDetails / items / properties / scale
      Added value: +{
      +  "anyOf": [
      +    {
      +      "additionalProperties": false,
      +      "properties": {
      +        "highLabel": {
      +          "type": "string"
      +        },
      +        "lowLabel": {
      +          "type": "string"
      +        },
      +        "max": {
      +          "type": "number"
      +        },
      +        "min": {
      +          "type": "number"
      +        }
      +      },
      +      "type": "object"
      +    },
      +    {
      +      "type": "null"
      +    }
      +  ],
      +  "description": "Rating questions only: the numeric scale and its end labels."
      +}
    • changedOutput schema / properties / questionDetails / items / properties / type / enum
      Previous value: -[
      -  "open_ended",
      -  "multiple_choice"
      -]New value: +[
      +  "open_ended",
      +  "multiple_choice",
      +  "rating",
      +  "ranking"
      +]
  2. Changed1 schema field changed
    • addedOutput schema / properties / alreadyLaunched
      Added value: +{
      +  "description": "True when this proposal was already launched: the original test is returned and nothing new runs.",
      +  "type": "boolean"
      +}
  3. Changed1 schema field changed
    • addedOutput schema / properties / projectUrl
      Added value: +{
      +  "description": "The test's project in the TheySaid app — share it when the user asks where the test is.",
      +  "type": "string"
      +}
  4. First observed

TDQS

A4.9/5.0
Behavior5/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Goes well beyond the annotations: it discloses the cost ('spends AI-tester runs'), the side effect ('creates a new project'), non-idempotency behavior in the specific form of alreadyLaunched: true on repeat calls, the failure mode PROPOSAL_NOT_FOUND for stale ids, and the expected runtime ('usually several minutes'). This is exactly the context an agent needs before a non-readOnly, non-idempotent launch.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Front-loads what the tool does, then the approval precondition, then the id-staleness rule, then edits, then outputs and alternatives. Sentences are dense but every one carries information an agent would otherwise have to guess; nothing is filler.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a two-parameter but behaviorally consequential launch tool, it covers preconditions, cost, side effects, repeat-call behavior, error mode, return contents (testId, personas/plan, startedMessage with duration), and the follow-up tools for results and relaunches. An output schema exists and the description still names the key return fields, so nothing material is missing.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the description must carry the load; it does well on the required param, stating that the latest proposalId is required and that a revise replaces earlier ids, with the precise PROPOSAL_NOT_FOUND failure. It also summarizes edits as 'add or remove tasks or questions, swap personas', but leaves several edit fields (audience/numTesters, voice settings, addLearningGoals, addQuestionSpecs, removeLearningGoalIndexes) unaddressed, so the coverage gap is only partly closed.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

States a specific verb and resource: 'Starts the AI usability test for a proposal from propose_usability_test or revise_usability_test.' It immediately distinguishes itself from the planning siblings and from relaunch_usability_test, which is called out explicitly as the route for another batch on an existing project.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines5/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Gives an explicit precondition ('only after the user has reviewed the plan and explicitly approved launching it'), names the producing siblings, names relaunch_usability_test as the alternative for an existing project, and points to wait_for_results for the results. When-to-use, when-not-to-use, and alternatives are all covered.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.

Resources