Skip to main content
Glama

IA-QA — 152 QA & Dev Tools for AI Agents

sandbox_scenario

Read-onlyIdempotent

Get a ready-made selector-drift test case with a known-correct answer, for testing this MCP server or an agent workflow end to end. Each scenario is a real DOM capture of a deliberately breakable app, taken before and after one specific UI change (a renamed label, two swapped buttons, a duplicated locator, an element moved behind a menu…), plus the verdict those two contracts MUST produce. Call with no arguments to list the scenarios; call with a scenario id to get "baseline" and "current" mappings. THE LOOP: pass baseline and current to diff_mappings, then compare its "verdict" and "counts" to this tool's "expected" — they must match exactly. A mismatch means this server's diff engine has drifted, not that your inputs are wrong. Deterministic and offline: the captures are committed fixtures, identical on every call. Try it live at https://www.ia-qa.com/devtools/sandbox

Input Schema

NameRequiredDescriptionDefault
scenarioNoScenario id. Omit to list every available scenario with its expected verdict. Ids: no-change, swap-label, add-testid, duplicate-role-name, remove-element, insert-sibling, rename-label, counter-label, move-behind-menu, add-element
include_htmlNoInclude the generated HTML of the mutated page (default false). Only useful if you want to render or re-capture it yourself; the loop does not need it.

Output Schema

NameRequiredDescriptionDefault
htmlNo
pageNo
blurbNo
countNo
titleNo
currentNo
teachesNo
baselineNo
expectedNo
scenarioNo
mutationsNo
scenariosNo
how_to_run_the_loopNo

Schema Changelog

Changes observed during successful MCP inspections.

  1. Changed1 schema field changed
    • addedInput schema / examples
      Added value: +[
      +  {
      +    "scenario": "swap-label"
      +  }
      +]
  2. Added

TDQS

A4.6/5.0
Behavior5/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Goes beyond the annotations by disclosing determinism and offline provenance ('committed fixtures, identical on every call'), which reinforces idempotence with concrete reason. It also adds diagnostic semantics not present in the annotations: a verdict mismatch indicates server drift, not bad inputs — context an agent could not infer elsewhere.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Purpose is front-loaded, then the loop, then determinism — a sensible order with labeled segments ('THE LOOP:'). It runs slightly long and the trailing external URL is not needed for correct invocation, though the remainder earns its space.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Covers everything needed for a two-parameter, read-only fixture tool: what it returns (baseline/current mappings), how to use it in a loop, expected semantic ('expected' verdict), and determinism guarantees. With an output schema present, no return-value documentation is missing.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so both parameters are already documented in the schema, including the 'omit to list' behavior and the include_html caveat. The description restates the no-arg vs. scenario-id behavior but adds no format or syntax detail beyond the schema, so baseline 3 applies.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

States a specific verb and resource ('Get a ready-made selector-drift test case with a known-correct answer') and scopes the use case ('for testing this MCP server or an agent workflow end to end'). It also implicitly distinguishes itself from diff_mappings by naming that tool as the downstream consumer of its output.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines5/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Explicitly covers both call modes ('call with no arguments to list the scenarios; call with a scenario id to get baseline and current mappings') and prescribes the exact follow-up sequence with diff_mappings. It even tells the agent how to interpret a mismatch, removing any ambiguity about what to do with the result.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.