Skip to main content
Glama

Test Deployed Environment

test_deployed_environment

Test a deployed environment end-to-end. Discovers the UI, generates a Playwright test, and executes it. The run is ephemeral unless project_id is provided, in which case a linked test case, script, and result are saved. Returns pass/fail with test code and screenshots.

Input Schema

NameRequiredDescriptionDefault
urlYesURL of the deployed environment to test (e.g. https://my-app.preview.example.com)
contextNoExplain why you are calling this tool and how it fits into the user's overall goal. This parameter is used for analytics and user intent tracking. YOU MUST provide 15-25 words (count carefully). NEVER use first person ('I', 'we', 'you') - maintain third-person perspective. NEVER include sensitive information such as credentials, passwords, or personal data. Example (20 words): "Searching across the organization's repositories to find all open issues related to performance complaints and latency issues for team prioritization."
timeoutNoTest execution timeout in seconds (default: 60)
max_stepsNoMaximum navigation steps for discovery (default: 15)
project_idNoProject ID to save the generated test into. When provided, a test case, linked script, and execution result are persisted, making the script available for Insert Tests Into Repo.
descriptionYesNatural language description of what to test (e.g. 'verify the users table displays 25 users with name, email, role and date columns')

Schema Changelog

Changes observed during successful MCP inspections.

  1. First observed

TDQS

A3.8/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=false and openWorldHint=true, and the description adds genuinely useful detail beyond them: the run is ephemeral by default, project_id persists a test case, linked script, and result, and the response includes pass/fail plus test code and screenshots. It does not mention expected runtime or that a full browser run may exceed the default timeout, which is a meaningful omission for an open-world operation.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Three tight sentences: capability first, persistence semantics second, return value third. No filler, and the most decision-relevant information (what it does and what it produces) is front-loaded.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a six-parameter tool with full schema coverage and no output schema, the description covers the pipeline, the persistence branch, and the return shape. The remaining gap is the absence of any note that this is a long-running browser-driven operation whose duration scales with timeout and max_steps.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the schema already documents all six parameters, including the analytics-only 'context' parameter and its strict 15-25 word constraint. The description adds only the persistence consequence of project_id, which the schema field description already covers, so it does not meaningfully exceed the baseline.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states a specific verb and resource ('Test a deployed environment end-to-end') and enumerates the internal pipeline: UI discovery, Playwright test generation, and execution. This makes the tool's scope reasonably distinguishable from generation-only siblings like generate_tests or runner siblings like run_tests, though no sibling is named explicitly.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Usage is implied by the phrase 'deployed environment end-to-end', and the description clarifies the persistence fork (ephemeral vs. saved when project_id is provided). However, it never states when to prefer this over close alternatives such as test_deploy_integration, run_native_test, or run_tests, nor any preconditions like authentication requirements for the target URL.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.

Resources