Skip to main content
Glama

Get Test Manager Test Runs by Project ID

tm.get_testRunsByProjectId

Retrieve all test runs in a project with details including status, type, counts, and filtering by status, build state, and folder.

Instructions

Retrieves every test run in a LambdaTest Test Manager project: title, folder ID, status, type, build state, objective, tags, distinct test case/environment counts, total test case instances, percent complete, and a pass/failed/skipped/etc. breakdown. KANEAI RUNS: a run's top-level type field is ALWAYS 'Manual' regardless of whether it's a real manual run or a KaneAI-generated one - it does not distinguish them, despite the name. The actual signal is 'KaneAI-Generated' (the API's is_auteur_generated field) - true for a run KaneAI itself created. Manual and KaneAI test runs are not interchangeable (a manual test case cannot correctly run inside a KaneAI run and vice versa) regardless of the separate 'Editable'/schedule fields - use 'KaneAI-Generated' before calling tm.add_testCasesToTestRun, which refuses to modify any KaneAI-generated run. 'Editable: No' and a schedule name instead indicate the run's composition is currently owned/regenerated by an active KaneAI schedule - a related but separate concern from manual/KaneAI compatibility (a one-off, unscheduled KaneAI run can be 'Editable: Yes' and still be a KaneAI run). FOLDERS: test runs can be organized into their own folders/subfolders, entirely separate from the folder tree used for test cases (tm.get_foldersByProjectId) - a test run's folder and the folders its individual test cases live in are unrelated concepts and do not share IDs. This is currently the only tool that reliably reports a test run's OWN folder_id - tm.get_testRunById and tm.get_testCaseInstancesByTestRunId both return an empty folder_id for the same run. There is no known endpoint to browse/resolve the test-run folder tree itself (name, parent, path) - only this raw folder_id value is available so far. TERMINOLOGY: a 'test case instance' is ONE (test case x environment) pairing, not one test case - e.g. 1 test case assigned 2 environments contributes 2 to 'Total Test Case Instances' but only 1 to 'Test Cases'. 'Test Cases' and 'Environments (distinct)' below ARE correctly distinct counts on this endpoint (unlike tm.get_testRunById, where the API's equivalently-named raw fields are all just duplicates of the instance count - that tool works around it by computing its own distinct counts, so both tools' numbers should agree for the same run). Supports pagination (page, per_page) and filtering by status (e.g. 'Not Started', 'In Progress', 'Passed', 'Failed', 'Skipped'), build_state ('active' or 'archived'), and/or folder_id (the test run's OWN folder - see the Folder ID note above; this is NOT the folder_id of any test case inside the run). Use tm.get_testRunById or tm.get_testCaseInstancesByTestRunId for full detail on a specific run. Read-only; does not modify anything.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
pageNo
statusNo
per_pageNo
folder_idNo
project_idYes
build_stateNo
Behavior5/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations provided, the description fully discloses behavioral traits: it is read-only, explains the KaneAI-generated run behavior, folder ID inconsistencies, and terminology nuances. This provides complete transparency beyond what structured fields could offer.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is long but well-structured with sections (KANEAI RUNS, FOLDERS, TERMINOLOGY) and front-loaded with the core purpose. While every sentence adds value, some details could be slightly more concise. Overall, it's appropriate for the complexity.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the complexity (6 parameters, no annotations, no output schema), the description is exceptionally complete. It covers edge cases, caveats, and relationships with sibling tools, leaving no significant gaps for an agent to understand correct usage.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 0%, so the description must compensate. It adds meaning to parameters like folder_id (explaining it's the test run's own folder) and status (giving examples like 'Not Started', 'Passed'). It also mentions pagination parameters. However, it does not list all parameters explicitly, so not a perfect 5.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description uses a specific verb and resource: 'Retrieves every test run in a LambdaTest Test Manager project' and lists the fields returned, making the purpose clear. It also distinguishes from siblings by mentioning alternatives for detail, like tm.get_testRunById and tm.get_testCaseInstancesByTestRunId.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines5/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides explicit guidance on when to use this tool versus alternatives, such as 'Use tm.get_testRunById or tm.get_testCaseInstancesByTestRunId for full detail on a specific run.' It also includes specific scenarios (e.g., checking 'KaneAI-Generated' before calling tm.add_testCasesToTestRun) and describes filtering options.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Install Server

Other Tools

Latest Blog Posts

MCP directory API

We provide all the information about MCP servers via our MCP API.

curl -X GET 'https://glama.ai/api/mcp/v1/servers/prakhar-gahlot/TestMu-AI-Test-Manager-MCP'

If you have feedback or need assistance with the MCP directory API, please join our Discord server