Skip to main content
Glama
charliemtnez

ghost-inspector-mcp

by charliemtnez

Ghost Inspector: stale versus genuinely broken

gi_stale_tests
Read-only

Identify stale test failures by detecting definition or module chain changes after the failing run, so genuine failures stand out. Also flags passing tests unverified by current definitions.

Instructions

Call this BEFORE diagnosing or editing any red test. Splits failures into two piles by comparing the whole execute chain's dateUpdated against each test's last run.

staleFailures are red tests whose definition or module chain changed AFTER the failing run. The failure describes a version that no longer exists — a colleague may already have fixed it and the test simply has not run again. Editing on top of one destroys their work, and Ghost Inspector keeps no version history of steps. One level deep is not enough here, because modules nest; the whole chain is walked.

genuineFailures have had no change since the failing run, so the failure still describes the current definition. Start there, oldest first.

šŸ”“ Re-running is not free advice: many Ghost Inspector suites submit real forms against production. Confirm what a test does before triggering it.

Also reports the case nobody looks for: passing tests whose chain changed after their last run, whose green result describes the old definition and proves nothing about the current one. Import-only modules are excluded rather than evaluated, since they have no results to compare against.

Costs one request per test, a few seconds for a few hundred tests.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
includePassesNoList the passing-but-unverified tests too. Off by default because it is the long bucket; the count is always reported.
Behavior5/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The description goes far beyond the readOnlyHint annotation, disclosing cost ('Costs one request per test, a few seconds for a few hundred tests'), algorithmic details (walking the whole module chain), and side-effect warnings about test re-runs. It also explains exclusions and the additional report of passing-but-unverified tests.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is longer than average but each sentence earns its place, covering trigger condition, failure categorization, warnings, exclusions, and cost. It is front-loaded with the key instruction and structured logically, making it dense but efficient.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's analytical complexity and the absence of an output schema, the description thoroughly explains the behavior, edge cases, costs, and expected results (staleFailures, genuineFailures, passing-unverified). It provides enough context for an agent to select and invoke the tool correctly.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage for the single parameter includePasses is 100%, with a clear description already. The tool description adds narrative context about passing tests but does not meaningfully enhance the parameter's meaning beyond what the schema provides. Baseline 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool's function: 'Splits failures into two piles by comparing the whole `execute` chain's `dateUpdated` against each test's last run.' The title and description distinguish it as a diagnostic classifier for stale versus genuine failures, setting it apart from sibling tools like gi_validate_test or gi_inventory.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines5/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Explicitly prescribes when to use: 'Call this BEFORE diagnosing or editing any red test.' It also gives actionable guidance on where to start ('Start there, oldest first'), and warns against unsafe re-running ('Confirm what a test does before triggering it'), covering both when-to and when-not-to.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Install Server

Other Tools

Latest Blog Posts

MCP directory API

We provide all the information about MCP servers via our MCP API.

curl -X GET 'https://glama.ai/api/mcp/v1/servers/charliemtnez/ghost-inspector-mcp'

If you have feedback or need assistance with the MCP directory API, please join our Discord server