Ghost Inspector: stale versus genuinely broken
gi_stale_testsIdentify stale test failures by detecting definition or module chain changes after the failing run, so genuine failures stand out. Also flags passing tests unverified by current definitions.
Instructions
Call this BEFORE diagnosing or editing any red test. Splits failures into two piles by comparing the whole execute chain's dateUpdated against each test's last run.
staleFailures are red tests whose definition or module chain changed AFTER the failing run. The failure describes a version that no longer exists ā a colleague may already have fixed it and the test simply has not run again. Editing on top of one destroys their work, and Ghost Inspector keeps no version history of steps. One level deep is not enough here, because modules nest; the whole chain is walked.
genuineFailures have had no change since the failing run, so the failure still describes the current definition. Start there, oldest first.
š“ Re-running is not free advice: many Ghost Inspector suites submit real forms against production. Confirm what a test does before triggering it.
Also reports the case nobody looks for: passing tests whose chain changed after their last run, whose green result describes the old definition and proves nothing about the current one. Import-only modules are excluded rather than evaluated, since they have no results to compare against.
Costs one request per test, a few seconds for a few hundred tests.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| includePasses | No | List the passing-but-unverified tests too. Off by default because it is the long bucket; the count is always reported. |