State Verifier — 3-Tier QA Coverage for SQUAD Products.
SUMA Testing Manifesto (sealed April 13, 2026):
200 OK is not a test. It is a rumor.
Every write operation must be followed by a database assertion.
Every endpoint is a button. Every button must have a test.
MODES:
READ (default):
Returns coverage report from testframe_reports DB.
Classifies gaps by tier and severity.
Identifies "shallow" tests (status-code-only, no DB assertion).
GENERATE (mode="generate"):
Uses OPTION C: SUMA graph (WHY/WHAT) + your code_context (HOW)
Generates test scaffolds in 3 tiers:
- Component: endpoint isolation, UI element presence
- Technical: DB state verification after API calls (State Verifier pattern)
- Functional: end-to-end business workflow with all-layer assertions
Requires code_context (paste the relevant file/endpoint code).
The 3-Tier taxonomy:
component → Single endpoint or UI element in isolation
technical → Database state AFTER API call (State Verifier)
functional → Complete business workflow, all layers verified
The gap severity taxonomy:
missing → No test exists (CRITICAL)
not_implemented → Planned but not written (HIGH)
shallow → Test exists but only checks HTTP status, no DB assertion (HIGH)
flaky → Non-deterministic (HIGH)
skipped → Marked skip/todo (MEDIUM)
dead_end → Tests a UI element that no longer exists (LOW, cleanup)
Args:
product: Product to query (e.g. "squad-suma-mcp", "squad-qms", "squad-ghostgate").
If omitted in READ mode, returns all products.
area: Filter by test area (e.g. "auth", "ingest", "assign"). Optional.
mode: "read" (default) or "generate" (AI test generation via Option C).
tier_filter: Filter by test tier — "component", "technical", or "functional".
If omitted, all tiers returned.
decision_graph: Hierarchical Tech Questionnaire (REQUIRED for generate mode). Structure:
{
"platform": {
"type": "web|android|ios|api|robotics",
"framework": "React|Flutter|FastAPI|etc",
"auth_mode": "GhostGate|GoogleSSO|JWT|none"
},
"database": {
"engine": "postgresql|sqlite|none",
"orm": "prisma|sqlalchemy|none",
"target_table": "table_name"
}
}
code_context: Optional raw code string to test (UI components, API routes).
ingest_snapshot: If True, saves coverage state as a K-WIL graph node.
Returns (READ mode):
overall_coverage_pct, products[], gaps_by_tier, shallow_tests, recommendation
Returns (GENERATE mode):
component_tests[], technical_tests[], functional_tests[], manifesto_violations[]