Skip to main content
Glama

Validate Agent Architecture (Consensus Mode)

architect.validate_consensus

Pro/Teams: N-shot CONSENSUS doctrine review of agentic code. ON CLIENT TIMEOUT: DO NOT RETRY THIS TOOL. Long-running (~80-120s for N=3 parallel LLM calls); MCP clients often close the call before the server returns. Retrying re-runs N × 60-180s LLM calls from scratch and burns N× compute. RECOVERY: same heartbeat pattern as architect.validate, the run_id is emitted in the FIRST progress event at t=0s (before LLM children fire); on timeout, call me.validation_history(run_id='<that-id>') to fetch the persisted consensus envelope. Runs N parallel architect.validate calls with private_session=True, then aggregates them to a per-principle MODE verdict + median severity + per-principle stability + score range/stdev. Returns one ConsensusValidationResponse with the headline median score, the honest variance band, and a representative full ValidationResponse (the child whose score is closest to the median). WHEN TO CALL: the user wants an HONEST first-pass score on agentic code, with the architect's variance surfaced. The single-shot architect.validate re-asserts the prior persisted run's verdict via baseline-anchor injection: same code can score 60/C anchored vs 98/A unanchored. Consensus mode is the unanchored honest read. WHEN NOT TO CALL: when you NEED the iteration delta against a prior run (regressions/improvements panel), for that, call architect.validate which keeps baseline injection on. CHAIN RESUME: each child runs with private_session=True (no anchor) on purpose, but the CONSOLIDATED outer row IS persisted with lifecycle_status='completed', the next single-shot architect.validate on the same repository auto-resolves it as prior_run_baseline. Consensus checkpoint becomes the new anchor. See the architect-validation-orchestration skill in the agent-asset pack for the full validate → consensus → certify sequence. BEHAVIOR: N (default 3, max 5) parallel LLM calls run concurrently; wallclock ~80-120s for N=3 (max child latency, not sum). Cost = N × LLM bill. Each child runs with private_session=True so the doctrine prompt's prior-run baseline injection is suppressed (no anchor bias). One CONSOLIDATED UserValidationRun row is written carrying the consensus envelope; the N children themselves do NOT persist (private_session contract). AUTH: sign-in required, with an active Pro, Pro Plus, Teams, Enterprise, beta, or trial plan. Same paid-plan gate as architect.validate. INPUTS: same shape as architect.validate. n is the only extra arg (range 2..5). private_session is implicit (always true for children); the OUTER consolidated row IS persisted unless the tool itself is called inside another private context: but no such wrapper exists today. OUTPUT: response carries score_consensus_median (headline), score_stdev (honest uncertainty), score_range (min, max), mode_stability_min_pct (the cert-eligibility gate's input, ≥ 80% means the consensus is stable), per_principle (mode + distribution + severity median per principle), and representative_response (the closest-to-median child's full ValidationResponse so existing UI components render unchanged). TYPED FAILURES: same as architect.validate (timed_out, rate_limited, dependency_unavailable). Plus consensus-specific: consensus_quorum_failed when fewer than 2 child runs succeeded (≥ 2 required to compute a meaningful median).

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
nNoNumber of parallel child runs. Default 3 (the variance signal is visible at N=3; cost = 3× LLM bill). Capped server-side by Settings.consensus_n_max (default 5).
taskNoWhat the agent or workflow is trying to accomplish.
filesNoList of file paths relevant to the implementation.
goalsNoSpecific safety or quality goals to evaluate against.
languageNoProgramming language of the code (e.g. 'python').
focus_areaNoOptional: narrow the review to a principle cluster or slug.
repositoryNoIteration key. Consensus children all run unanchored (`private_session=True`), but the consolidated row IS persisted under this key: discoverable as prior baseline for the next single-shot `architect.validate`. Same value across calls keeps the iteration arc inspectable.
example_limitNoMax curated examples per child run.
implementation_contextYesThe artifact under review. SEND FULL FILE CONTENTS VERBATIM: same constraint as architect.validate. Truncation produces hallucinated findings on code that isn't there.

Output Schema

TableJSON Schema
NameRequiredDescriptionDefault

No arguments

Schema Changelog

Changes observed during successful MCP inspections.

  1. Changed2 schema fields changed
    • changedInput schema / properties / implementation_context / description
      Previous value: -"The artifact under review. SEND FULL FILE CONTENTS VERBATIM — same constraint as architect.validate. Truncation produces hallucinated findings on code that isn't there."New value: +"The artifact under review. SEND FULL FILE CONTENTS VERBATIM: same constraint as architect.validate. Truncation produces hallucinated findings on code that isn't there."
    • changedInput schema / properties / repository / description
      Previous value: -"Iteration key. Consensus children all run unanchored (`private_session=True`), but the consolidated row IS persisted under this key — discoverable as prior baseline for the next single-shot `architect.validate`. Same value across calls keeps the iteration arc inspectable."New value: +"Iteration key. Consensus children all run unanchored (`private_session=True`), but the consolidated row IS persisted under this key: discoverable as prior baseline for the next single-shot `architect.validate`. Same value across calls keeps the iteration arc inspectable."
  2. Changed1 schema field changed
    • changedInput schema / properties / repository / description
      Previous value: -"Repository name or path. Lets the consensus row group into the per-project history view alongside single-shot validate runs."New value: +"Iteration key. Consensus children all run unanchored (`private_session=True`), but the consolidated row IS persisted under this key — discoverable as prior baseline for the next single-shot `architect.validate`. Same value across calls keeps the iteration arc inspectable."
  3. Changed1 schema field changed
    • changedOutput schema / (root)
      Previous value: -nullNew value: +{
      +  "additionalProperties": true,
      +  "title": "validate_consensus_agent_architectureDictOutput",
      +  "type": "object"
      +}
  4. Changed1 schema field changed
    • changedOutput schema / (root)
      Previous value: -{
      -  "$defs": {
      -    "ArchitectFinding": {
      -      "description": "One per-principle finding from architect.validate.",
      -      "properties": {
      -        "confidence": {
      -          "anyOf": [
      -            {
      -              "type": "number"
      -            },
      -            {
      -              "type": "null"
      -            }
      -          ],
      -          "title": "Confidence"
      -        },
      -        "evidence": {
      -          "anyOf": [
      -            {
      -              "type": "string"
      -            },
      -            {
      -              "type": "null"
      -            }
      -          ],
      -          "title": "Evidence"
      -        },
      -        "evidence_quality": {
      -          "anyOf": [
      -            {
      -              "type": "string"
      -            },
      -            {
      -              "type": "null"
      -            }
      -          ],
      -          "title": "Evidence Quality"
      -        },
      -        "principle_id": {
      -          "title": "Principle Id",
      -          "type": "integer"
      -        },
      -        "recommendation": {
      -          "anyOf": [
      -            {
      -              "type": "string"
      -            },
      -            {
      -              "type": "null"
      -            }
      -          ],
      -          "title": "Recommendation"
      -        },
      -        "severity_class": {
      -          "anyOf": [
      -            {
      -              "type": "string"
      -            },
      -            {
      -              "type": "null"
      -            }
      -          ],
      -          "title": "Severity Class"
      -        },
      -        "severity_score": {
      -          "anyOf": [
      -            {
      -              "type": "integer"
      -            },
      -            {
      -              "type": "null"
      -            }
      -          ],
      -          "title": "Severity Score"
      -        },
      -        "slug": {
      -          "title": "Slug",
      -          "type": "string"
      -        },
      -        "title": {
      -          "title": "Title",
      -          "type": "string"
      -        },
      -        "verdict": {
      -          "title": "Verdict",
      -          "type": "string"
      -        }
      -      },
      -      "title": "ArchitectFinding",
      -      "type": "object"
      -    },
      -    "ArchitectReadiness": {
      -      "description": "Readiness rubric output (score / grade / tier / breakdown).",
      -      "properties": {
      -        "aligned": {
      -          "title": "Aligned",
      -          "type": "integer"
      -        },
      -        "applicable": {
      -          "title": "Applicable",
      -          "type": "integer"
      -        },
      -        "grade": {
      -          "title": "Grade",
      -          "type": "string"
      -        },
      -        "grade_capped_by_certification": {
      -          "title": "Grade Capped By Certification",
      -          "type": "boolean"
      -        },
      -        "grade_capped_by_high_risk": {
      -          "title": "Grade Capped By High Risk",
      -          "type": "boolean"
      -        },
      -        "hardening_recommended": {
      -          "title": "Hardening Recommended",
      -          "type": "integer"
      -        },
      -        "high_risk": {
      -          "title": "High Risk",
      -          "type": "integer"
      -        },
      -        "mixed": {
      -          "title": "Mixed",
      -          "type": "integer"
      -        },
      -        "needs_changes": {
      -          "title": "Needs Changes",
      -          "type": "integer"
      -        },
      -        "not_applicable": {
      -          "title": "Not Applicable",
      -          "type": "integer"
      -        },
      -        "polish": {
      -          "title": "Polish",
      -          "type": "integer"
      -        },
      -        "production_blocker": {
      -          "title": "Production Blocker",
      -          "type": "integer"
      -        },
      -        "rubric_version": {
      -          "title": "Rubric Version",
      -          "type": "string"
      -        },
      -        "score": {
      -          "title": "Score",
      -          "type": "integer"
      -        },
      -        "tier": {
      -          "title": "Tier",
      -          "type": "string"
      -        }
      -      },
      -      "title": "ArchitectReadiness",
      -      "type": "object"
      -    },
      -    "ErrorBody": {
      -      "description": "The body of `error_payload(code, message, details)` returns.",
      -      "properties": {
      -        "code": {
      -          "title": "Code",
      -          "type": "string"
      -        },
      -        "details": {
      -          "additionalProperties": true,
      -          "title": "Details",
      -          "type": "object"
      -        },
      -        "message": {
      -          "title": "Message",
      -          "type": "string"
      -        }
      -      },
      -      "title": "ErrorBody",
      -      "type": "object"
      -    }
      -  },
      -  "properties": {
      -    "assessment_status": {
      -      "anyOf": [
      -        {
      -          "type": "string"
      -        },
      -        {
      -          "type": "null"
      -        }
      -      ],
      -      "default": null,
      -      "title": "Assessment Status"
      -    },
      -    "assessment_summary": {
      -      "anyOf": [
      -        {
      -          "type": "string"
      -        },
      -        {
      -          "type": "null"
      -        }
      -      ],
      -      "default": null,
      -      "title": "Assessment Summary"
      -    },
      -    "badge_url": {
      -      "default": null,
      -      "title": "Badge Url",
      -      "type": "string"
      -    },
      -    "baseline_compatibility": {
      -      "anyOf": [
      -        {
      -          "type": "string"
      -        },
      -        {
      -          "type": "null"
      -        }
      -      ],
      -      "default": null,
      -      "title": "Baseline Compatibility"
      -    },
      -    "baseline_race_status": {
      -      "anyOf": [
      -        {
      -          "type": "string"
      -        },
      -        {
      -          "type": "null"
      -        }
      -      ],
      -      "default": null,
      -      "title": "Baseline Race Status"
      -    },
      -    "baseline_status": {
      -      "anyOf": [
      -        {
      -          "type": "string"
      -        },
      -        {
      -          "type": "null"
      -        }
      -      ],
      -      "default": null,
      -      "title": "Baseline Status"
      -    },
      -    "card_badge_url": {
      -      "default": null,
      -      "title": "Card Badge Url",
      -      "type": "string"
      -    },
      -    "certification_attempts_count": {
      -      "default": null,
      -      "title": "Certification Attempts Count",
      -      "type": "integer"
      -    },
      -    "certification_blocker_reason": {
      -      "anyOf": [
      -        {
      -          "type": "string"
      -        },
      -        {
      -          "type": "null"
      -        }
      -      ],
      -      "default": null,
      -      "title": "Certification Blocker Reason"
      -    },
      -    "certification_findings": {
      -      "default": null,
      -      "items": {
      -        "additionalProperties": true,
      -        "type": "object"
      -      },
      -      "title": "Certification Findings",
      -      "type": "array"
      -    },
      -    "certification_status": {
      -      "anyOf": [
      -        {
      -          "type": "string"
      -        },
      -        {
      -          "type": "null"
      -        }
      -      ],
      -      "default": null,
      -      "title": "Certification Status"
      -    },
      -    "certification_summary": {
      -      "anyOf": [
      -        {
      -          "type": "string"
      -        },
      -        {
      -          "type": "null"
      -        }
      -      ],
      -      "default": null,
      -      "title": "Certification Summary"
      -    },
      -    "code_classification_category": {
      -      "anyOf": [
      -        {
      -          "type": "string"
      -        },
      -        {
      -          "type": "null"
      -        }
      -      ],
      -      "default": null,
      -      "title": "Code Classification Category"
      -    },
      -    "code_classification_rationale": {
      -      "anyOf": [
      -        {
      -          "type": "string"
      -        },
      -        {
      -          "type": "null"
      -        }
      -      ],
      -      "default": null,
      -      "title": "Code Classification Rationale"
      -    },
      -    "consensus_method": {
      -      "default": null,
      -      "title": "Consensus Method",
      -      "type": "string"
      -    },
      -    "consensus_pass_count": {
      -      "default": null,
      -      "title": "Consensus Pass Count",
      -      "type": "integer"
      -    },
      -    "consensus_runs": {
      -      "default": null,
      -      "items": {
      -        "additionalProperties": true,
      -        "type": "object"
      -      },
      -      "title": "Consensus Runs",
      -      "type": "array"
      -    },
      -    "created_at": {
      -      "default": null,
      -      "title": "Created At",
      -      "type": "string"
      -    },
      -    "error": {
      -      "$ref": "#/$defs/ErrorBody",
      -      "default": null
      -    },
      -    "focus_area": {
      -      "anyOf": [
      -        {
      -          "type": "string"
      -        },
      -        {
      -          "type": "null"
      -        }
      -      ],
      -      "default": null,
      -      "title": "Focus Area"
      -    },
      -    "improvements": {
      -      "default": null,
      -      "items": {
      -        "additionalProperties": true,
      -        "type": "object"
      -      },
      -      "title": "Improvements",
      -      "type": "array"
      -    },
      -    "matched_principles": {
      -      "default": null,
      -      "items": {
      -        "$ref": "#/$defs/ArchitectFinding"
      -      },
      -      "title": "Matched Principles",
      -      "type": "array"
      -    },
      -    "next_step": {
      -      "anyOf": [
      -        {
      -          "additionalProperties": true,
      -          "type": "object"
      -        },
      -        {
      -          "type": "null"
      -        }
      -      ],
      -      "default": null,
      -      "title": "Next Step"
      -    },
      -    "overall_status": {
      -      "default": null,
      -      "title": "Overall Status",
      -      "type": "string"
      -    },
      -    "principles_aligned": {
      -      "default": null,
      -      "title": "Principles Aligned",
      -      "type": "integer"
      -    },
      -    "principles_evaluated": {
      -      "default": null,
      -      "title": "Principles Evaluated",
      -      "type": "integer"
      -    },
      -    "prior_run_id": {
      -      "anyOf": [
      -        {
      -          "type": "string"
      -        },
      -        {
      -          "type": "null"
      -        }
      -      ],
      -      "default": null,
      -      "title": "Prior Run Id"
      -    },
      -    "public_review_url": {
      -      "default": null,
      -      "title": "Public Review Url",
      -      "type": "string"
      -    },
      -    "readiness": {
      -      "anyOf": [
      -        {
      -          "$ref": "#/$defs/ArchitectReadiness"
      -        },
      -        {
      -          "type": "null"
      -        }
      -      ],
      -      "default": null
      -    },
      -    "regressions": {
      -      "default": null,
      -      "items": {
      -        "additionalProperties": true,
      -        "type": "object"
      -      },
      -      "title": "Regressions",
      -      "type": "array"
      -    },
      -    "run_id": {
      -      "default": null,
      -      "title": "Run Id",
      -      "type": "string"
      -    },
      -    "tier": {
      -      "anyOf": [
      -        {
      -          "type": "string"
      -        },
      -        {
      -          "type": "null"
      -        }
      -      ],
      -      "default": null,
      -      "title": "Tier"
      -    }
      -  },
      -  "title": "ArchitectValidateConsensusResponse",
      -  "type": "object"
      -}New value: +null
  5. Changed1 schema field changed
    • changedOutput schema / (root)
      Previous value: -nullNew value: +{
      +  "$defs": {
      +    "ArchitectFinding": {
      +      "description": "One per-principle finding from architect.validate.",
      +      "properties": {
      +        "confidence": {
      +          "anyOf": [
      +            {
      +              "type": "number"
      +            },
      +            {
      +              "type": "null"
      +            }
      +          ],
      +          "title": "Confidence"
      +        },
      +        "evidence": {
      +          "anyOf": [
      +            {
      +              "type": "string"
      +            },
      +            {
      +              "type": "null"
      +            }
      +          ],
      +          "title": "Evidence"
      +        },
      +        "evidence_quality": {
      +          "anyOf": [
      +            {
      +              "type": "string"
      +            },
      +            {
      +              "type": "null"
      +            }
      +          ],
      +          "title": "Evidence Quality"
      +        },
      +        "principle_id": {
      +          "title": "Principle Id",
      +          "type": "integer"
      +        },
      +        "recommendation": {
      +          "anyOf": [
      +            {
      +              "type": "string"
      +            },
      +            {
      +              "type": "null"
      +            }
      +          ],
      +          "title": "Recommendation"
      +        },
      +        "severity_class": {
      +          "anyOf": [
      +            {
      +              "type": "string"
      +            },
      +            {
      +              "type": "null"
      +            }
      +          ],
      +          "title": "Severity Class"
      +        },
      +        "severity_score": {
      +          "anyOf": [
      +            {
      +              "type": "integer"
      +            },
      +            {
      +              "type": "null"
      +            }
      +          ],
      +          "title": "Severity Score"
      +        },
      +        "slug": {
      +          "title": "Slug",
      +          "type": "string"
      +        },
      +        "title": {
      +          "title": "Title",
      +          "type": "string"
      +        },
      +        "verdict": {
      +          "title": "Verdict",
      +          "type": "string"
      +        }
      +      },
      +      "title": "ArchitectFinding",
      +      "type": "object"
      +    },
      +    "ArchitectReadiness": {
      +      "description": "Readiness rubric output (score / grade / tier / breakdown).",
      +      "properties": {
      +        "aligned": {
      +          "title": "Aligned",
      +          "type": "integer"
      +        },
      +        "applicable": {
      +          "title": "Applicable",
      +          "type": "integer"
      +        },
      +        "grade": {
      +          "title": "Grade",
      +          "type": "string"
      +        },
      +        "grade_capped_by_certification": {
      +          "title": "Grade Capped By Certification",
      +          "type": "boolean"
      +        },
      +        "grade_capped_by_high_risk": {
      +          "title": "Grade Capped By High Risk",
      +          "type": "boolean"
      +        },
      +        "hardening_recommended": {
      +          "title": "Hardening Recommended",
      +          "type": "integer"
      +        },
      +        "high_risk": {
      +          "title": "High Risk",
      +          "type": "integer"
      +        },
      +        "mixed": {
      +          "title": "Mixed",
      +          "type": "integer"
      +        },
      +        "needs_changes": {
      +          "title": "Needs Changes",
      +          "type": "integer"
      +        },
      +        "not_applicable": {
      +          "title": "Not Applicable",
      +          "type": "integer"
      +        },
      +        "polish": {
      +          "title": "Polish",
      +          "type": "integer"
      +        },
      +        "production_blocker": {
      +          "title": "Production Blocker",
      +          "type": "integer"
      +        },
      +        "rubric_version": {
      +          "title": "Rubric Version",
      +          "type": "string"
      +        },
      +        "score": {
      +          "title": "Score",
      +          "type": "integer"
      +        },
      +        "tier": {
      +          "title": "Tier",
      +          "type": "string"
      +        }
      +      },
      +      "title": "ArchitectReadiness",
      +      "type": "object"
      +    },
      +    "ErrorBody": {
      +      "description": "The body of `error_payload(code, message, details)` returns.",
      +      "properties": {
      +        "code": {
      +          "title": "Code",
      +          "type": "string"
      +        },
      +        "details": {
      +          "additionalProperties": true,
      +          "title": "Details",
      +          "type": "object"
      +        },
      +        "message": {
      +          "title": "Message",
      +          "type": "string"
      +        }
      +      },
      +      "title": "ErrorBody",
      +      "type": "object"
      +    }
      +  },
      +  "properties": {
      +    "assessment_status": {
      +      "anyOf": [
      +        {
      +          "type": "string"
      +        },
      +        {
      +          "type": "null"
      +        }
      +      ],
      +      "default": null,
      +      "title": "Assessment Status"
      +    },
      +    "assessment_summary": {
      +      "anyOf": [
      +        {
      +          "type": "string"
      +        },
      +        {
      +          "type": "null"
      +        }
      +      ],
      +      "default": null,
      +      "title": "Assessment Summary"
      +    },
      +    "badge_url": {
      +      "default": null,
      +      "title": "Badge Url",
      +      "type": "string"
      +    },
      +    "baseline_compatibility": {
      +      "anyOf": [
      +        {
      +          "type": "string"
      +        },
      +        {
      +          "type": "null"
      +        }
      +      ],
      +      "default": null,
      +      "title": "Baseline Compatibility"
      +    },
      +    "baseline_race_status": {
      +      "anyOf": [
      +        {
      +          "type": "string"
      +        },
      +        {
      +          "type": "null"
      +        }
      +      ],
      +      "default": null,
      +      "title": "Baseline Race Status"
      +    },
      +    "baseline_status": {
      +      "anyOf": [
      +        {
      +          "type": "string"
      +        },
      +        {
      +          "type": "null"
      +        }
      +      ],
      +      "default": null,
      +      "title": "Baseline Status"
      +    },
      +    "card_badge_url": {
      +      "default": null,
      +      "title": "Card Badge Url",
      +      "type": "string"
      +    },
      +    "certification_attempts_count": {
      +      "default": null,
      +      "title": "Certification Attempts Count",
      +      "type": "integer"
      +    },
      +    "certification_blocker_reason": {
      +      "anyOf": [
      +        {
      +          "type": "string"
      +        },
      +        {
      +          "type": "null"
      +        }
      +      ],
      +      "default": null,
      +      "title": "Certification Blocker Reason"
      +    },
      +    "certification_findings": {
      +      "default": null,
      +      "items": {
      +        "additionalProperties": true,
      +        "type": "object"
      +      },
      +      "title": "Certification Findings",
      +      "type": "array"
      +    },
      +    "certification_status": {
      +      "anyOf": [
      +        {
      +          "type": "string"
      +        },
      +        {
      +          "type": "null"
      +        }
      +      ],
      +      "default": null,
      +      "title": "Certification Status"
      +    },
      +    "certification_summary": {
      +      "anyOf": [
      +        {
      +          "type": "string"
      +        },
      +        {
      +          "type": "null"
      +        }
      +      ],
      +      "default": null,
      +      "title": "Certification Summary"
      +    },
      +    "code_classification_category": {
      +      "anyOf": [
      +        {
      +          "type": "string"
      +        },
      +        {
      +          "type": "null"
      +        }
      +      ],
      +      "default": null,
      +      "title": "Code Classification Category"
      +    },
      +    "code_classification_rationale": {
      +      "anyOf": [
      +        {
      +          "type": "string"
      +        },
      +        {
      +          "type": "null"
      +        }
      +      ],
      +      "default": null,
      +      "title": "Code Classification Rationale"
      +    },
      +    "consensus_method": {
      +      "default": null,
      +      "title": "Consensus Method",
      +      "type": "string"
      +    },
      +    "consensus_pass_count": {
      +      "default": null,
      +      "title": "Consensus Pass Count",
      +      "type": "integer"
      +    },
      +    "consensus_runs": {
      +      "default": null,
      +      "items": {
      +        "additionalProperties": true,
      +        "type": "object"
      +      },
      +      "title": "Consensus Runs",
      +      "type": "array"
      +    },
      +    "created_at": {
      +      "default": null,
      +      "title": "Created At",
      +      "type": "string"
      +    },
      +    "error": {
      +      "$ref": "#/$defs/ErrorBody",
      +      "default": null
      +    },
      +    "focus_area": {
      +      "anyOf": [
      +        {
      +          "type": "string"
      +        },
      +        {
      +          "type": "null"
      +        }
      +      ],
      +      "default": null,
      +      "title": "Focus Area"
      +    },
      +    "improvements": {
      +      "default": null,
      +      "items": {
      +        "additionalProperties": true,
      +        "type": "object"
      +      },
      +      "title": "Improvements",
      +      "type": "array"
      +    },
      +    "matched_principles": {
      +      "default": null,
      +      "items": {
      +        "$ref": "#/$defs/ArchitectFinding"
      +      },
      +      "title": "Matched Principles",
      +      "type": "array"
      +    },
      +    "next_step": {
      +      "anyOf": [
      +        {
      +          "additionalProperties": true,
      +          "type": "object"
      +        },
      +        {
      +          "type": "null"
      +        }
      +      ],
      +      "default": null,
      +      "title": "Next Step"
      +    },
      +    "overall_status": {
      +      "default": null,
      +      "title": "Overall Status",
      +      "type": "string"
      +    },
      +    "principles_aligned": {
      +      "default": null,
      +      "title": "Principles Aligned",
      +      "type": "integer"
      +    },
      +    "principles_evaluated": {
      +      "default": null,
      +      "title": "Principles Evaluated",
      +      "type": "integer"
      +    },
      +    "prior_run_id": {
      +      "anyOf": [
      +        {
      +          "type": "string"
      +        },
      +        {
      +          "type": "null"
      +        }
      +      ],
      +      "default": null,
      +      "title": "Prior Run Id"
      +    },
      +    "public_review_url": {
      +      "default": null,
      +      "title": "Public Review Url",
      +      "type": "string"
      +    },
      +    "readiness": {
      +      "anyOf": [
      +        {
      +          "$ref": "#/$defs/ArchitectReadiness"
      +        },
      +        {
      +          "type": "null"
      +        }
      +      ],
      +      "default": null
      +    },
      +    "regressions": {
      +      "default": null,
      +      "items": {
      +        "additionalProperties": true,
      +        "type": "object"
      +      },
      +      "title": "Regressions",
      +      "type": "array"
      +    },
      +    "run_id": {
      +      "default": null,
      +      "title": "Run Id",
      +      "type": "string"
      +    },
      +    "tier": {
      +      "anyOf": [
      +        {
      +          "type": "string"
      +        },
      +        {
      +          "type": "null"
      +        }
      +      ],
      +      "default": null,
      +      "title": "Tier"
      +    }
      +  },
      +  "title": "ArchitectValidateConsensusResponse",
      +  "type": "object"
      +}
  6. Added

TDQS

A4.8/5.0
Behavior5/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The description goes far beyond the annotations. It discloses the long-running nature (~80-120s), the N parallel LLM calls, the cost multiplier (N × LLM bill), the private_session=True behavior for children, the persistence contract (children do not persist, the consolidated row does), the auth gate, and the typed failure modes including consensus_quorum_failed. It even warns about MCP client timeout behavior and provides a recovery path. This is exemplary behavioral disclosure.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is long but every section earns its place: timeout warning, recovery, when-to-call, when-not-to-call, behavior, auth, inputs, outputs, typed failures. It is front-loaded with the most critical operational warning (DO NOT RETRY ON TIMEOUT) and structured with clear section labels. It could be slightly tighter, but the density of actionable information justifies the length.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a complex tool with 9 parameters, an output schema, and significant operational risk, the description is complete. It explains the output fields (score_consensus_median, score_stdev, score_range, mode_stability_min_pct, per_principle, representative_response), the failure modes, the auth requirements, the persistence semantics, and the relationship to the sibling architect.validate. Nothing an agent needs to call it correctly is missing.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so the baseline is 3. The description adds value by explaining the semantics of key parameters: n (range 2..5, default 3, cost implication), repository (iteration key, persisted as prior baseline), and implementation_context (send full file contents verbatim, truncation causes hallucinated findings). It also clarifies that private_session is implicit for children. The only minor gap is that it doesn't enumerate every parameter, but the schema already covers them.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description opens with a specific verb and resource: 'N-shot CONSENSUS doctrine review of agentic code.' It clearly distinguishes consensus mode from the single-shot architect.validate by explaining the anchoring difference (60/C anchored vs 98/A unanchored). The tool's purpose is unmistakable and differentiated from siblings.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines5/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides explicit WHEN TO CALL and WHEN NOT TO CALL sections. It names the alternative (architect.validate) and the exact condition that selects it: use consensus when the user wants an honest unanchored first-pass score; use single-shot validate when iteration delta against a prior run is needed. It also gives recovery guidance on timeout, which is a usage condition.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.

Resources