Skip to main content
Glama

AI Design Blueprint Doctrine

Validate Agent Architecture (Consensus Mode)

architect.validate_consensus

Pro/Teams — N-shot CONSENSUS doctrine review of agentic code. ON CLIENT TIMEOUT — DO NOT RETRY THIS TOOL. Long-running (~80-120s for N=3 parallel LLM calls); MCP clients often close the call before the server returns. Retrying re-runs N × 60-180s LLM calls from scratch and burns N× compute. RECOVERY: same heartbeat pattern as architect.validate — the run_id is emitted in the FIRST progress event at t=0s (before LLM children fire); on timeout, call me.validation_history(run_id='<that-id>') to fetch the persisted consensus envelope. Runs N parallel architect.validate calls with private_session=True, then aggregates them to a per-principle MODE verdict + median severity + per-principle stability + score range/stdev. Returns one ConsensusValidationResponse with the headline median score, the honest variance band, and a representative full ValidationResponse (the child whose score is closest to the median). WHEN TO CALL: the user wants an HONEST first-pass score on agentic code, with the architect's variance surfaced. The single-shot architect.validate re-asserts the prior persisted run's verdict via baseline-anchor injection — same code can score 60/C anchored vs 98/A unanchored. Consensus mode is the unanchored honest read. WHEN NOT TO CALL: when you NEED the iteration delta against a prior run (regressions/improvements panel) — for that, call architect.validate which keeps baseline injection on. CHAIN RESUME: each child runs with private_session=True (no anchor) on purpose, but the CONSOLIDATED outer row IS persisted with lifecycle_status='completed' — the next single-shot architect.validate on the same repository auto-resolves it as prior_run_baseline. Consensus checkpoint becomes the new anchor. See the architect-validation-orchestration skill in the agent-asset pack for the full validate → consensus → certify sequence. BEHAVIOR: N (default 3, max 5) parallel LLM calls run concurrently; wallclock ~80-120s for N=3 (max child latency, not sum). Cost = N × LLM bill. Each child runs with private_session=True so the doctrine prompt's prior-run baseline injection is suppressed (no anchor bias). One CONSOLIDATED UserValidationRun row is written carrying the consensus envelope; the N children themselves do NOT persist (private_session contract). AUTH: sign-in required, with an active Pro, Pro Plus, Teams, Enterprise, beta, or trial plan. Same paid-plan gate as architect.validate. INPUTS: same shape as architect.validate. n is the only extra arg (range 2..5). private_session is implicit (always true for children); the OUTER consolidated row IS persisted unless the tool itself is called inside another private context — but no such wrapper exists today. OUTPUT: response carries score_consensus_median (headline), score_stdev (honest uncertainty), score_range (min, max), mode_stability_min_pct (the cert-eligibility gate's input — ≥ 80% means the consensus is stable), per_principle (mode + distribution + severity median per principle), and representative_response (the closest-to-median child's full ValidationResponse so existing UI components render unchanged). TYPED FAILURES: same as architect.validate (timed_out, rate_limited, dependency_unavailable). Plus consensus-specific: consensus_quorum_failed when fewer than 2 child runs succeeded (≥ 2 required to compute a meaningful median).

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
nNoNumber of parallel child runs. Default 3 (the variance signal is visible at N=3; cost = 3× LLM bill). Capped server-side by Settings.consensus_n_max (default 5).
taskNoWhat the agent or workflow is trying to accomplish.
filesNoList of file paths relevant to the implementation.
goalsNoSpecific safety or quality goals to evaluate against.
languageNoProgramming language of the code (e.g. 'python').
focus_areaNoOptional: narrow the review to a principle cluster or slug.
repositoryNoIteration key. Consensus children all run unanchored (`private_session=True`), but the consolidated row IS persisted under this key — discoverable as prior baseline for the next single-shot `architect.validate`. Same value across calls keeps the iteration arc inspectable.
example_limitNoMax curated examples per child run.
implementation_contextYesThe artifact under review. SEND FULL FILE CONTENTS VERBATIM — same constraint as architect.validate. Truncation produces hallucinated findings on code that isn't there.

Output Schema

TableJSON Schema
NameRequiredDescriptionDefault

No arguments

Schema Changelog

Changes observed during successful MCP inspections.

  1. Changed1 schema field changed
    • changedInput schema / properties / repository / description
      Previous value: -"Repository name or path. Lets the consensus row group into the per-project history view alongside single-shot validate runs."New value: +"Iteration key. Consensus children all run unanchored (`private_session=True`), but the consolidated row IS persisted under this key — discoverable as prior baseline for the next single-shot `architect.validate`. Same value across calls keeps the iteration arc inspectable."
  2. Changed1 schema field changed
    • changedOutput schema / (root)
      Previous value: -nullNew value: +{
      +  "additionalProperties": true,
      +  "title": "validate_consensus_agent_architectureDictOutput",
      +  "type": "object"
      +}
  3. Changed1 schema field changed
    • changedOutput schema / (root)
      Previous value: -{
      -  "$defs": {
      -    "ArchitectFinding": {
      -      "description": "One per-principle finding from architect.validate.",
      -      "properties": {
      -        "confidence": {
      -          "anyOf": [
      -            {
      -              "type": "number"
      -            },
      -            {
      -              "type": "null"
      -            }
      -          ],
      -          "title": "Confidence"
      -        },
      -        "evidence": {
      -          "anyOf": [
      -            {
      -              "type": "string"
      -            },
      -            {
      -              "type": "null"
      -            }
      -          ],
      -          "title": "Evidence"
      -        },
      -        "evidence_quality": {
      -          "anyOf": [
      -            {
      -              "type": "string"
      -            },
      -            {
      -              "type": "null"
      -            }
      -          ],
      -          "title": "Evidence Quality"
      -        },
      -        "principle_id": {
      -          "title": "Principle Id",
      -          "type": "integer"
      -        },
      -        "recommendation": {
      -          "anyOf": [
      -            {
      -              "type": "string"
      -            },
      -            {
      -              "type": "null"
      -            }
      -          ],
      -          "title": "Recommendation"
      -        },
      -        "severity_class": {
      -          "anyOf": [
      -            {
      -              "type": "string"
      -            },
      -            {
      -              "type": "null"
      -            }
      -          ],
      -          "title": "Severity Class"
      -        },
      -        "severity_score": {
      -          "anyOf": [
      -            {
      -              "type": "integer"
      -            },
      -            {
      -              "type": "null"
      -            }
      -          ],
      -          "title": "Severity Score"
      -        },
      -        "slug": {
      -          "title": "Slug",
      -          "type": "string"
      -        },
      -        "title": {
      -          "title": "Title",
      -          "type": "string"
      -        },
      -        "verdict": {
      -          "title": "Verdict",
      -          "type": "string"
      -        }
      -      },
      -      "title": "ArchitectFinding",
      -      "type": "object"
      -    },
      -    "ArchitectReadiness": {
      -      "description": "Readiness rubric output (score / grade / tier / breakdown).",
      -      "properties": {
      -        "aligned": {
      -          "title": "Aligned",
      -          "type": "integer"
      -        },
      -        "applicable": {
      -          "title": "Applicable",
      -          "type": "integer"
      -        },
      -        "grade": {
      -          "title": "Grade",
      -          "type": "string"
      -        },
      -        "grade_capped_by_certification": {
      -          "title": "Grade Capped By Certification",
      -          "type": "boolean"
      -        },
      -        "grade_capped_by_high_risk": {
      -          "title": "Grade Capped By High Risk",
      -          "type": "boolean"
      -        },
      -        "hardening_recommended": {
      -          "title": "Hardening Recommended",
      -          "type": "integer"
      -        },
      -        "high_risk": {
      -          "title": "High Risk",
      -          "type": "integer"
      -        },
      -        "mixed": {
      -          "title": "Mixed",
      -          "type": "integer"
      -        },
      -        "needs_changes": {
      -          "title": "Needs Changes",
      -          "type": "integer"
      -        },
      -        "not_applicable": {
      -          "title": "Not Applicable",
      -          "type": "integer"
      -        },
      -        "polish": {
      -          "title": "Polish",
      -          "type": "integer"
      -        },
      -        "production_blocker": {
      -          "title": "Production Blocker",
      -          "type": "integer"
      -        },
      -        "rubric_version": {
      -          "title": "Rubric Version",
      -          "type": "string"
      -        },
      -        "score": {
      -          "title": "Score",
      -          "type": "integer"
      -        },
      -        "tier": {
      -          "title": "Tier",
      -          "type": "string"
      -        }
      -      },
      -      "title": "ArchitectReadiness",
      -      "type": "object"
      -    },
      -    "ErrorBody": {
      -      "description": "The body of `error_payload(code, message, details)` returns.",
      -      "properties": {
      -        "code": {
      -          "title": "Code",
      -          "type": "string"
      -        },
      -        "details": {
      -          "additionalProperties": true,
      -          "title": "Details",
      -          "type": "object"
      -        },
      -        "message": {
      -          "title": "Message",
      -          "type": "string"
      -        }
      -      },
      -      "title": "ErrorBody",
      -      "type": "object"
      -    }
      -  },
      -  "properties": {
      -    "assessment_status": {
      -      "anyOf": [
      -        {
      -          "type": "string"
      -        },
      -        {
      -          "type": "null"
      -        }
      -      ],
      -      "default": null,
      -      "title": "Assessment Status"
      -    },
      -    "assessment_summary": {
      -      "anyOf": [
      -        {
      -          "type": "string"
      -        },
      -        {
      -          "type": "null"
      -        }
      -      ],
      -      "default": null,
      -      "title": "Assessment Summary"
      -    },
      -    "badge_url": {
      -      "default": null,
      -      "title": "Badge Url",
      -      "type": "string"
      -    },
      -    "baseline_compatibility": {
      -      "anyOf": [
      -        {
      -          "type": "string"
      -        },
      -        {
      -          "type": "null"
      -        }
      -      ],
      -      "default": null,
      -      "title": "Baseline Compatibility"
      -    },
      -    "baseline_race_status": {
      -      "anyOf": [
      -        {
      -          "type": "string"
      -        },
      -        {
      -          "type": "null"
      -        }
      -      ],
      -      "default": null,
      -      "title": "Baseline Race Status"
      -    },
      -    "baseline_status": {
      -      "anyOf": [
      -        {
      -          "type": "string"
      -        },
      -        {
      -          "type": "null"
      -        }
      -      ],
      -      "default": null,
      -      "title": "Baseline Status"
      -    },
      -    "card_badge_url": {
      -      "default": null,
      -      "title": "Card Badge Url",
      -      "type": "string"
      -    },
      -    "certification_attempts_count": {
      -      "default": null,
      -      "title": "Certification Attempts Count",
      -      "type": "integer"
      -    },
      -    "certification_blocker_reason": {
      -      "anyOf": [
      -        {
      -          "type": "string"
      -        },
      -        {
      -          "type": "null"
      -        }
      -      ],
      -      "default": null,
      -      "title": "Certification Blocker Reason"
      -    },
      -    "certification_findings": {
      -      "default": null,
      -      "items": {
      -        "additionalProperties": true,
      -        "type": "object"
      -      },
      -      "title": "Certification Findings",
      -      "type": "array"
      -    },
      -    "certification_status": {
      -      "anyOf": [
      -        {
      -          "type": "string"
      -        },
      -        {
      -          "type": "null"
      -        }
      -      ],
      -      "default": null,
      -      "title": "Certification Status"
      -    },
      -    "certification_summary": {
      -      "anyOf": [
      -        {
      -          "type": "string"
      -        },
      -        {
      -          "type": "null"
      -        }
      -      ],
      -      "default": null,
      -      "title": "Certification Summary"
      -    },
      -    "code_classification_category": {
      -      "anyOf": [
      -        {
      -          "type": "string"
      -        },
      -        {
      -          "type": "null"
      -        }
      -      ],
      -      "default": null,
      -      "title": "Code Classification Category"
      -    },
      -    "code_classification_rationale": {
      -      "anyOf": [
      -        {
      -          "type": "string"
      -        },
      -        {
      -          "type": "null"
      -        }
      -      ],
      -      "default": null,
      -      "title": "Code Classification Rationale"
      -    },
      -    "consensus_method": {
      -      "default": null,
      -      "title": "Consensus Method",
      -      "type": "string"
      -    },
      -    "consensus_pass_count": {
      -      "default": null,
      -      "title": "Consensus Pass Count",
      -      "type": "integer"
      -    },
      -    "consensus_runs": {
      -      "default": null,
      -      "items": {
      -        "additionalProperties": true,
      -        "type": "object"
      -      },
      -      "title": "Consensus Runs",
      -      "type": "array"
      -    },
      -    "created_at": {
      -      "default": null,
      -      "title": "Created At",
      -      "type": "string"
      -    },
      -    "error": {
      -      "$ref": "#/$defs/ErrorBody",
      -      "default": null
      -    },
      -    "focus_area": {
      -      "anyOf": [
      -        {
      -          "type": "string"
      -        },
      -        {
      -          "type": "null"
      -        }
      -      ],
      -      "default": null,
      -      "title": "Focus Area"
      -    },
      -    "improvements": {
      -      "default": null,
      -      "items": {
      -        "additionalProperties": true,
      -        "type": "object"
      -      },
      -      "title": "Improvements",
      -      "type": "array"
      -    },
      -    "matched_principles": {
      -      "default": null,
      -      "items": {
      -        "$ref": "#/$defs/ArchitectFinding"
      -      },
      -      "title": "Matched Principles",
      -      "type": "array"
      -    },
      -    "next_step": {
      -      "anyOf": [
      -        {
      -          "additionalProperties": true,
      -          "type": "object"
      -        },
      -        {
      -          "type": "null"
      -        }
      -      ],
      -      "default": null,
      -      "title": "Next Step"
      -    },
      -    "overall_status": {
      -      "default": null,
      -      "title": "Overall Status",
      -      "type": "string"
      -    },
      -    "principles_aligned": {
      -      "default": null,
      -      "title": "Principles Aligned",
      -      "type": "integer"
      -    },
      -    "principles_evaluated": {
      -      "default": null,
      -      "title": "Principles Evaluated",
      -      "type": "integer"
      -    },
      -    "prior_run_id": {
      -      "anyOf": [
      -        {
      -          "type": "string"
      -        },
      -        {
      -          "type": "null"
      -        }
      -      ],
      -      "default": null,
      -      "title": "Prior Run Id"
      -    },
      -    "public_review_url": {
      -      "default": null,
      -      "title": "Public Review Url",
      -      "type": "string"
      -    },
      -    "readiness": {
      -      "anyOf": [
      -        {
      -          "$ref": "#/$defs/ArchitectReadiness"
      -        },
      -        {
      -          "type": "null"
      -        }
      -      ],
      -      "default": null
      -    },
      -    "regressions": {
      -      "default": null,
      -      "items": {
      -        "additionalProperties": true,
      -        "type": "object"
      -      },
      -      "title": "Regressions",
      -      "type": "array"
      -    },
      -    "run_id": {
      -      "default": null,
      -      "title": "Run Id",
      -      "type": "string"
      -    },
      -    "tier": {
      -      "anyOf": [
      -        {
      -          "type": "string"
      -        },
      -        {
      -          "type": "null"
      -        }
      -      ],
      -      "default": null,
      -      "title": "Tier"
      -    }
      -  },
      -  "title": "ArchitectValidateConsensusResponse",
      -  "type": "object"
      -}New value: +null
  4. Changed1 schema field changed
    • changedOutput schema / (root)
      Previous value: -nullNew value: +{
      +  "$defs": {
      +    "ArchitectFinding": {
      +      "description": "One per-principle finding from architect.validate.",
      +      "properties": {
      +        "confidence": {
      +          "anyOf": [
      +            {
      +              "type": "number"
      +            },
      +            {
      +              "type": "null"
      +            }
      +          ],
      +          "title": "Confidence"
      +        },
      +        "evidence": {
      +          "anyOf": [
      +            {
      +              "type": "string"
      +            },
      +            {
      +              "type": "null"
      +            }
      +          ],
      +          "title": "Evidence"
      +        },
      +        "evidence_quality": {
      +          "anyOf": [
      +            {
      +              "type": "string"
      +            },
      +            {
      +              "type": "null"
      +            }
      +          ],
      +          "title": "Evidence Quality"
      +        },
      +        "principle_id": {
      +          "title": "Principle Id",
      +          "type": "integer"
      +        },
      +        "recommendation": {
      +          "anyOf": [
      +            {
      +              "type": "string"
      +            },
      +            {
      +              "type": "null"
      +            }
      +          ],
      +          "title": "Recommendation"
      +        },
      +        "severity_class": {
      +          "anyOf": [
      +            {
      +              "type": "string"
      +            },
      +            {
      +              "type": "null"
      +            }
      +          ],
      +          "title": "Severity Class"
      +        },
      +        "severity_score": {
      +          "anyOf": [
      +            {
      +              "type": "integer"
      +            },
      +            {
      +              "type": "null"
      +            }
      +          ],
      +          "title": "Severity Score"
      +        },
      +        "slug": {
      +          "title": "Slug",
      +          "type": "string"
      +        },
      +        "title": {
      +          "title": "Title",
      +          "type": "string"
      +        },
      +        "verdict": {
      +          "title": "Verdict",
      +          "type": "string"
      +        }
      +      },
      +      "title": "ArchitectFinding",
      +      "type": "object"
      +    },
      +    "ArchitectReadiness": {
      +      "description": "Readiness rubric output (score / grade / tier / breakdown).",
      +      "properties": {
      +        "aligned": {
      +          "title": "Aligned",
      +          "type": "integer"
      +        },
      +        "applicable": {
      +          "title": "Applicable",
      +          "type": "integer"
      +        },
      +        "grade": {
      +          "title": "Grade",
      +          "type": "string"
      +        },
      +        "grade_capped_by_certification": {
      +          "title": "Grade Capped By Certification",
      +          "type": "boolean"
      +        },
      +        "grade_capped_by_high_risk": {
      +          "title": "Grade Capped By High Risk",
      +          "type": "boolean"
      +        },
      +        "hardening_recommended": {
      +          "title": "Hardening Recommended",
      +          "type": "integer"
      +        },
      +        "high_risk": {
      +          "title": "High Risk",
      +          "type": "integer"
      +        },
      +        "mixed": {
      +          "title": "Mixed",
      +          "type": "integer"
      +        },
      +        "needs_changes": {
      +          "title": "Needs Changes",
      +          "type": "integer"
      +        },
      +        "not_applicable": {
      +          "title": "Not Applicable",
      +          "type": "integer"
      +        },
      +        "polish": {
      +          "title": "Polish",
      +          "type": "integer"
      +        },
      +        "production_blocker": {
      +          "title": "Production Blocker",
      +          "type": "integer"
      +        },
      +        "rubric_version": {
      +          "title": "Rubric Version",
      +          "type": "string"
      +        },
      +        "score": {
      +          "title": "Score",
      +          "type": "integer"
      +        },
      +        "tier": {
      +          "title": "Tier",
      +          "type": "string"
      +        }
      +      },
      +      "title": "ArchitectReadiness",
      +      "type": "object"
      +    },
      +    "ErrorBody": {
      +      "description": "The body of `error_payload(code, message, details)` returns.",
      +      "properties": {
      +        "code": {
      +          "title": "Code",
      +          "type": "string"
      +        },
      +        "details": {
      +          "additionalProperties": true,
      +          "title": "Details",
      +          "type": "object"
      +        },
      +        "message": {
      +          "title": "Message",
      +          "type": "string"
      +        }
      +      },
      +      "title": "ErrorBody",
      +      "type": "object"
      +    }
      +  },
      +  "properties": {
      +    "assessment_status": {
      +      "anyOf": [
      +        {
      +          "type": "string"
      +        },
      +        {
      +          "type": "null"
      +        }
      +      ],
      +      "default": null,
      +      "title": "Assessment Status"
      +    },
      +    "assessment_summary": {
      +      "anyOf": [
      +        {
      +          "type": "string"
      +        },
      +        {
      +          "type": "null"
      +        }
      +      ],
      +      "default": null,
      +      "title": "Assessment Summary"
      +    },
      +    "badge_url": {
      +      "default": null,
      +      "title": "Badge Url",
      +      "type": "string"
      +    },
      +    "baseline_compatibility": {
      +      "anyOf": [
      +        {
      +          "type": "string"
      +        },
      +        {
      +          "type": "null"
      +        }
      +      ],
      +      "default": null,
      +      "title": "Baseline Compatibility"
      +    },
      +    "baseline_race_status": {
      +      "anyOf": [
      +        {
      +          "type": "string"
      +        },
      +        {
      +          "type": "null"
      +        }
      +      ],
      +      "default": null,
      +      "title": "Baseline Race Status"
      +    },
      +    "baseline_status": {
      +      "anyOf": [
      +        {
      +          "type": "string"
      +        },
      +        {
      +          "type": "null"
      +        }
      +      ],
      +      "default": null,
      +      "title": "Baseline Status"
      +    },
      +    "card_badge_url": {
      +      "default": null,
      +      "title": "Card Badge Url",
      +      "type": "string"
      +    },
      +    "certification_attempts_count": {
      +      "default": null,
      +      "title": "Certification Attempts Count",
      +      "type": "integer"
      +    },
      +    "certification_blocker_reason": {
      +      "anyOf": [
      +        {
      +          "type": "string"
      +        },
      +        {
      +          "type": "null"
      +        }
      +      ],
      +      "default": null,
      +      "title": "Certification Blocker Reason"
      +    },
      +    "certification_findings": {
      +      "default": null,
      +      "items": {
      +        "additionalProperties": true,
      +        "type": "object"
      +      },
      +      "title": "Certification Findings",
      +      "type": "array"
      +    },
      +    "certification_status": {
      +      "anyOf": [
      +        {
      +          "type": "string"
      +        },
      +        {
      +          "type": "null"
      +        }
      +      ],
      +      "default": null,
      +      "title": "Certification Status"
      +    },
      +    "certification_summary": {
      +      "anyOf": [
      +        {
      +          "type": "string"
      +        },
      +        {
      +          "type": "null"
      +        }
      +      ],
      +      "default": null,
      +      "title": "Certification Summary"
      +    },
      +    "code_classification_category": {
      +      "anyOf": [
      +        {
      +          "type": "string"
      +        },
      +        {
      +          "type": "null"
      +        }
      +      ],
      +      "default": null,
      +      "title": "Code Classification Category"
      +    },
      +    "code_classification_rationale": {
      +      "anyOf": [
      +        {
      +          "type": "string"
      +        },
      +        {
      +          "type": "null"
      +        }
      +      ],
      +      "default": null,
      +      "title": "Code Classification Rationale"
      +    },
      +    "consensus_method": {
      +      "default": null,
      +      "title": "Consensus Method",
      +      "type": "string"
      +    },
      +    "consensus_pass_count": {
      +      "default": null,
      +      "title": "Consensus Pass Count",
      +      "type": "integer"
      +    },
      +    "consensus_runs": {
      +      "default": null,
      +      "items": {
      +        "additionalProperties": true,
      +        "type": "object"
      +      },
      +      "title": "Consensus Runs",
      +      "type": "array"
      +    },
      +    "created_at": {
      +      "default": null,
      +      "title": "Created At",
      +      "type": "string"
      +    },
      +    "error": {
      +      "$ref": "#/$defs/ErrorBody",
      +      "default": null
      +    },
      +    "focus_area": {
      +      "anyOf": [
      +        {
      +          "type": "string"
      +        },
      +        {
      +          "type": "null"
      +        }
      +      ],
      +      "default": null,
      +      "title": "Focus Area"
      +    },
      +    "improvements": {
      +      "default": null,
      +      "items": {
      +        "additionalProperties": true,
      +        "type": "object"
      +      },
      +      "title": "Improvements",
      +      "type": "array"
      +    },
      +    "matched_principles": {
      +      "default": null,
      +      "items": {
      +        "$ref": "#/$defs/ArchitectFinding"
      +      },
      +      "title": "Matched Principles",
      +      "type": "array"
      +    },
      +    "next_step": {
      +      "anyOf": [
      +        {
      +          "additionalProperties": true,
      +          "type": "object"
      +        },
      +        {
      +          "type": "null"
      +        }
      +      ],
      +      "default": null,
      +      "title": "Next Step"
      +    },
      +    "overall_status": {
      +      "default": null,
      +      "title": "Overall Status",
      +      "type": "string"
      +    },
      +    "principles_aligned": {
      +      "default": null,
      +      "title": "Principles Aligned",
      +      "type": "integer"
      +    },
      +    "principles_evaluated": {
      +      "default": null,
      +      "title": "Principles Evaluated",
      +      "type": "integer"
      +    },
      +    "prior_run_id": {
      +      "anyOf": [
      +        {
      +          "type": "string"
      +        },
      +        {
      +          "type": "null"
      +        }
      +      ],
      +      "default": null,
      +      "title": "Prior Run Id"
      +    },
      +    "public_review_url": {
      +      "default": null,
      +      "title": "Public Review Url",
      +      "type": "string"
      +    },
      +    "readiness": {
      +      "anyOf": [
      +        {
      +          "$ref": "#/$defs/ArchitectReadiness"
      +        },
      +        {
      +          "type": "null"
      +        }
      +      ],
      +      "default": null
      +    },
      +    "regressions": {
      +      "default": null,
      +      "items": {
      +        "additionalProperties": true,
      +        "type": "object"
      +      },
      +      "title": "Regressions",
      +      "type": "array"
      +    },
      +    "run_id": {
      +      "default": null,
      +      "title": "Run Id",
      +      "type": "string"
      +    },
      +    "tier": {
      +      "anyOf": [
      +        {
      +          "type": "string"
      +        },
      +        {
      +          "type": "null"
      +        }
      +      ],
      +      "default": null,
      +      "title": "Tier"
      +    }
      +  },
      +  "title": "ArchitectValidateConsensusResponse",
      +  "type": "object"
      +}
  5. Added

TDQS

A4.7/5.0
Behavior5/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations only carry generic flags, so the description carries the full burden and delivers: long-running execution (~80-120s), N parallel LLM calls with Nx cost, a DO NOT RETRY timeout warning, private_session child isolation versus a persisted consolidated row, and consensus-specific typed failures. There is no contradiction with the annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is long but appropriately structured, with the most critical operational warning front-loaded and clearly labeled sections for behavior, auth, inputs, outputs, and failures. Every section earns its place given the tool's cost, timeout behavior, and persistence semantics.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a complex, expensive, state-persisting tool, the description covers prerequisites, input mapping, output fields, failure modes, sibling routing, persistence semantics, and recovery after client timeout. An agent has everything needed to decide whether to call it, how to call it safely, and what to do when it times out.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100% and every parameter is already richly documented, including the verbatim implementation_context constraint, n's server-side cap, and repository's iteration-key behavior. The tool description mostly restates these points rather than adding substantially new parameter semantics, so it stays at the high-coverage baseline.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description opens by defining the tool as an N-shot CONSENSUS doctrine review of agentic code and specifies that it returns a ConsensusValidationResponse with a median score and variance band. It explicitly contrasts consensus mode with the single-shot architect.validate, so an agent can tell the siblings apart.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines5/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

It provides dedicated WHEN TO CALL and WHEN NOT TO CALL sections, directing agents to consensus mode for honest unanchored first-pass scores and to architect.validate for iteration-delta regressions. It also gives concrete timeout recovery steps via run_id and validation_history, making invocation context unambiguous.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.

Resources