Skip to main content
Glama

jev_verify_decision

Verify a GitHub decision comment against its cited issues or PRs, checking source fidelity and returning accepted, rejected, or needs_review with coverage and metadata.

Instructions

Verify a GitHub decision comment against its cited issues/PRs using the configured AI splitter and Jev. Mirrors ai jev verify-decision; latest selects the most recent comment with citations. Returns accepted, rejected or needs_review plus statements, coverage, models, usage and cache metadata as JSON/YAML. These verdicts are successful tool results. Low coverage alone requires review. Checks source fidelity, not whether the decision is correct. Requires gh, Jev and AI backend credentials; backend selection is server configuration, model overrides are request-local.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
repoNoRepository directory for bare issue references; defaults to server cwd.
issueYesJudged issue: N, #N, owner/repo#N or GitHub issue URL.
modelNoSplitter AI model override; falls back to mcp.default_model, then backend defaults. Backend selection comes from server configuration.
outputNoReport format: json (default) or yaml.
commentNolatest (default), numeric comment id or issue-comment URL.
refreshNoBypass the shared GitHub issue cache.
jev_modelNoJev model override for support and coverage judgments.
thresholdNoMinimum support probability for acceptance; default 0.5.
reject_belowNoProbability below which a statement rejects the comment; default 0.3.
max_input_charsNoSource character cap; default 60000.
coverage_thresholdNoCoverage below this probability requires review; default 0.5.

Schema Changelog

Changes observed during successful MCP inspections.

  1. Addedv0.45.0

TDQS

A3.6/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations provided, so the description must carry behavioral disclosure. It does well: explains return values ('accepted, rejected or needs_review plus statements, coverage, models, usage and cache metadata'), clarifies that verdicts are successful results, notes low coverage triggers review, and states prerequisite credentials (gh, Jev, AI backend).

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness2/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description packs multiple distinct facts into a dense block: purpose, mechanism, return format, verdict semantics, coverage behavior, scope caveat, and credential requirements. It is front-loaded with purpose but the middle-and-later sentences are run-on and would benefit from restructuring. The final sentence about server config is somewhat tangential.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a tool with 11 parameters, no output schema, and no annotations, the description does a good job covering the core behavior: what it returns, that verdicts are successful results, that low coverage means review, and that it checks fidelity not correctness. The credential requirements are noted. It could explicitly address the cache (refresh param) behavior but covers enough.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so the schema already documents all 11 parameters in detail. The description adds high-level context (e.g., 'latest selects the most recent comment with citations') but doesn't enumerate threshold or model override semantics beyond what the schema provides. Baseline 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

States a specific verb ('Verify') and resource ('GitHub decision comment against its cited issues/PRs') with the mechanism ('using the configured AI splitter and Jev'). Distinguishes from siblings like jev_route and ai_chat, though it doesn't explicitly name them.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Explains the specific use case (verifying a decision comment) and clarifies the scope ('Checks source fidelity, not whether the decision is correct'), which sets a clear boundary on when this tool is the right choice. No explicit sibling alternatives are named.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Deploy Server

Other Tools