Skip to main content
Glama

Ask many questions about one state

jev_ask

Ask multiple independent questions about the same state in a single request, scoring all questions in one forward pass. Cuts cost and latency for document-heavy workloads without changing answers.

Instructions

Ask several independent questions about the same state in ONE request. Jev prefills the state once and scores every question in a single forward pass, so extra questions add almost no latency. Prefer this over repeated single-question calls: on a document-dominated workload it is dramatically cheaper and faster with no change in answers. Questions cannot see each other's answers, so state any speculative premise explicitly and let your own logic decide which answers apply.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
stateYesThe content to evaluate. A plain string for text, or an object/array for structured data such as a record, a diff, or a chat log.
act_aboveNoConfidence at or above which the answer is marked 'act'. Default 0.8. Calibrate on your own data and the cost of being wrong.
questionsYes
review_aboveNoConfidence at or above which the answer is marked 'review' rather than 'abstain'. Default 0.5.

Output Schema

TableJSON Schema
NameRequiredDescriptionDefault
modelYes
usageYes
answersYesKeyed by your question ids. Choice and Score answers also carry an 'action' gated on confidence.
none_optionsYesFor each 'classify' question, the key carrying the no-match meaning, or null.

Schema Changelog

Changes observed during successful MCP inspections.

  1. First observedv0.3.0

TDQS

A3.8/5.0
Behavior1/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description bears full burden. It does not disclose the exact behavior of the scoring mechanism, how confidence thresholds work (act_above/review_above) beyond the schema, or the output format (which is not in the schema). The description mentions batching but leaves critical operational details (e.g., how to interpret results, whether 'abstain' is possible) implicit.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is concise, with a clear lead sentence stating the primary benefit, followed by a specific usage recommendation and a caveat about question independence. Each sentence earns its place; no filler.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's complexity (multiple question types, confidence thresholds, no annotations) and the presence of an output schema (which is not provided), the description is insufficient. It does not explain the return format, how confidence levels map to answers, or how to handle 'abstain' vs 'act' vs 'review'. The description covers batching but misses critical behavioral details for correct usage.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 75%, and the description adds significant context: it notes that extra questions add little latency, which implies questions is a list. However, it does not elaborate on the 'state' parameter's flexibility or the confidence thresholds' calibration. Since the schema already describes each parameter well, the description's marginal value is limited but not absent.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool's purpose: asking several independent questions about the same state in a single request. It distinguishes itself from siblings by emphasizing batching multiple questions, which is unique among the sibling tools (jev_classify, jev_score, jev_check handle single questions). The verb 'ask' and resource 'state' are specific.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines5/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description explicitly says to prefer this over repeated single-question calls, citing cost and speed benefits. It also mentions a key constraint: questions cannot see each other's answers, so speculative premises must be stated explicitly. This provides clear when-to-use guidance and warns about a behavioral limitation.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Deploy Server

Other Tools