Skip to main content
Glama

firedrill_summary

Read-onlyIdempotent

Read complete batch counts and a bounded page of repeated-trial groups, missing evidence and exact-check denominators. Optional taskMetrics contain authored numeric measurements, coverage, median/range and bounded run samples per exact definition and cohort; zero/negative values are valid, absent values are not zero and units are not pooled. Follow groupPage.nextCursor for more groups. Oversized groups retain population facts and exact API pointers, not fabricated smaller populations. Rubric scores are anchored levels, not probabilities or a universal winner. Task measurements change no gate.

Input Schema

NameRequiredDescriptionDefault
limitNo
cursorNo
batchIdYes
projectIdYes
environmentIdYes

Schema Changelog

Changes observed during successful MCP inspections.

  1. First observed

TDQS

B3.3/5.0
Behavior5/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare read-only, idempotent, non-destructive behavior, and the description adds substantial behavioral context beyond them: bounded paging, oversized-group handling that retains population facts and exact API pointers, metric handling rules (zero/negative valid, absent values not zero, units not pooled), rubric score interpretation, and the fact that task measurements change no gate.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness3/5

Is the description appropriately sized, front-loaded, and free of redundancy?

It front-loads a purpose sentence, but then packs many caveats into semicolon-heavy clauses and cryptic phrases such as 'Task measurements change no gate.' The density reduces readability even if much of the content is relevant for a complex summary tool.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

No output schema exists, so the description must carry return-value context, and it does describe paging, oversized groups, metrics, and rubric scores. However, required identifier parameters and the input cursor/limit semantics are left unexplained, leaving gaps for correct invocation.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0% across five parameters, so the description must compensate, but it only indirectly touches pagination ('bounded page', groupPage.nextCursor) and never explains projectId, environmentId, batchId, limit, or the input cursor. It also references taskMetrics, which is not an input parameter in the schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

States a specific verb, 'Read', and specific resources: complete batch counts, repeated-trial groups, missing evidence, and exact-check denominators. It does not distinguish itself from many siblings such as firedrill_batch, firedrill_batches, or firedrill_report, and the phrasing is dense, but the summary purpose is inferable.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description gives a pagination usage instruction ('Follow groupPage.nextCursor for more groups') but no explicit when-to-use or when-not-use guidance and no named alternatives among the many sibling tools. Usage remains implied rather than directed.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.

Resources