Skip to main content
Glama

get failure clusters

get_failure_clusters
Read-onlyIdempotent

Group live production failures into systemic clusters by cause, so you can prioritize fixes without reading each failure individually.

Instructions

See live production failures grouped into systemic causes per criterion (judge FAIL rationales plus pending scan suspects, clustered by a model) so a customer can find what to fix first rather than reading failures one by one. GET /v1/evals/failure_clusters (API-key scope: read). Returns: {window_days, generated_at, cached (true when served from the hourly cache), criteria:[{criterion_id, criterion_name, failures (online FAILs + pending suspects, deduped), without_reason (failures with no stored rationale — counted, never clustered), clusters:[{name, count, share (of this criterion's clustered failures), request_ids, example (one representative rationale verbatim)}]}]}. Cache-Control: no-store. Notes: 400 "window_days must be an integer 1..90" for an out-of-range value. MONEY: a fresh clustering (cache miss or force=true) makes one small metered model call per criterion that has ≥4 failure reasons (at most 40 reasons per criterion) — billed to the wallet like other assists; cached responses cost nothing. Criteria with fewer than 4 reasons are listed with no clusters.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
forceNoPass the literal "true" to bypass the per-workspace one-hour cache and re-cluster now. Default: false.
window_daysNoLook-back window in days, integer 1..90. Default: 7.
Install Server

TDQS

A4.6/5.0
Behavior5/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Beyond the readOnly/idempotent annotations, the description discloses the hourly cache and how 'force' bypasses it, the metered model-call billing on fresh clustering, deduplication of online FAILs and pending suspects, the 'without_reason' exclusions from clustering, and the 400 error for invalid window_days. These are meaningful behavioral details that annotations alone cannot convey.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is long but dense and well ordered: purpose, endpoint/scoping, full return shape, and then cache/error/billing notes. Every section earns its place because there is no output schema to rely on. Minor redundancy like 'Cache-Control: no-store' could be dropped, but it does not detract much.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With no output schema, the description fully specifies the response structure, including the cache flag, criteria array, cluster fields, and the representative rationale example. It also covers error behavior, billing, and edge cases such as criteria with fewer than four reasons. An agent has everything needed to call the tool and interpret results.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The schema already documents both parameters fully (defaults, ranges, and force's cache-bypass effect), so the baseline is 3. The description adds further value by specifying the cost implications of force=true, the 40-reason cap per criterion, and the exact 400 error message when window_days is out of range.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description names a precise resource ('live production failures grouped into systemic causes per criterion') with a clear action ('See') and the user purpose ('find what to fix first rather than reading failures one by one'). It is not a tautology of the title and is easily distinguishable from sibling tools that scan or list individual failures.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description gives clear context: use this to get an aggregated, prioritized view of production failures instead of inspecting them individually. It does not explicitly name an alternative tool or a when-not-to-use condition, but the intended scenario is unmistakable.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Other Tools

Latest Blog Posts

MCP directory API

We provide all the information about MCP servers via our MCP API.

curl -X GET 'https://glama.ai/api/mcp/v1/servers/omnia-v/errorbar-mcp'

If you have feedback or need assistance with the MCP directory API, please join our Discord server