Skip to main content
Glama

cohort_failures

UNDERSTANDING — what a whole market gets WRONG: the agent-readiness checks its members most commonly fail, ranked by what fixing each would move the cohort mean. The inverse of gap_analysis, which says where a market is under-served; this says where it is failing the rubric. Turns "fix your OpenAPI" into "this industry does not publish OpenAPI", which is the shape of a finding worth publishing. Named checks only — facet rollups cannot name the checks underneath them.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
kindYes
pageNo
slugYes
limitNo
contextNoOptional: why you are asking. One sentence — the task you are trying to complete, or what you expect to get back. Never included in the answer and never used to rank; it is read only when a result turns out to be wrong, which is when knowing the intent is what makes the report actionable.

TDQS

A3.9/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations provided, the description carries the full behavioral burden. It discloses that results are ranked by potential impact on the cohort mean, that only named checks are returned, and that facet rollups are unsupported. It does not mention output structure, pagination, or error behavior, but the core behavioral traits are clearly disclosed.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness3/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is information-dense and front-loads the central idea, but it includes stylistic flourishes such as 'UNDERSTANDING' and 'which is the shape of a finding worth publishing' that do not add operational value. It is longer than necessary without addressing key invocation details.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The tool has no output schema, no annotations, and only one documented parameter, so the description needed to explain both the return shape and how to invoke it. It explains the conceptual output well but leaves required parameters undocumented and gives no indication of what a response item looks like, making it incomplete for an agent to call correctly.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is low at 20%, so the description needed to compensate, but it never explains the required parameters kind and slug, nor page, limit, or the meaning of the enum values. The context parameter is already described in the schema, so the description adds little to parameter understanding.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly identifies the tool's purpose: it reports the agent-readiness checks that cohort members most commonly fail, ranked by how much fixing each would move the cohort mean. It also explicitly distinguishes itself from gap_analysis, so an agent can tell the two apart without inspecting schemas.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines5/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description explicitly positions the tool as the inverse of gap_analysis and explains the semantic difference: gap_analysis shows where a market is under-served, while cohort_failures shows where it fails the rubric. It also warns that it returns named checks only, not facet rollups, which helps an agent decide when this tool is appropriate.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.

TDQS

B3.1/5.0
Disambiguation3/5

Most tools are clearly separated by artifact type or resource (find_mcp vs find_openapi vs get_provider vs get_api), but the sheer volume creates some genuinely confusable clusters: apis_io_search vs find_apis vs find_artifacts, and insights_adoption vs insights_dimensions vs find_company_insights. Several readiness-related tools (what_can_i_fix, simulate_fixes, readiness_gates) also share a conceptual boundary, though their descriptions do help.

Naming Consistency3/5

The dominant patterns (find_*, get_*, cohort_*, compare_*) are consistent and predictable, but the set mixes in irregular names like apis_io_search, tag_group_tags, what_can_i_fix, whats_changed, and resolve. These deviations are readable but break the otherwise regular verb_noun convention.

Tool Count2/5

106 tools is far beyond the typical well-scoped server and will impose a heavy selection burden on agents. The server covers a genuinely broad domain (catalog search, ratings, cohorts, agent readiness, lists, exports, feedback), so the count is defensible in scope, but it is still too many to navigate efficiently.

Completeness5/5

The surface is remarkably complete: search and browse, single-entity detail, comparisons, cohort analytics, agent-readiness assessment, saved searches, list management, feedback/correction flows, and full dataset exports are all covered. There are no obvious dead ends, and even minor operations like re-running saved searches or simulating fixes are present.

Resources