Skip to main content
Glama

opsin_why_it_fails

Why agents fail, as OPSIN read it: its readings of an agent's misses on tasks with known answers (the unchanged agent's, or the best agent it built), each way of failing with how many of the misses it read, the ways that were the task's own fault, and the lines it designed from them with where each stands. A reading, not a signed result. Narrow it with suite and thinking.

Tool call template

This tool declares no required parameters. Add optional parameters from the input schema as needed.

{
  "id": 1,
  "jsonrpc": "2.0",
  "method": "tools/call",
  "params": {
    "arguments": {},
    "name": "opsin_why_it_fails"
  }
}

Input Schema

NameRequiredDescriptionDefault
suiteNoOne suite; opsin_suites lists them
thinkingNoThe base agent's thinking setting

Schema Changelog

Changes observed during successful MCP inspections.

  1. Changed1 schema field changed
    • changedInput schema / properties / suite / enum
      Previous value: -[
      -  "defi-maths",
      -  "agent-safety",
      -  "markets-maths",
      -  "market-calls",
      -  "coding"
      -]New value: +[
      +  "defi-maths",
      +  "agent-safety",
      +  "markets-maths",
      +  "market-calls",
      +  "coding",
      +  "position-books"
      +]
  2. Added

TDQS

A3.5/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries the full burden; it does disclose the return content (failure categories with counts, task-attributable failures, designed fixes and their status) and the source population (the unchanged agent or the best agent it built). It omits whether the call is strictly read-only, how fresh the data is, what happens when there are no recorded misses, and cost/latency, leaving real behavioral gaps for a no-annotation tool.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness3/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The key idea, "Why agents fail", is front-loaded, but the body is a single run-on sentence with abstract phrasing like "as OPSIN read it" and "the lines it designed from them with where each stands" that requires re-parsing. It would be clearer as a short list of what the response contains, and some of the hedging ("A reading, not a signed result" is fine; the double parenthetical is not) could be trimmed.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With only two optional parameters and no output schema, the description is the only place return values can be explained, and it does describe the four sections of the response and the population being analyzed. What remains missing is failure/empty-state behavior and confirmation of read-only semantics, which matters given the absence of annotations.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% and both params are documented enums, so the baseline would be 3. The description adds genuine meaning by framing both as narrowing filters and by pointing the agent at opsin_suites to discover valid suite values, which the schema itself references but does not resolve.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

"Why agents fail" plus the elaboration about readings of an agent's misses on tasks with known answers establishes a specific resource: failure-mode diagnostics over benchmarked runs. It never names or distinguishes itself from nearby siblings such as opsin_verdict or opsin_status, so an agent must infer that this is the analysis view while those are the verdict/status views.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

"Narrow it with suite and thinking" tells the agent how to scope the call, and "A reading, not a signed result" implies it should not be treated as a verdict. There is still no explicit when-to-use statement, no statement of when to prefer opsin_verdict, and no prerequisites, so usage is only implied.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.

Resources