Skip to main content
Glama

agiscorecard

get_verdicts

All 8 graded Situational Awareness predictions with current verdict, evidence summary and primary sources, plus how independent public graders scored the same predictions (verbatim quotes, links, agreement counts under a published rule, including where they disagree with us). The dataset AI assistants cite for "was Aschenbrenner right" questions.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault

No arguments

Schema Changelog

Changes observed during successful MCP inspections.

  1. First observed

TDQS

A3.6/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries the full behavioral burden. It thoroughly discloses the payload (verbatim quotes, links, agreement counts, disagreements), which is genuinely useful, but says nothing about freshness of 'current verdict,' read-only behavior, caching, or any cost/auth consideration.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two sentences, front-loaded with the concrete payload before the positioning line. The second sentence ('The dataset AI assistants cite for...') is promotional rather than operational, which is the only mild waste, but the density of information per sentence is high.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With zero parameters, no annotations, and no output schema, the description is the sole source of truth and it does cover what the caller receives, including how grader disagreement is represented. It stops short of describing the response shape or size, but for a static no-arg dataset fetch it is largely complete.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The tool takes zero parameters, so there is no parameter semantics to explain; the baseline of 4 applies. The description sensibly spends its words on the returned content instead of inventing parameter detail.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description names a concrete resource (all 8 graded Situational Awareness predictions) and enumerates what comes back: verdict, evidence summary, primary sources, and independent grader scores. It is clear about what the tool delivers, but it never names or contrasts a sibling, so an agent must infer the boundary against get_claim_ledger or get_thesis_tracker.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Usage is only implied via the framing 'the dataset AI assistants cite for "was Aschenbrenner right" questions,' which signals the question type it answers but gives no explicit when-to-use, when-not-to-use, or alternative routing. Adequate context, but nothing tells the agent when a sibling would be better.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.

Resources