Skip to main content
Glama

Johnlaney Forecast Desk

Server Details

Prediction-market tools: check if a yes/no claim is decidable, desk Brier track record.

Glama couldn't complete the latest health check. If this server requires authentication, missing or expired test credentials may be the cause. A test profile lets Glama authenticate for health checks and discover tools; it is separate from your personal connections.

If you are the author, claim ownership, then add or update a test profile under Admin → Test Profile.

Status
Unhealthy
Last Tested
Transport
Streamable HTTP · MCP 2025-11-25
URL

TDQS

B3.4/5.0

Scored across 2 tools

Disambiguation5/5

The two tools are completely distinct: one aggregates Brier scores and resolved counts, the other checks claim decidability. There is no overlap or ambiguity between them.

Naming Consistency4/5

Both tool names are two-word noun compounds using underscores (brier_summary, claim_decidability). They follow a consistent pattern, though neither uses a verb_noun convention.

Tool Count3/5

With only 2 tools, the server feels thin for a 'Forecast Desk' purpose. It is borderline, not extreme, but the surface is minimal.

Completeness2/5

The domain implies a forecasting workflow, but there are no tools to create, resolve, or manage claims. Only a reporting summary and a validation check exist, leaving significant gaps.

Available Tools

2 tools
brier_summaryAInspect

Aggregate Brier score and resolved count for the desk and each seat (report-only).

ParametersJSON Schema
NameRequiredDescriptionDefault

No parameters

Output Schema

ParametersJSON Schema
NameRequiredDescription
resultYes

TDQS

A4.1/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries the full burden of behavioral disclosure. The explicit 'report-only' marker clearly signals that this tool has no side effects, which is a meaningful behavioral trait beyond what the empty schema implies.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

One compact sentence front-loads the action, scope, and read-only nature. There is no wasted text, and every phrase earns its place.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a parameterless, report-only aggregation tool with an output schema present, the description is fully adequate. It specifies what is aggregated, at what granularity, and that it is non-mutating.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The tool has zero parameters, so the baseline is 4. The description adds conceptual meaning by explaining what is aggregated, even though there are no parameters to elaborate on.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states a specific verb ('Aggregate') and a precise resource ('Brier score and resolved count for the desk and each seat'). The parenthetical 'report-only' clarifies its analytical nature, clearly distinguishing it from the sibling tool claim_decidability.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

There is no explicit guidance on when to use this tool versus claim_decidability, nor any exclusions. 'Report-only' implies a read-only reporting context, but the description does not state when an agent should choose this over alternatives.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

claim_decidabilityBInspect

Check whether a binary claim names a deadline, a public settlement source, and a clear condition.

ParametersJSON Schema
NameRequiredDescriptionDefault
claimYes

Output Schema

ParametersJSON Schema
NameRequiredDescription
resultYes

TDQS

B3.1/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations provided, the description must carry the full burden of behavioral disclosure. It states the evaluation criteria but does not clarify what the tool actually returns (e.g., a boolean, a structured assessment) or any side effects (it appears inert, but is not stated). Given no annotations, this is a moderate gap; the description is not misleading but incomplete.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, concise sentence that immediately front-loads the core purpose and criteria. Every word contributes to understanding. It is appropriately sized for a simple tool.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's moderate complexity (checking three conditions), the description covers the 'what' but not the 'how' or 'return value'. Since there is an output schema (though not detailed in the context), the description does not need to explain return values, but it still lacks context on expected input format and examples. However, for a simple check, it is adequate but not rich.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, meaning the schema provides no description for the 'claim' parameter. The description adds some meaning—it implies the claim is a binary claim about a deadline, settlement source, and condition—but it does not define what constitutes a 'binary claim' or provide format examples. With only one parameter and minimal description, the compensation is insufficient.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states a specific verb ('Check') and a specific resource ('a binary claim') and names the three conditions it evaluates ('names a deadline, a public settlement source, and a clear condition'). It conveys the purpose clearly, though it does not explicitly distinguish from the sibling 'brier_summary'.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

There is no guidance on when to use this tool versus 'brier_summary'. The description implies it is for checking decidability, but it does not state contexts where brier_summary would be preferred or when not to use this tool. No exclusions or alternatives are mentioned.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Tool Schema Changelog

Recent tool additions, removals, and schema changes observed during successful MCP inspections.

  1. 2 tool updates
    • First observedbrier_summary
    • First observedclaim_decidability

Related MCP Connectors

Related MCP Servers

  • A
    license
    A
    quality
    A
    maintenance
    Quant tools for AI agents on Kalshi & Polymarket. 32 tools, 25 free with no key: EV, Kelly sizing, Bayes updates, odds conversion, base-rate gaps, combo grading, Fed odds, the NFL model, and Kalshi 15-minute markets and perps (live board + liquidation estimates). Pro adds commodity and NFL edge models, the mispricing scanner and edge alerts.
    2
    6
    8 npm
    MIT
  • F
    license
    Not graded
    quality
    D
    maintenance
    Enables verification of natural language claims against CME prediction market data, with tools to query historical trading data, get contract information, and automatically verify claims using NLP-powered parsing.
    -
  • A
    license
    Not graded
    quality
    A
    maintenance
    Read-only Polymarket data tools for AI agents: wallet profiles, fee-inclusive PnL cross-checks, Brier-score calibration, leaderboards, market scans and more (10 tools). No API keys, no order placement — data only. English + Chinese docs.
    3 npm
    198
    MIT
Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.

Resources