Skip to main content
Glama

weather_verification-scores

Free: our forecast verification stats (MAE by variable, region, lead, segment). Transparent skill scores from stored forecast/actual pairs over a rolling 90-day window, scored against real NWS station observations and segmented by what produced each forecast (proprietary-blend temperature at covered stations vs NWS passthrough). Live-accumulated pairs are reported separately from the model's offline historical_oos fit metrics — the two are never mixed. Free forever so you can judge the model before paying for forecasts. [HTTP: GET /v1/verification/scores · price free via x402 · docs https://x402-factory.com/docs/weather.verification-scores]

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
regionNo
variableNo
lead_hoursNo

Schema Changelog

Changes observed during successful MCP inspections.

  1. First observed

TDQS

A3.7/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries the full burden, and it does substantial work: it discloses the rolling 90-day window, the NWS station-observation ground truth, the segmentation by forecast producer, and the separation of live-accumulated pairs from offline historical_oos fit metrics. It even states pricing (free via x402). It omits pagination, response size, and auth specifics beyond the x402 price note, keeping it from a 5.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Front-loaded with the core purpose (verification stats and their axes) before the provenance and pricing detail. The sentence structure is dense but each clause adds information, and the bracketed HTTP/price/docs footer is genuinely useful metadata. Slight padding in the 'Transparent skill scores' and 'Free forever' framing.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

No output schema exists, so the description must convey what comes back; it does so conceptually ('MAE by variable, region, lead, segment') and explains the live-vs-offline separation, which an agent needs to interpret the numbers. It lacks concrete return shape and filtering semantics, but for a stats endpoint it is largely complete.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the description must compensate. It connects the params to output dimensions ('MAE by variable, region, lead'), which adds real meaning to variable/region/lead_hours as breakdown axes. But it never explains valid region strings, the lead_hours unit basis (1-240), or whether these filter or group, so compensation is partial.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

States a specific verb+resource ('forecast verification stats') and enumerates the exact breakdown axes (MAE by variable, region, lead, segment). It clearly reads as an aggregate scoring endpoint. It does not explicitly distinguish itself from the sibling weather_verification-station or weather_verification-table tools, so it falls short of a 5.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The line 'Free forever so you can judge the model before paying for forecasts' implies the use case (pre-purchase model evaluation), which is useful implied guidance. However, there is no explicit when-to-use vs when-not, and no routing to the sibling verification tools or to the forecast tools it validates against.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.