Skip to main content
Glama

fahali_get_track_record_scorecard

Read-onlyIdempotent

Retrieve judged outcome scorecards by engine, claim family, asset class, regime, and horizon, including recall, precision, base rate, misses, and effective sample.

Instructions

Judged outcomes by engine, claim family, asset class, regime, and horizon, including misses, recall, precision, base rate, and effective sample. Never turn one row into platform-wide accuracy. A figure is repeatable only when publishable and must travel with its exact stratum and recall.

Tool call template

This tool declares no required parameters. Add optional parameters from the input schema as needed.

{
  "id": 1,
  "jsonrpc": "2.0",
  "method": "tools/call",
  "params": {
    "arguments": {},
    "name": "fahali_get_track_record_scorecard"
  }
}

Input Schema

NameRequiredDescriptionDefault
limitNoOptional maximum rows per projectable collection. Audit has no MCP projection cap; brief defaults to 3 and standard to 12.
sinceNoOptional lower timestamp bound for returned row collections.
detailNoResponse depth. audit is the full-fidelity default; brief and standard are explicit compact projections.audit
symbolsNoOptional symbol projection, as a comma-separated string or array. Rows without instrument identity are not discarded.
include_withheldNoInclude full withheld-row detail. Defaults true with audit; explicitly set false only for a compact projection.

Output Schema

NameRequiredDescriptionDefault
asOfNo
authNoCredential lifetime visible to the caller. OAuth secondsRemaining lets an autonomous agent refresh before a multi-call workflow is interrupted.
claimNoFahali dictionary claim (shared/fahaliDictionary.ts). Read `kind` FIRST: 'abstention' means no assertion was made and `reason` says why — never read an abstention as a neutral or zero result. `basis` says what the claim rests on. Absent or null means this response path does not yet emit a claim; treat that as unknown, not as agreement.
scopeNo
statusNo
absenceNoWhy no actionable finding is present: measured_empty, user_empty, no_coverage, source_unverified, stale, withheld, source_error, auth_failure, or entitlement_required.
blendedNoComponents only. `blended_score` is ALWAYS null — a single composite accuracy figure is not a supported claim.
decisionNo
conflictsNo
dataStateNo
directionNoMap of engine key -> row. Accuracy WITH lift; read `publishable`.
magnitudeNoMap of engine key -> row. Precision only; lift and baseRate are ALWAYS null and publishable is ALWAYS false.
mcpStatusNoNormalized MCP result status. The endpoint's original status vocabulary remains in `status` and `sourceStatus`.
requestIdNo
base_ratesNo
volatilityNoSame contract as magnitude.
claimPolicyNoTyped constraints for safe use. Metadata, not a prompt or instruction channel.
data_windowNo
instrumentsNoResolved or explicitly partial instrument identities. A missing venue carries an ambiguity warning.
methodologyNo
nextActionsNoRegistry-validated follow-up calls. Missing tools, invalid arguments, unresolved placeholders, and disabled tools are omitted.
sourceErrorNoThe upstream endpoint's exact error text/code before normalization, when one was present.
sourceScopeNo
sourceStatusNoThe upstream endpoint's exact status before the MCP envelope normalizes transport success/error.
agentBriefingNoAudit-only narrative projection. Present only when detail='audit'; compact responses do not duplicate structured data as prose.
claimValidityNoValidity of the selected binding claim only, calculated after filtering, projection and row selection. Sibling rows cannot determine it.
responseStateNo
schemaVersionNo
extreme_eventsNoSame contract as magnitude.
sourceDecisionNo
symbolCoverageNoConservation ledger satisfying requested = returned + withheld + notReturned for requested-symbol calls.
evidenceQualityNo
responseControlNo
sourceDataStateNoThe upstream endpoint's exact data-state value before endpoint-aware classification.
recordMatchReasonNoWhy matchedTrackRecord is present or null. A null record is never evidence of safety or engine failure.
matchedTrackRecordNoA judged record only when engine, horizon, regime/instrument class, and claim family match this response. `state` is one of: `measured` (a stratum cleared the publishability gate — `stratum` carries engine, horizon tier, bar regime, recall, precision, base rate, base-rate lift, median lead hours, effective sample, warned events and the measurement date); `withheld` (the gate ran and refused — `reason` says why, in words); `unavailable` (the record could not be read at all — an infrastructure failure that says nothing about the record). It is ONE stratum selected by recall, never a platform-wide accuracy. Null means no exact record match; read recordMatchReason.
confidenceSemanticsNoEvery confidence-bearing value with its score type, scale, calibration status, and probability flag.
decisionEligibilityNoFail-closed binding-authority policy. WITHHELD means source evidence remains available for audit while normalized direction, actionability and execution fields are revoked.
directionEligibilityNoCurrent market-direction eligibility. Direction is authorized only by an exact, eligible producer stratum (canonical_verdict, canonical_symbol_verdict, committee_verdict) — read bindingAuthority to see which one bound. Widening WHO may bind did not weaken WHAT binding requires: the named producer must still hold a matching horizon/class/family record on a verified-only judged population, so an authority without a record still cannot bind.
executionEligibilityNoFail-closed execution boundary. Portfolio monitoring tools always return WITHHELD with MONITOR_ONLY_NO_EXECUTION_AUTHORITY while Fahali has no capital path.
base_rates_by_horizonNo
monitoringEligibilityNoCurrent portfolio-monitoring validity based on captured identity, freshness, integrity, and the caller-supplied monitoring policy. ELIGIBLE authorizes observation/delivery only, never financial action.
sourceEvidenceQualityNo
currentActionEligibilityNoCurrent eligibility of an immutable historical portfolio verdict. It never mutates the stored judgment being replayed.
sourceConfidenceSemanticsNo

Schema Changelog

Changes observed during successful MCP inspections.

  1. Changed6 schema fields changedv1.28.1
    • addedInput schema / properties / detail
      Added value: +{
      +  "default": "audit",
      +  "description": "Response depth. audit is the full-fidelity default; brief and standard are explicit compact projections.",
      +  "enum": [
      +    "brief",
      +    "standard",
      +    "audit"
      +  ],
      +  "type": "string"
      +}
    • addedInput schema / properties / include_withheld
      Added value: +{
      +  "default": true,
      +  "description": "Include full withheld-row detail. Defaults true with audit; explicitly set false only for a compact projection.",
      +  "type": "boolean"
      +}
    • addedInput schema / properties / limit
      Added value: +{
      +  "description": "Optional maximum rows per projectable collection. Audit has no MCP projection cap; brief defaults to 3 and standard to 12.",
      +  "maximum": 100,
      +  "minimum": 1,
      +  "type": "integer"
      +}
    • addedInput schema / properties / since
      Added value: +{
      +  "description": "Optional lower timestamp bound for returned row collections.",
      +  "format": "date-time",
      +  "type": "string"
      +}
    • addedInput schema / properties / symbols
      Added value: +{
      +  "description": "Optional symbol projection, as a comma-separated string or array. Rows without instrument identity are not discarded.",
      +  "items": {
      +    "type": "string"
      +  },
      +  "type": [
      +    "string",
      +    "array"
      +  ]
      +}
    • changedOutput schema / (root)
      Previous value: -nullNew value: +{
      +  "properties": {
      +    "absence": {
      +      "description": "Why no actionable finding is present: measured_empty, user_empty, no_coverage, source_unverified, stale, withheld, source_error, auth_failure, or entitlement_required.",
      +      "type": [
      +        "object",
      +        "null"
      +      ]
      +    },
      +    "agentBriefing": {
      +      "description": "Audit-only narrative projection. Present only when detail='audit'; compact responses do not duplicate structured data as prose.",
      +      "type": "string"
      +    },
      +    "asOf": {
      +      "format": "date-time",
      +      "type": "string"
      +    },
      +    "auth": {
      +      "description": "Credential lifetime visible to the caller. OAuth secondsRemaining lets an autonomous agent refresh before a multi-call workflow is interrupted.",
      +      "properties": {
      +        "credentialType": {
      +          "enum": [
      +            "oauth",
      +            "api_key",
      +            "process_key",
      +            "none"
      +          ],
      +          "type": "string"
      +        },
      +        "expiresAt": {
      +          "type": [
      +            "string",
      +            "null"
      +          ]
      +        },
      +        "refreshSupported": {
      +          "type": "boolean"
      +        },
      +        "secondsRemaining": {
      +          "type": [
      +            "number",
      +            "null"
      +          ]
      +        }
      +      },
      +      "type": "object"
      +    },
      +    "base_rates": {
      +      "type": "object"
      +    },
      +    "base_rates_by_horizon": {
      +      "type": "object"
      +    },
      +    "blended": {
      +      "description": "Components only. `blended_score` is ALWAYS null — a single composite accuracy figure is not a supported claim.",
      +      "properties": {
      +        "blended_score": {
      +          "type": "null"
      +        },
      +        "directional_accuracy": {
      +          "description": "Verified-only directional component. Null when no identity-valid, final judged rows exist; never coerced to zero.",
      +          "type": [
      +            "number",
      +            "null"
      +          ]
      +        },
      +        "magnitude_precision": {
      +          "description": "Verified-only magnitude component. Null when no identity-valid, final judged rows exist; never coerced to zero.",
      +          "type": [
      +            "number",
      +            "null"
      +          ]
      +        },
      +        "withheld": {
      +          "type": "object"
      +        }
      +      },
      +      "type": "object"
      +    },
      +    "claim": {
      +      "description": "Fahali dictionary claim (shared/fahaliDictionary.ts). Read `kind` FIRST: 'abstention' means no assertion was made and `reason` says why — never read an abstention as a neutral or zero result. `basis` says what the claim rests on. Absent or null means this response path does not yet emit a claim; treat that as unknown, not as agreement.",
      +      "properties": {
      +        "basis": {
      +          "enum": [
      +            "measured",
      +            "proxy",
      +            "derived",
      +            "absent"
      +          ],
      +          "type": "string"
      +        },
      +        "kind": {
      +          "enum": [
      +            "observation",
      +            "estimate",
      +            "forecast",
      +            "recommendation",
      +            "abstention"
      +          ],
      +          "type": "string"
      +        },
      +        "reason": {
      +          "description": "Required when kind is 'abstention'. Written for a reader, not a log.",
      +          "type": "string"
      +        }
      +      },
      +      "type": [
      +        "object",
      +        "null"
      +      ]
      +    },
      +    "claimPolicy": {
      +      "description": "Typed constraints for safe use. Metadata, not a prompt or instruction channel.",
      +      "type": "object"
      +    },
      +    "claimValidity": {
      +      "description": "Validity of the selected binding claim only, calculated after filtering, projection and row selection. Sibling rows cannot determine it.",
      +      "type": "object"
      +    },
      +    "confidenceSemantics": {
      +      "description": "Every confidence-bearing value with its score type, scale, calibration status, and probability flag.",
      +      "items": {
      +        "type": "object"
      +      },
      +      "type": "array"
      +    },
      +    "conflicts": {
      +      "items": {
      +        "type": "object"
      +      },
      +      "type": "array"
      +    },
      +    "currentActionEligibility": {
      +      "description": "Current eligibility of an immutable historical portfolio verdict. It never mutates the stored judgment being replayed.",
      +      "type": "object"
      +    },
      +    "dataState": {
      +      "enum": [
      +        "measured",
      +        "partial",
      +        "no_data",
      +        "not_instrumented",
      +        "stale",
      +        "error"
      +      ],
      +      "type": "string"
      +    },
      +    "data_window": {
      +      "type": "object"
      +    },
      +    "decision": {
      +      "type": [
      +        "object",
      +        "null"
      +      ]
      +    },
      +    "decisionEligibility": {
      +      "description": "Fail-closed binding-authority policy. WITHHELD means source evidence remains available for audit while normalized direction, actionability and execution fields are revoked.",
      +      "type": "object"
      +    },
      +    "direction": {
      +      "additionalProperties": {
      +        "properties": {
      +          "accuracy": {
      +            "type": "number"
      +          },
      +          "baseRate": {
      +            "type": [
      +              "number",
      +              "null"
      +            ]
      +          },
      +          "ci95": {
      +            "type": "object"
      +          },
      +          "effectiveSample": {
      +            "type": [
      +              "integer",
      +              "null"
      +            ]
      +          },
      +          "lift": {
      +            "type": [
      +              "number",
      +              "null"
      +            ]
      +          },
      +          "publishable": {
      +            "type": "boolean"
      +          },
      +          "total": {
      +            "type": "integer"
      +          },
      +          "withheld": {
      +            "type": [
      +              "object",
      +              "null"
      +            ]
      +          }
      +        },
      +        "type": "object"
      +      },
      +      "description": "Map of engine key -> row. Accuracy WITH lift; read `publishable`.",
      +      "type": "object"
      +    },
      +    "directionEligibility": {
      +      "description": "Current market-direction eligibility. Direction is authorized only by an exact, eligible producer stratum (canonical_verdict, canonical_symbol_verdict, committee_verdict) — read bindingAuthority to see which one bound. Widening WHO may bind did not weaken WHAT binding requires: the named producer must still hold a matching horizon/class/family record on a verified-only judged population, so an authority without a record still cannot bind.",
      +      "type": "object"
      +    },
      +    "evidenceQuality": {
      +      "type": "object"
      +    },
      +    "executionEligibility": {
      +      "description": "Fail-closed execution boundary. Portfolio monitoring tools always return WITHHELD with MONITOR_ONLY_NO_EXECUTION_AUTHORITY while Fahali has no capital path.",
      +      "type": "object"
      +    },
      +    "extreme_events": {
      +      "description": "Same contract as magnitude.",
      +      "type": "object"
      +    },
      +    "instruments": {
      +      "description": "Resolved or explicitly partial instrument identities. A missing venue carries an ambiguity warning.",
      +      "items": {
      +        "type": "object"
      +      },
      +      "type": "array"
      +    },
      +    "magnitude": {
      +      "additionalProperties": {
      +        "properties": {
      +          "baseRate": {
      +            "type": "null"
      +          },
      +          "ci95": {
      +            "type": "object"
      +          },
      +          "effectiveSample": {
      +            "type": [
      +              "integer",
      +              "null"
      +            ]
      +          },
      +          "lift": {
      +            "type": "null"
      +          },
      +          "precision": {
      +            "type": "number"
      +          },
      +          "publishable": {
      +            "type": "boolean"
      +          },
      +          "total": {
      +            "type": "integer"
      +          },
      +          "withheld": {
      +            "properties": {
      +              "reason": {
      +                "type": "string"
      +              },
      +              "requiredMeasurement": {
      +                "type": "string"
      +              }
      +            },
      +            "type": "object"
      +          }
      +        },
      +        "type": "object"
      +      },
      +      "description": "Map of engine key -> row. Precision only; lift and baseRate are ALWAYS null and publishable is ALWAYS false.",
      +      "type": "object"
      +    },
      +    "matchedTrackRecord": {
      +      "description": "A judged record only when engine, horizon, regime/instrument class, and claim family match this response. `state` is one of: `measured` (a stratum cleared the publishability gate — `stratum` carries engine, horizon tier, bar regime, recall, precision, base rate, base-rate lift, median lead hours, effective sample, warned events and the measurement date); `withheld` (the gate ran and refused — `reason` says why, in words); `unavailable` (the record could not be read at all — an infrastructure failure that says nothing about the record). It is ONE stratum selected by recall, never a platform-wide accuracy. Null means no exact record match; read recordMatchReason.",
      +      "properties": {
      +        "dataAsOf": {
      +          "description": "When the record was computed. A figure without this reads as current forever.",
      +          "type": "string"
      +        },
      +        "reason": {
      +          "description": "Present on `withheld` and `unavailable`: why there is no figure.",
      +          "type": "string"
      +        },
      +        "state": {
      +          "enum": [
      +            "measured",
      +            "withheld",
      +            "unavailable"
      +          ],
      +          "type": "string"
      +        },
      +        "stratum": {
      +          "description": "Present only on `measured`. Precision must never be quoted without recall.",
      +          "properties": {
      +            "barRegime": {
      +              "type": "string"
      +            },
      +            "baseRatePct": {
      +              "type": "number"
      +            },
      +            "claimFamily": {
      +              "description": "What this precision is ABOUT: `directional` (price moved the way the stratum said) or `magnitude` (a move exceeded the judge bar, carrying no direction). Never infer a direction from a `magnitude` row.",
      +              "type": "string"
      +            },
      +            "claimMeans": {
      +              "description": "The record endpoint's own sentence explaining the claim family. Quote it beside any precision figure.",
      +              "type": "string"
      +            },
      +            "effectiveSample": {
      +              "type": "number"
      +            },
      +            "engine": {
      +              "type": "string"
      +            },
      +            "horizonTier": {
      +              "type": "string"
      +            },
      +            "leadMedianHours": {
      +              "type": "number"
      +            },
      +            "measuredOn": {
      +              "type": "string"
      +            },
      +            "precisionPct": {
      +              "description": "Share of its warnings that held. Never quotable alone.",
      +              "type": "number"
      +            },
      +            "recallPct": {
      +              "description": "Share of qualifying events this stratum warned on — the half a buyer is exposed to.",
      +              "type": "number"
      +            },
      +            "warnedEvents": {
      +              "type": "number"
      +            }
      +          },
      +          "type": "object"
      +        }
      +      },
      +      "required": [
      +        "state"
      +      ],
      +      "type": [
      +        "object",
      +        "null"
      +      ]
      +    },
      +    "mcpStatus": {
      +      "description": "Normalized MCP result status. The endpoint's original status vocabulary remains in `status` and `sourceStatus`.",
      +      "enum": [
      +        "ok",
      +        "error"
      +      ],
      +      "type": "string"
      +    },
      +    "methodology": {
      +      "type": "object"
      +    },
      +    "monitoringEligibility": {
      +      "description": "Current portfolio-monitoring validity based on captured identity, freshness, integrity, and the caller-supplied monitoring policy. ELIGIBLE authorizes observation/delivery only, never financial action.",
      +      "type": "object"
      +    },
      +    "nextActions": {
      +      "description": "Registry-validated follow-up calls. Missing tools, invalid arguments, unresolved placeholders, and disabled tools are omitted.",
      +      "items": {
      +        "properties": {
      +          "args": {
      +            "additionalProperties": {
      +              "type": "string"
      +            },
      +            "type": "object"
      +          },
      +          "requiredTier": {
      +            "type": "string"
      +          },
      +          "tool": {
      +            "type": "string"
      +          },
      +          "why": {
      +            "type": "string"
      +          }
      +        },
      +        "required": [
      +          "tool",
      +          "why"
      +        ],
      +        "type": "object"
      +      },
      +      "type": "array"
      +    },
      +    "recordMatchReason": {
      +      "description": "Why matchedTrackRecord is present or null. A null record is never evidence of safety or engine failure.",
      +      "type": "string"
      +    },
      +    "requestId": {
      +      "type": "string"
      +    },
      +    "responseControl": {
      +      "type": "object"
      +    },
      +    "responseState": {
      +      "enum": [
      +        "OK_WITH_FINDINGS",
      +        "OK_NO_FINDINGS",
      +        "PARTIAL",
      +        "WITHHELD",
      +        "NO_COVERAGE",
      +        "ERROR"
      +      ],
      +      "type": "string"
      +    },
      +    "schemaVersion": {
      +      "enum": [
      +        "2.0"
      +      ],
      +      "type": "string"
      +    },
      +    "scope": {
      +      "type": "object"
      +    },
      +    "sourceConfidenceSemantics": {
      +      "type": [
      +        "array",
      +        "object",
      +        "null"
      +      ]
      +    },
      +    "sourceDataState": {
      +      "description": "The upstream endpoint's exact data-state value before endpoint-aware classification.",
      +      "type": [
      +        "string",
      +        "null"
      +      ]
      +    },
      +    "sourceDecision": {
      +      "type": [
      +        "object",
      +        "null"
      +      ]
      +    },
      +    "sourceError": {
      +      "description": "The upstream endpoint's exact error text/code before normalization, when one was present.",
      +      "type": [
      +        "string",
      +        "null"
      +      ]
      +    },
      +    "sourceEvidenceQuality": {
      +      "type": [
      +        "object",
      +        "null"
      +      ]
      +    },
      +    "sourceScope": {
      +      "type": [
      +        "object",
      +        "null"
      +      ]
      +    },
      +    "sourceStatus": {
      +      "description": "The upstream endpoint's exact status before the MCP envelope normalizes transport success/error.",
      +      "type": [
      +        "string",
      +        "null"
      +      ]
      +    },
      +    "status": {
      +      "type": "string"
      +    },
      +    "symbolCoverage": {
      +      "description": "Conservation ledger satisfying requested = returned + withheld + notReturned for requested-symbol calls.",
      +      "type": "object"
      +    },
      +    "volatility": {
      +      "description": "Same contract as magnitude.",
      +      "type": "object"
      +    }
      +  },
      +  "type": "object"
      +}
  2. Addedv1.5.3

TDQS

A3.7/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already cover safety (readOnly, idempotent, non-destructive), so the description earns credit for adding substance beyond them: stratification, inclusion of misses and effective sample, a 'publishable' gating concept, and an explicit warning against generalizing a single row. Withheld-row and projection behavior are left to the schema rather than restated.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Three short sentences, front-loaded with the scope and metric inventory before the cautionary rules. Every sentence carries weight; only the phrase 'must travel with its exact stratum and recall' is slightly cryptic in wording.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With a full output schema and rich annotations already in place, the description supplies the one thing structured fields cannot: the epistemic framing (stratified, publishable-only, sample-size aware). It does not explain what distinguishes 'publishable' from 'withheld' rows, which would complete the picture.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the schema fully documents limit, since, detail, symbols, and include_withheld. The description adds no parameter-level detail beyond the existing enum and default semantics, which is acceptable at this coverage level but not additive.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description names a specific resource (judged outcomes / track record) and enumerates the stratifying dimensions (engine, claim family, asset class, regime, horizon) plus the metrics included (misses, recall, precision, base rate, effective sample). It is clearly distinct from siblings like get_engine_status or get_lead_time, though it lacks an explicit verb, describing the payload rather than the action.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The two closing sentences give interpretive rules ('never turn one row into platform-wide accuracy', 'repeatable only when publishable'), which tells the agent how to use the output but not when to call this tool instead of a sibling such as get_engine_status or get_verdict_history. Usage is implied rather than stated with alternatives or exclusions.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Deploy Server

Other Tools