Skip to main content
Glama

sebbi.pro - the proof layer for AI

Replay past decisions under new rules

sebbi_forensic_replay

Forensic Replay Sandbox. Replays every AI decision sealed with the customer's API key under a new rule set and returns which verdicts would change, which way, by month, the money behind them and the rule that caused each. Rule set: allow_below and block_from (verdict boundaries, today 0.35 and 0.70), factors (history, amount, device_risk, anomaly, unsafe_country as multipliers, 1 = unchanged), high_risk_countries and safe_countries (country codes), signal_weights for the customer's own risk signals, and rules: [{name, field, op (eq, ne, gt, gte, lt, lte, in, not_in, contains, exists), value, then (CHALLENGE or BLOCK)}] on any field they send. Records are verified untouched first and only exactly reproducible decisions are counted. The run is sealed into the chain and gets a shareable report link.

Tool call template

Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.

{
  "id": 1,
  "jsonrpc": "2.0",
  "method": "tools/call",
  "params": {
    "arguments": {
      "api_key": "<api_key>"
    },
    "name": "sebbi_forensic_replay"
  }
}

Input Schema

NameRequiredDescriptionDefault
toNoLast day, YYYY-MM-DD (optional)
fromNoFirst day, YYYY-MM-DD (optional)
nameNoA name for the rule change, e.g. 'Human review over 10,000'
api_keyYes
rulesetNoThe new rules, as described above

Schema Changelog

Changes observed during successful MCP inspections.

  1. Added

TDQS

A4.4/5.0
Behavior5/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Goes well beyond the annotations by disclosing verification behavior ('Records are verified untouched first'), a reproducibility constraint ('only exactly reproducible decisions are counted'), and side effects ('sealed into the chain', 'shareable report link'). This is consistent with readOnlyHint=false and destructiveHint=false while giving real operational context.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Purpose and return value are front-loaded, followed by ruleset detail and then the verification/sealing behavior, so the ordering is sensible. The first sentence is dense and runs long, and the ruleset enumeration is packed into a single sprawling clause, costing some readability.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With no output schema, the description does the work of explaining what comes back (which verdicts change, direction, month, money, causing rule) plus verification and report-link side effects. It stops short of describing the response envelope or how 'by month' is structured, which is the only real gap for a 5-parameter nested-input tool.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters5/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The schema leaves the nested ruleset object opaque ('The new rules, as described above'), and the description fully compensates by defining allow_below/block_from with current defaults, the factor multipliers, country lists, signal_weights, and the rules array shape with its full op enum and then values. This is essential meaning absent from the schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description opens with a specific verb and resource ('Replays every AI decision sealed with the customer's API key under a new rule set') and clearly frames this as a sandbox batch simulation, which separates it from single-shot siblings like sebbi_test_decision. The returned artifact (changed verdicts by month with money and causing rule) is stated up front.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Usage is only implied: an agent can infer this is the tool for 'what would change if we altered the rules', but there is no explicit when-to-use versus sebbi_test_decision or sebbi_enforce_create, and no stated prerequisites beyond supplying an api_key. No conditions or exclusions are given.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.

Resources