verify_determinism
Prove energy analyses are reproducible without a model: run a pinned reference suite twice, recheck in fresh interpreters, and compare SHA-256 digests to validate results.
Instructions
[READ][risk=low] Prove this engine's analysis is reproducible without a model.
Runs a named suite of analyses (availability, production counts, the Six Big
Losses, ISA-18.2 alarm load, control charts, the conservative baseline, the
RCA copilot) over a pinned reference dataset, canonically encodes each result
and digests it — twice in this process and, with ``subprocesses``, once more
in each of two fresh interpreters started at different PYTHONHASHSEED values.
That last arm is the one that catches a set or dict iteration order reaching a
result; a single run never can. The socket API raises throughout, so a
computation that reached for a device or a hostname fails here rather than
quietly succeeding on a machine that happens to be online. ``sys.modules`` is
checked afterwards for any model library — empty is the guarantee.
Use it to answer "how do I know your AI didn't make this number up": the
answer is that no model is in the path, and here is the SHA-256 that says so,
reproducible on the customer's own box. Read-only; nothing is written unless
the CLI (`iaiops verify determinism --out record.json`) is used to save the
signable record for a validation file.
Args:
subprocesses: Also re-run in two fresh interpreters at fixed, different
hash seeds (default True; adds roughly a second).
Returns dict: {check, result:{verdict ('reproducible'|'not_reproducible'),
suite_digest, dataset:{name, revision, digest}, checks:[{name, covers,
digest}], arms:[{arm, suite_digest, matches_first_arm}], arms_disagreeing,
model_modules_loaded, network}, context:{iaiops_version, python, platform,
generated_at, ...}, note}. ``result`` is identical between runs; ``context``
is not — it records when and where this run happened.
Example: verify_determinism().
Tool call template
This tool declares no required parameters. Add optional parameters from the input schema as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {},
"name": "verify_determinism"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| subprocesses | No |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||