addedInput schema / examples
Added value: +[
+ {
+ "assertions": [
+ {
+ "tool": "search",
+ "type": "must_call"
+ }
+ ],
+ "trace": [
+ {
+ "role": "assistant",
+ "tool_calls": [
+ {
+ "function": {
+ "arguments": "{}",
+ "name": "search"
+ }
+ }
+ ]
+ }
+ ]
+ }
+]
removedInput schema / properties / assertions / description
Removed value: -"List of assertions to validate against the trace."
changedInput schema / properties / assertions / items / properties / after / description
Previous value: -"[order] Tool that must be called after."New value: +"[order] Called after."
changedInput schema / properties / assertions / items / properties / before / description
Previous value: -"[order] Tool that must be called first."New value: +"[order] Called first."
removedInput schema / properties / assertions / items / properties / id / description
Removed value: -"Optional assertion identifier."
changedInput schema / properties / assertions / items / properties / max / description
Previous value: -"[max_calls] Maximum number of allowed calls."New value: +"[max_calls]"
changedInput schema / properties / assertions / items / properties / min / description
Previous value: -"[min_calls] Minimum number of required calls."New value: +"[min_calls]"
changedInput schema / properties / assertions / items / properties / sensitivity / description
Previous value: -"[no_injection] Default low = critical patterns only (override, jailbreak, fake role delimiters). Higher catches more and fires on ordinary text (\"act as\", {{templates}}) — pattern matching, not a classifier."New value: +"[no_injection] Default low (critical patterns only); higher also fires on ordinary text."
changedInput schema / properties / assertions / items / properties / tool / description
Previous value: -"Tool name to check (for must_call, must_not_call, max_calls, min_calls)."New value: +"For must_call, must_not_call, max_calls, min_calls."
changedInput schema / properties / assertions / items / properties / type / description
Previous value: -"Assertion type. no_injection runs prompt_injection_scan on every tool result (indirect injection: text a third party wrote that the agent then reads); no_pii runs redact_pii on the final answer (a leak to the user). Both report types and counts, never the matched values."New value: +"no_injection scans tool results (indirect injection); no_pii scans the final answer. Both report types and counts, never values."
changedInput schema / properties / assertions / items / properties / types / description
Previous value: -"[no_pii] Comma-separated PII types (email, phone, ssn, credit_card, ip_address, jwt). Default: all."New value: +"[no_pii] Comma-separated: email, phone, ssn, credit_card, ip_address, jwt. Default all."
changedInput schema / properties / assertions / items / properties / where / description
Previous value: -"[no_injection, no_pii] What to scan. Defaults: no_injection → tool_results, no_pii → answer (PII in a tool result is often legitimate — an order carries the customer email)."New value: +"[no_injection, no_pii] Override what is scanned."
changedInput schema / properties / format / description
Previous value: -"Trace format. auto (default) detects automatically."New value: +"Default auto."
changedInput schema / properties / trace / description
Previous value: -"Agent execution trace as JSON (OpenAI messages array, LangChain run tree) or plain text log (Thought/Action/Observation format)."New value: +"The trace: JSON (messages array, run tree) or a Thought/Action/Observation text log."