Audit the agent's past decisions
audit_my_agentSends a Plures audit: up to 50 decisions an AI agent already made, graded so the developer sees which were wrong. The account's first audit is free. After it has finished, each further audit is paid from the account's credit when it is sent: $0.20 a decision, or $0.50 for kind judgment, so tell the developer the cost and get their yes before sending a second one. One audit at a time. Works with a test or live key. Each row is input (what the agent saw, including the policy it should follow) and decision (what it did). Gather them from the developer's logs, database or test fixtures; leave out names and other private details (emails, phones and card numbers are removed anyway). kind check (default) asks whether each call was right (the dashboard calls it the accuracy audit); kind judgment asks whether a customer would be happy with it (the quality audit). Text only: to have an image, video or audio clip judged, the developer sends a quality audit from plures.si/dashboard/audit with a media column. A person at Plures reviews it before anyone grades it. Use get_audit_report to read the results.
Tool call template
This tool declares no required parameters. Add optional parameters from the input schema as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {},
"name": "audit_my_agent"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| csv | No | Instead of rows: CSV text with a header row and columns input and decision | |
| kind | No | check (default): was each call right. judgment: would a customer be happy with it | |
| rows | No | The decisions: what the agent saw and what it did | |
| about | No | What the agent does, in a sentence, e.g. "Answers support tickets and can refund up to $50" |