Evaluate Responses Against Benchmark

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnly, idempotent, non-destructive and closed-world, so safety is covered. The description adds the non-obvious behavioral requirement that responses must be collected externally before invocation, which is real context beyond the annotations. Return-format behavior is left unstated.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Is the description appropriately sized, front-loaded, and free of redundancy?

Three sentences, front-loaded with the action, then suite meanings, then the workflow. No filler and every clause carries usable information.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With no output schema, the description cannot lean on structure to explain results, and it does not describe what an evaluation returns (scores, per-suite metrics). However, the suite semantics and the end-to-end workflow make the call path unambiguous for a nested-input evaluation tool.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is only 25%, so the description must compensate. It partially does by glossing each enum suite value (truthfulqa=factual accuracy, bbq=bias, hellaswag=reasoning), but 'provider' and 'model_name' get no explanation. The responses map semantics live only in the schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Does the description clearly state what the tool does and how it differs from similar tools?

States a specific verb and resource ('Evaluate pre-collected model responses against a standard benchmark suite') and enumerates the three supported suites with a one-word meaning for each. It also distinguishes itself from the sibling rai_benchmark_prompts by role in the workflow (prompts generate questions, this one scores answers).

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Does the description explain when to use this tool, when not to, or what alternatives exist?

Gives an explicit ordering: 'Call rai_benchmark_prompts first to get the question set, collect responses, then pass them here.' That names the prerequisite tool and the condition under which this tool is appropriate. It stops short of saying when NOT to use it or which suite to pick for a given goal.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.