Server Quality Checklist

Tool Scores

• truenasA
  4/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description carries the burden of behavioral disclosure. It usefully reveals the two-step discovery workflow and that the third step executes an action. However, it does not mention whether actions may be destructive, require authentication, or what the return/response looks like. The described behavior is accurate but lacks safety/state-change context.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is concise, well-structured, and front-loaded with the core purpose. The bulleted usage modes are efficient and each sentence contributes either to purpose or to the invocation protocol. The category list is compact and complete.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a meta-tool exposing 278 actions, the description provides a complete discovery protocol and lists all top-level categories, making the tool usable in practice. The absence of an output schema means return values are not documented, but the stepwise discovery mechanism compensates by letting the agent learn on the fly. Slight gap: no mention of error handling or authentication expectations, though these are per-action details.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The input schema provides descriptions for all parameters (100% coverage), so the description adds little beyond what is already structured. It reiterates that omitting action discovers actions and that params are discovered by calling with category only. This repetition confirms the discovery flow but does not add new field-level insight such as value formats or examples.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool manages TrueNAS and enumerates 278 actions across specific categories (system, storage, sharing, etc.), which grounds its purpose. The verb 'manage' is broad, but the category list and usage modes make the tool's role as a gateway/dispatcher apparent. It does not need sibling differentiation because no siblings are listed.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines5/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  Usage is explicitly and clearly specified with three distinct invocation patterns: no args or category='help' lists categories, category alone lists available actions, and category+action executes with params. This is directly actionable guidance with no ambiguity, and it even explains how to discover required parameters.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.