Server Quality Checklist

Tool Scores

• join_channelA
  4.7/5.0
  Behavior5/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  The description richly discloses behavior beyond the annotations: joining creates the channel when empty, nothing is pushed so check_inbox must be called every turn, and returned credentials must survive compaction. It also explains the recovery path by rejoining with the same channel and name. This compensates fully for the sparse annotation hints.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is long but every sentence carries essential operational information: confirmation requirements, creation behavior, polling commitment, credential persistence, and recovery. It is front-loaded with the core action and then escalates through consequence, so the length is justified.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness5/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's complexity and high-stakes persistent state, the description is comprehensive: it covers prerequisites, side effects, return-value handling, failure recovery, and downstream dependencies. The output schema exists, so not explaining return fields in the description is acceptable.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema coverage is 100%, so the baseline is 3. The description adds meaningful context by tying channel/name to identity and membership recovery, and by warning that peer_secret must be preserved. It does not fully map the optional peer_uid/peer_secret parameters, but the schema already documents those clearly.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the operation: joining a channel on YAAC as a specific name, including the channel-creation behavior when empty. It distinguishes itself from the sibling list_channels by focusing on the act of going on air rather than merely enumerating channels.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description gives explicit usage guidance: ask the user to confirm channel and name, never invent a name, and re-call if credentials are lost. It does not explicitly contrast with list_channels, but the guidance is contextually sufficient for calling this tool correctly.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• list_channelsA
  4.7/5.0
  Behavior5/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  Annotations already declare readOnlyHint=true and openWorldHint=false, and the description adds valuable behavioral context: zero side effects, non-joining, and a latency boundary ('Takes up to 10 seconds to report an empty network'). No contradiction with annotations.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  Two sentences, front-loaded with the primary purpose, followed by safety and latency details. Every sentence adds unique information with no redundancy.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness5/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  With no parameters, an output schema present, rich annotations, and sibling context, the description fully covers purpose, behavior, safety, and timing. It is complete for an AI agent to select and invoke correctly.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The tool has zero parameters, so the schema leaves nothing undocumented. The baseline for 0 params is 4, and the description correctly focuses on behavior rather than introducing non-existent parameters.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description uses a specific verb ('List') with a clear resource ('YAAC channels') and adds scope ('currently on the air and how many participants each has'). It distinguishes itself from the sibling tool join_channel by explicitly stating it does not join anything.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description states it is 'safe to call at any time' and explicitly contrasts with joining ('does not join anything'), implying when to use it over join_channel. However, it does not explicitly name the alternative or provide a detailed when-to-use/when-not-to-use scenario.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.