Server Quality Checklist

Tool Scores

• set_asi_paramsC
  2.6/5.0
  Behavior1/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden of behavioral disclosure, but it merely restates the tool's action. It does not mention side effects, whether settings apply immediately, whether a restart is needed, or any dependencies.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness3/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single compact sentence with no wasted words, which is structurally concise. However, it is under-specified rather than helpfully concise, omitting context that would aid tool selection and invocation.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a tool with no annotations, this description is insufficient: it lacks usage guidelines, behavioral context, and sibling differentiation. The presence of an output schema and full input schema reduces the need for return-value documentation, but the tool still needs more contextual guidance.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The input schema has 100% coverage with descriptions for all three parameters, so the baseline is 3. The description adds no additional parameter semantics, but the schema already documents remux, tx_mode, and playout_rate.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description 'Set ASI output parameters' clearly names the verb (set) and resource (ASI output parameters), matching the tool name. However, it does not explain what ASI is or differentiate this from sibling tools like set_tsoip_params or set_rf_params.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  No guidance is given on when to use this tool versus alternatives such as set_rate or the other *_params tools. There are no prerequisites, context, or exclusions stated, leaving the agent to guess.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• open_fileC
  2.9/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries the full burden. It does not disclose side effects (e.g., overwriting current file), prerequisites (e.g., requiring an active connection), or additional accepted file types (the schema mentions XML settings). The single clause 'for playout' gives minimal context but lacks necessary behavioral detail.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness4/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single concise sentence with the core action front-loaded. It is not bloated, but it is slightly under-specified; however, for the purpose of conciseness it is well-sized.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Even though the tool is simple and an output schema exists, the lack of annotations and workflow context leaves gaps. The description does not mention that opening a file might replace the current one, require a connection, or that it can open XML settings files. Given sibling tools suggest a connected workflow, more context is needed.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 100% for the only parameter, so the baseline is 3. The tool description adds no parameter-level meaning; the schema's filepath description ('Full path to the .ts file or StreamXpress .xml settings file') is actually richer than the tool description. No bonus is warranted.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description 'Open a TS file for playout' clearly states the verb (open) and resource (a TS file) for a distinct action compared to sibling tools like connect, start, or set_rate. However, it omits that the filepath parameter can also be a StreamXpress .xml settings file, making the description slightly incomplete and narrower than the schema.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  There is no guidance on when to use this tool versus alternatives, nor any indication of prerequisites (e.g., must be connected first) or typical workflow ordering (e.g., open_file before start). The description simply states the action without context.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• select_portB
  3.1/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  Annotations are absent, so the description must carry the burden of behavioral disclosure. It does not explain whether this operation mutates state, has side effects, or requires specific conditions. The single sentence adds no transparency beyond what 'select' implies.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single clear sentence with no redundant words. It is appropriately sized for a straightforward selection tool.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  The presence of an output schema reduces the need to explain return values. The schema also documents prerequisites (serial from scan_ports). However, the description alone does not place the tool within a broader setup workflow or mention potential side effects, leaving some gaps.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The input schema covers 100% of parameters with descriptions, so the baseline is 3. The description itself adds no parameter-specific meaning, but the schema already provides sufficient details such as 'serial from scan_ports' and 'modulation standard'.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description uses a specific verb ('select') and resource ('physical output port for playout'), clearly indicating the tool's function. It differentiates from sibling tools like scan_ports and connect by focusing on choosing an output port for playout.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  No guidance is provided on when to use this tool or how it fits into a workflow. The schema mentions 'serial' comes from scan_ports, but the description itself does not reference prerequisites, alternatives, or sequencing.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• set_tsoip_paramsB
  3.1/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description carries the full burden for behavioral disclosure. It only states that the tool 'configures' parameters without revealing whether changes take effect immediately, whether they overwrite existing settings, what happens on invalid input, or whether a restart is required. This is a significant gap for a configuration/mutation tool.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness4/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, focused sentence with no redundancy. It earns its place by clearly stating the tool's purpose, but it could arguably be more informative without becoming verbose.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Despite being a simple configuration tool, the description lacks essential context: it does not specify whether the destination must be set before starting, how the FEC/TTL settings interact, or what state the output must be in. The existence of an output schema reduces the need to describe return values, but the sparse description leaves gaps in operational usage.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema coverage is 100% with detailed descriptions for all 7 parameters, so the baseline is 3. The description adds minimal contextual framing by identifying these as 'output parameters' but does not elaborate on any specific parameter meanings beyond what is already in the schema.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description uses a specific verb ('Configure') and a specific resource ('TS-over-IP output parameters'), and it explicitly mentions the protocol scope (UDP/RTP). This clearly distinguishes it from sibling tools like set_rf_params and set_asi_params, which target different output types.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  No guidance is provided on when to use this tool versus alternatives. It does not mention prerequisites, whether it should be called before start, or how it relates to set_rf_params/set_asi_params. The context is only implied by the tool name and the phrase 'UDP/RTP'.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• set_rateA
  3.5/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are present, and the description only states the tool's action without disclosing side effects, constraints, or interaction with other settings. The detail about 188-byte packets adds technical context but does not explain behavioral traits such as valid ranges, persistence, or call timing.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, information-dense sentence that immediately conveys the action, target, and unit. It contains no filler or redundant information, earning a perfect score for conciseness.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a simple one-parameter setter with an output schema, the description covers the core purpose and parameter semantics. However, it omits operational context such as when the setting takes effect or any prerequisites, making it minimally adequate but not fully complete.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The schema already fully describes the parameter (rate_bps) with an example, and the description enhances it by specifying the measurement basis (188-byte packets). This additional semantic detail helps distinguish the intended bitrate calculation from raw data rate, adding value beyond the schema.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the verb 'Set' and the resource 'TS playout bitrate' with explicit units ('bits per second (188-byte packets)'). It distinguishes itself from sibling set_* tools by targeting the rate specifically, leaving no ambiguity about its function.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  No guidance is provided on when to use this tool versus alternatives or prerequisites (e.g., whether the device must be connected or if the rate can be changed during playout). Sibling tools like set_tsoip_params or set_rf_params are not referenced, so the description offers no usage context.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• stopA
  3.6/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden of behavioral disclosure. It states the core action ('Stop TS playout') but does not disclose side effects, idempotence, error behavior, or whether any state is required. This is a significant gap for an operation that mutates playout state.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, front-loaded sentence with zero wasted words. It immediately communicates the action and target, making it perfectly concise for a tool with no parameters.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the simplicity of a zero-parameter stop action and the presence of an output schema, the description is nearly complete. However, it lacks any context about behavioral expectations (e.g., whether it errors if nothing is playing), but this is a minor gap for such a simple tool.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The tool has zero parameters, so there is nothing to document. Per the rubric, a baseline of 4 is appropriate when no parameters exist; the description adds no parameter-specific information because none is needed.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description 'Stop TS playout' uses a specific verb ('Stop') and clearly identifies the resource ('TS playout'). It is concise and directly contrasts with sibling tool 'start', making its purpose unambiguous.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  No guidance is provided on when to use this tool versus alternatives. It does not mention prerequisites, whether it should only be called after 'start', or any conditions for safe use. The tool name implies usage, but the description offers no explicit context.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• connectA
  3.7/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries the full burden. It discloses the startup requirement but does not explain connection behavior (e.g., whether it is idempotent, what happens on failure, or if prior setup is needed beyond the -rc flag). This is insufficient for a state-changing tool.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  Two short sentences with no filler. The essential information is front-loaded, and every word contributes to the purpose or usage prerequisite. Highly concise and well-structured.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's role in a larger workflow (siblings include start, stop, select_port), the description does not mention that connect is a mandatory first step. An output schema exists, but the description does not indicate what a successful or failed connection returns. The description is adequate for a simple tool but lacks workflow context.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 100%, so the parameters are already well documented. The description adds a small amount of context by tying the port to the '-rc' listener, which slightly reinforces the schema's meaning but does not fundamentally expand it.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the action ('Connect') and the specific resource ('a StreamXpress instance running in remote-control mode'). This distinguishes the tool from siblings like 'disconnect' and 'scan_ports' and gives a precise purpose without ambiguity.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides a critical prerequisite (starting StreamXpress with '-rc <port>'), which is essential context for when to use this tool. It does not explicitly mention when not to use it or compare with alternatives, but the intent is clear from the tool name and sibling set.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• disconnectA
  3.7/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries the full burden of behavioral disclosure. It only states the action without detailing side effects (e.g., closing network connections, ending session, idempotency, or cleanup). This is a significant gap for a state-changing operation.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, simple sentence with no fluff or redundancy. It is perfectly concise and front-loaded, stating the essential information immediately.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  The tool is low-complexity (0 parameters, simple action), but the description lacks context about session management, such as whether it is the counterpart to 'connect', whether it is safe to call multiple times, or what the output schema contains. The lack of annotations and behavioral details leaves some gaps.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The input schema has zero parameters, so there is no parameter semantics to explain. Baseline is 4 for 0-param tools, and the description adds nothing beyond the schema, which is acceptable.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the action ('Disconnect') and the resource ('StreamXpress remote-control session'), distinguishing it from siblings like 'connect' and 'stop'. The verb+resource combination is specific and unambiguous.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies usage (call when you want to end the session) but provides no explicit guidance on when to use this tool versus alternatives like 'stop' or 'connect'. No exclusions or context are given, making the guidance minimal.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• startA
  3.7/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries the full burden of behavioral disclosure. It does not mention prerequisites (e.g., must have an open file or connected port), side effects (e.g., begins streaming), error conditions, or whether the operation is reversible.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, direct sentence with no wasted words. It is front-loaded with the action verb.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  The tool is simple with no parameters and an output schema, so the description need not cover return values. However, the lack of behavioral transparency and explicit usage guidance leaves some gaps for an agent deciding how and when to invoke this tool.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The tool has zero parameters, so the parameter semantics baseline is 4. The description does not need to add parameter information, and none is provided.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the action ('Start'), the resource ('TS playout'), and the context ('selected port'). It distinguishes from the sibling tool 'stop', which performs the inverse operation.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The phrase 'on the selected port' implies that a port must first be selected via 'select_port', but the description does not explicitly state when to use this tool or mention any alternatives. There are no exclusions or conditions provided.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get_statusA
  3.8/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description must carry the burden of behavioral disclosure. 'Get' implies a read-only operation, but it does not state whether a connection must be active, whether it returns real-time data, or any error conditions. The listed fields add some transparency, but the description lacks depth.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, front-loaded sentence that immediately identifies the action and resource. It includes the most important output fields without any wasted words.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's simplicity (no params, output schema exists), the description covers the essential purpose and key return fields. It is complete enough for an agent to understand the tool's role, though a note about preconditions (e.g., needing a connection) would enhance completeness.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The tool has zero parameters, so the description is not required to explain parameter meanings. The baseline for no parameters is 4, and the description correctly focuses on the output fields rather than nonexistent inputs.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description uses a specific verb 'Get' with a clear resource 'current playout status' and lists concrete fields (position, wraps, filename, bitrate). It clearly distinguishes this tool from sibling control tools like start, stop, and set_rate, which are all action-oriented.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  No guidance is provided on when to use this tool versus alternatives. The description only states what it does, not when or whether it should be preferred over other tools. Sibling tools like connect, open_file, and start suggest a workflow, but the description gives no explicit context for using get_status.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• set_rf_paramsA
  3.8/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description must disclose behavioral traits. It only states the operation and scope, but does not mention side effects, prerequisites (e.g., connection or selected port), or whether the change is immediate or persistent. This leaves significant ambiguity for a mutation tool.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, focused sentence that front-loads the core action. It contains no filler or redundant information, making it highly efficient.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a simple 2-parameter tool with full schema and an output schema, the description covers the essential purpose and scope. It lacks explicit prerequisites like requiring an active connection or selected port, but the context is largely complete given the tool's simplicity.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 100%, with both parameters fully described in the input schema. The tool description adds no additional parameter meaning beyond the schema, so the baseline of 3 applies.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description states a specific action 'Set' and the resource 'RF output frequency and level', clearly identifying what the tool does. The parenthetical 'modulator ports only' differentiates it from sibling tools like set_asi_params or set_tsoip_params, which target other parameter types.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description gives a clear usage constraint: 'modulator ports only', indicating when this tool is appropriate. While it doesn't explicitly name alternatives, the scope is evident from the context, and the sibling tools' names imply distinct parameter sets.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• scan_portsA
  4.3/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the burden of disclosing behavioral traits. It states the operation (scan) and return value (port descriptors with serial, type, output capabilities). However, it does not explicitly state that the operation is read-only or safe, nor does it mention any prerequisites like an active connection (only 'connected' as an adjective). This is adequate but not fully transparent.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is two sentences, front-loaded with the purpose and followed by the return value. Every sentence is informative and there is no waste, padding, or repetition. Structure is excellent.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness5/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool has no parameters and an output schema that likely documents the return fields, the description is fully complete. It explains what the tool does and what it returns, with no need to detail return structure (handled by schema) or prerequisites beyond the implied connection. This is a self-contained, sufficient description.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The tool has zero parameters and 100% schema coverage (empty schema). The baseline for zero parameters is 4, and there is no parameter meaning to convey. The description correctly implies that the tool requires no additional input.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description uses a specific verb ('Scan') and clearly identifies the resource ('available output ports on the connected StreamXpress'). It distinguishes itself from sibling tools like 'connect' and 'select_port' by focusing on enumeration of ports. This is a clear and unambiguous purpose.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies usage context by mentioning 'on the connected StreamXpress', suggesting it should be called after establishing a connection. It doesn't explicitly name alternatives or exclusions, but its complementary role to select_port is evident. This gives reasonable context without explicit 'when not to use' guidance.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.