Server Quality Checklist

Tool Scores

• ssh_connectC
  2.9/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden of behavioral disclosure. 'Connect' implies establishing a persistent session, but the description doesn't specify what happens after connection (e.g., whether it maintains state, returns a connection handle, or has timeout behavior). It mentions SSH but doesn't detail security implications, error handling, or what constitutes a successful connection.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, clear sentence that efficiently conveys the core function without unnecessary words. It's front-loaded with the essential action and resource, making it easy for an agent to parse. Every word earns its place in this minimal but complete statement.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a tool with 7 parameters, no annotations, and no output schema, the description is insufficient. It doesn't address what the tool returns (e.g., connection status, session ID), error conditions, or behavioral details like persistence. Given the complexity of SSH connections and the lack of structured metadata, the description should provide more operational context.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 100%, so all parameters are documented in the schema. The description adds no additional parameter semantics beyond the basic action of connecting. It doesn't explain parameter interactions (e.g., password vs privateKeyPath) or provide context beyond what the schema already specifies. Baseline 3 is appropriate given high schema coverage.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the action ('connect') and target ('to a remote server via SSH'), making the purpose immediately understandable. It distinguishes from siblings like ssh_disconnect or ssh_exec by specifying the connection establishment function. However, it doesn't explicitly differentiate from all SSH-related siblings beyond the basic verb.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides no guidance on when to use this tool versus alternatives. It doesn't mention prerequisites like needing authentication credentials, nor does it explain when to choose this over other SSH tools like ssh_exec (which might handle both connection and command execution). The context is implied but not articulated.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• ssh_disconnectC
  2.9/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries full burden for behavioral disclosure. It states the action (close) but doesn't describe effects (e.g., terminates session, frees resources), side effects, error conditions, or permissions required. This is a mutation tool with minimal behavioral context.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, efficient sentence with zero wasted words. It's appropriately sized for a simple tool and front-loads the core action. Every word earns its place.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a mutation tool with no annotations and no output schema, the description is inadequate. It doesn't explain what happens after closing (success/failure states, return values), error handling, or dependencies on active connections. Given the complexity and lack of structured data, more context is needed.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 100% (connectionId parameter fully documented in schema). The description adds no parameter-specific details beyond what the schema provides. Baseline 3 is appropriate when the schema does the heavy lifting.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description 'Close an SSH connection' clearly states the action (close) and resource (SSH connection). It distinguishes from siblings like ssh_connect (open) and ssh_exec (run commands), but doesn't explicitly mention this differentiation. The purpose is specific and unambiguous.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides no guidance on when to use this tool versus alternatives. It doesn't mention prerequisites (e.g., needing an active connection), exclusions, or relationships with sibling tools like ssh_connect. Usage context is implied but not stated.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• ssh_download_fileC
  2.9/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden of behavioral disclosure. It states the action ('Download') but doesn't describe what happens during execution—such as whether it overwrites local files, handles errors, requires specific permissions, or provides progress feedback. This leaves significant gaps for a file transfer operation.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, efficient sentence that directly states the tool's function without any unnecessary words. It's front-loaded with the core action, making it easy to parse and understand immediately.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a file download tool with no annotations and no output schema, the description is incomplete. It doesn't explain what the tool returns (e.g., success status, error messages, or file metadata), nor does it cover behavioral aspects like error handling or security considerations, which are critical for SSH operations.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 100%, so the schema already documents all three parameters (connectionId, remotePath, localPath) with clear descriptions. The description adds no additional meaning beyond what's in the schema, such as file format support or path validation rules, meeting the baseline for high coverage.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the action ('Download') and resource ('a file from the remote server'), making the tool's purpose immediately understandable. However, it doesn't explicitly differentiate from sibling tools like ssh_upload_file or ssh_list_files, which would require mentioning it's specifically for file retrieval rather than upload or listing.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides no guidance on when to use this tool versus alternatives. It doesn't mention prerequisites like needing an active SSH connection (implied by the connectionId parameter but not stated), nor does it differentiate from siblings such as ssh_upload_file for uploading or ssh_list_files for browsing files.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• ssh_execC
  2.9/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden of behavioral disclosure. It states the action but lacks critical details: it doesn't mention security implications, permission requirements, output format (e.g., stdout/stderr), error handling, or that it might affect the remote system. This is inadequate for a mutation tool with zero annotation coverage.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, efficient sentence with no wasted words. It's front-loaded with the core action, making it easy to parse quickly, which is ideal for conciseness.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the complexity (executing commands on a remote server), lack of annotations, and no output schema, the description is incomplete. It fails to address behavioral aspects like safety, output, or error handling, which are crucial for an agent to use this tool effectively in context with siblings.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The schema description coverage is 100%, so all parameters are documented in the schema. The description adds no additional meaning beyond implying command execution, which the schema already covers with parameter descriptions. This meets the baseline of 3 when the schema does the heavy lifting.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the action ('execute a command') and target ('on the remote server'), which distinguishes it from siblings like ssh_connect or ssh_upload_file. However, it doesn't explicitly differentiate from potential command-execution alternatives in the sibling list, keeping it at 4 rather than 5.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  No guidance is provided on when to use this tool versus alternatives. It doesn't mention prerequisites (e.g., needing an active SSH connection via ssh_connect), exclusions, or comparisons to other command-related tools, leaving the agent to infer usage context.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• ssh_list_filesC
  2.9/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries the full burden of behavioral disclosure. It states the basic function but lacks critical details: it doesn't specify what the output looks like (e.g., list format, error handling), whether it requires specific permissions, or if there are rate limits. For a tool interacting with a remote server, this is a significant gap in transparency.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, direct sentence that efficiently conveys the core purpose without any fluff. It is appropriately sized and front-loaded, making it easy for an agent to parse quickly. Every word earns its place, with no wasted verbiage.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the complexity of SSH operations and the lack of annotations or output schema, the description is incomplete. It doesn't explain what the tool returns (e.g., file list, errors), behavioral aspects like timeouts, or integration with sibling tools (e.g., ssh_connect). For a tool with no structured output and no annotations, more context is needed to be fully helpful.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The input schema has 100% description coverage, with clear documentation for both parameters (connectionId and remotePath). The description adds no additional semantic context beyond what the schema provides, such as format examples or constraints. According to the rules, with high schema coverage, the baseline is 3 even without param info in the description.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the action ('List files') and target ('in a directory on the remote server'), which is specific and unambiguous. It distinguishes from siblings like ssh_download_file or ssh_exec by focusing on directory listing rather than file transfer or command execution. However, it doesn't explicitly differentiate from hypothetical similar listing tools, keeping it at 4 rather than 5.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides no guidance on when to use this tool versus alternatives. It doesn't mention prerequisites (e.g., needing an active SSH connection via ssh_connect), exclusions (e.g., not for listing local files), or comparisons to other tools. This leaves the agent to infer usage from the tool name and context alone.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• ssh_upload_fileC
  2.9/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden of behavioral disclosure. It states the action ('Upload') but lacks critical details: it doesn't specify whether this overwrites existing files, requires specific permissions, handles errors, or indicates success/failure. For a file transfer tool with zero annotation coverage, this leaves significant gaps in understanding its behavior.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, direct sentence with zero wasted words. It front-loads the core action and resource efficiently, making it easy to parse quickly. Every word earns its place by conveying essential information without redundancy.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the complexity of SSH file operations and the lack of annotations or output schema, the description is insufficient. It doesn't cover behavioral aspects like error handling, success indicators, or interaction with sibling tools (e.g., dependency on 'ssh_connect'). For a tool that modifies remote systems, more context is needed to ensure safe and effective use.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The input schema has 100% description coverage, clearly documenting all three required parameters. The description adds no additional semantic context beyond what the schema provides, such as file format constraints or path validation rules. Since the schema does the heavy lifting, the baseline score of 3 is appropriate.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the action ('Upload') and target resource ('a file to the remote server'), making the purpose immediately understandable. However, it doesn't distinguish this tool from its sibling 'ssh_download_file' beyond the directional difference, missing an opportunity to clarify the upload-specific context.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides no guidance on when to use this tool versus alternatives like 'ssh_download_file' or 'ssh_list_files', nor does it mention prerequisites such as needing an active SSH connection via 'ssh_connect'. Without any contextual cues, users must infer usage from the tool name alone.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• ubuntu_nginx_controlC
  2.9/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries full burden for behavioral disclosure but provides minimal information. It mentions 'Control' which implies system administration actions, but doesn't disclose that this likely requires root/sudo privileges (though the schema hints at this), doesn't mention what happens when actions fail, and provides no information about output format or error conditions.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is extremely concise at just 5 words, front-loading the essential information with zero wasted words. Every word earns its place by specifying the target (Nginx), platform (Ubuntu), and action type (Control).

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a system administration tool with 3 parameters, no annotations, and no output schema, the description is insufficient. It doesn't explain what 'Control' entails operationally, doesn't mention that this requires an established SSH connection (though the parameter implies it), and provides no information about what the tool returns or how to interpret results.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  With 100% schema description coverage, the baseline is 3. The description adds no parameter-specific information beyond what's already documented in the schema. It doesn't explain the relationship between parameters, doesn't provide examples of valid 'action' values (though the schema lists them), and offers no additional context about parameter usage.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the verb ('Control') and resource ('Nginx web server on Ubuntu'), making the purpose immediately understandable. However, it doesn't differentiate this tool from potential alternatives like 'ssh_exec' which could also control Nginx, or explain why this specialized tool exists when general SSH execution is available.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides no guidance on when to use this tool versus alternatives. It doesn't mention prerequisites (like needing an active SSH connection first), doesn't compare it to the 'ssh_exec' sibling tool, and offers no context about when this specialized Nginx control tool is preferable to general command execution.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• ubuntu_ssl_certificateC
  2.9/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden of behavioral disclosure. While 'manage' implies both read and write operations, it doesn't specify critical behaviors like whether actions are destructive (e.g., 'issue' might overwrite existing certificates), authentication requirements beyond SSH, rate limits for Let's Encrypt, or what the tool outputs. This leaves significant gaps for a tool with multiple action types.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, efficient sentence that states the core purpose without unnecessary words. It's appropriately sized and front-loaded, with every word earning its place by conveying essential information about the tool's domain and technology stack.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's complexity (multiple actions with different parameter requirements), lack of annotations, and absence of an output schema, the description is insufficient. It doesn't explain what the tool returns (e.g., certificate paths, status messages, error formats) or provide context about Let's Encrypt integration, making it incomplete for effective agent use.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The schema description coverage is 100%, so all parameters are documented in the schema. The description adds no additional parameter semantics beyond what's in the schema (e.g., it doesn't explain the relationship between 'action' values and other parameters like 'domain' or 'email'). Since the schema does the heavy lifting, the baseline score of 3 is appropriate.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's purpose as managing SSL certificates using Let's Encrypt on Ubuntu, which includes both the verb ('manage') and resource ('SSL certificates'). It distinguishes itself from sibling tools like ubuntu_nginx_control or ubuntu_website_deployment by focusing specifically on SSL certificate operations, though it doesn't explicitly differentiate from all siblings.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides no guidance on when to use this tool versus alternatives. It doesn't mention prerequisites (e.g., needing an active SSH connection via ssh_connect first), nor does it explain when to choose this over other certificate management approaches or sibling tools like ubuntu_website_deployment that might handle certificates differently.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• ubuntu_ufw_firewallC
  2.9/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries full burden for behavioral disclosure. 'Manage' implies both read and write operations, but the description doesn't specify which actions are destructive (e.g., 'reset' likely removes all rules), authentication requirements (sudo is a parameter but not highlighted), or potential side effects. For a multi-action tool with zero annotation coverage, this is insufficient.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, efficient sentence that directly states the tool's purpose without unnecessary words. It's appropriately sized and front-loaded, earning a perfect score for conciseness.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's complexity (6 parameters including potentially destructive actions like 'reset'), no annotations, and no output schema, the description is inadequate. It doesn't explain what the tool returns, error conditions, or behavioral nuances. For a multi-action system management tool, this leaves significant gaps in understanding.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 100%, so the schema fully documents all 6 parameters. The description adds no additional parameter semantics beyond what's in the schema. According to scoring rules, when schema coverage is high (>80%), the baseline is 3 even with no param info in the description.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description 'Manage Ubuntu Uncomplicated Firewall (UFW)' clearly states the tool's purpose as managing a specific firewall system. It identifies the resource (UFW firewall) and implies a range of management actions. However, it doesn't distinguish this tool from potential sibling firewall tools (none exist in the provided list), so it earns a 4 rather than a 5.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides no guidance on when to use this tool versus alternatives. It doesn't mention prerequisites like requiring an SSH connection, nor does it differentiate from other system management tools in the sibling list (e.g., ubuntu_nginx_control). Without any usage context or exclusions, this scores a 2.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• ubuntu_update_packagesC
  2.9/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries full burden for behavioral disclosure. 'Update system packages' implies a system modification, but the description doesn't disclose that this requires elevated privileges (sudo), may require user confirmation, could break dependencies, or has potential side effects. It mentions none of the behavioral traits that would help an agent understand the operation's impact.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, efficient sentence with zero wasted words. It's appropriately sized for a tool with comprehensive schema documentation. Every word earns its place by clearly stating the core functionality without unnecessary elaboration.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a system modification tool with 5 parameters, no annotations, and no output schema, the description is inadequate. It doesn't explain what 'update' entails (apt update vs apt upgrade), doesn't mention typical use cases, doesn't warn about potential system impacts, and provides no information about return values or error conditions. The agent would need to infer too much from the sparse description.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 100%, so the schema already documents all 5 parameters thoroughly. The description adds no parameter-specific information beyond what's in the schema. It doesn't explain the relationship between parameters (e.g., how securityOnly interacts with upgrade) or provide usage examples. Baseline 3 is appropriate when schema does the heavy lifting.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description 'Update system packages on Ubuntu' clearly states the action (update) and resource (system packages on Ubuntu). It distinguishes from sibling tools like ubuntu_nginx_control or ubuntu_ufw_firewall by focusing on package management rather than service control or firewall configuration. However, it doesn't explicitly differentiate from generic ssh_exec which could also run update commands.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides no guidance on when to use this tool versus alternatives. It doesn't mention prerequisites like needing an active SSH connection, nor does it explain when to use this specialized tool versus the more general ssh_exec tool. There's no context about typical update scenarios or limitations.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• ubuntu_website_deploymentC
  2.9/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden of behavioral disclosure. It mentions 'deploy' and 'create backups' but doesn't specify critical details like whether this is a destructive operation (e.g., overwriting files), permission requirements, error handling, or backup retention. This leaves significant gaps for safe usage.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, efficient sentence that front-loads the core functionality ('Deploy website files and create backups on Ubuntu') with zero wasted words. It's appropriately sized for the tool's complexity and easy to parse.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a tool with 7 parameters, no annotations, and no output schema, the description is incomplete. It doesn't address behavioral aspects like safety (e.g., whether deployment overwrites existing files), error conditions, or what the tool returns. Given the complexity and lack of structured data, more context is needed for reliable use.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The schema has 100% description coverage, so parameters are well-documented in the schema itself. The description adds minimal value beyond implying the tool handles website files and backups, but it doesn't provide additional context like file format expectations or backup naming conventions. Baseline 3 is appropriate given the schema does the heavy lifting.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's purpose with specific verbs ('deploy website files' and 'create backups') and resource ('on Ubuntu'), making it easy to understand what the tool does. However, it doesn't explicitly differentiate from sibling tools like 'ssh_upload_file' or 'ubuntu_nginx_control', which might handle similar operations.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides no guidance on when to use this tool versus alternatives like 'ssh_upload_file' for file transfers or 'ubuntu_nginx_control' for web server management. It mentions the action parameter includes 'deploy, backup, restore' but doesn't explain when each is appropriate or any prerequisites.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.