Server Quality Checklist

Tool Scores

• get_table_definitionD
  1.7/5.0
  Behavior1/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden of behavioral disclosure but offers none. It doesn't indicate whether this is a read-only operation, what permissions might be required, whether it's idempotent, what happens if the table doesn't exist, or what format the definition will be returned in. The description fails to provide any behavioral context beyond the basic action.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is extremely concise at just three words, with zero wasted language. While this conciseness comes at the expense of completeness, the description is perfectly front-loaded and contains no unnecessary verbiage. Every word directly contributes to stating the tool's basic purpose.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given that this tool has 2 required parameters with 0% schema coverage, no annotations, and no explanation of what a 'table definition' contains, the description is severely incomplete. While the existence of an output schema reduces the need to describe return values, the description fails to address the critical gaps in parameter documentation and behavioral context for a database metadata tool.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters1/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  With 0% schema description coverage for both parameters, the description provides no information about what 'table' and 'sch' parameters represent or how they should be used. The description doesn't mention these parameters at all, leaving them completely undocumented. For a tool with two required parameters, this represents a critical gap in documentation.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose2/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description 'Get table definition' is a tautology that essentially restates the tool name 'get_table_definition' without adding meaningful clarification. It does specify a verb ('Get') and resource ('table definition'), but fails to distinguish this tool from its sibling 'list_tables_in_current_schema' or explain what a 'table definition' actually contains (e.g., schema, columns, constraints).

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines1/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides absolutely no guidance on when to use this tool versus alternatives. It doesn't mention the sibling tools 'execute_query' or 'list_tables_in_current_schema', nor does it explain prerequisites like needing to specify both 'table' and 'sch' parameters. There's no indication of appropriate contexts or exclusions for usage.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• execute_queryC
  2.9/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries the full burden of behavioral disclosure. It states the tool executes SQL commands but doesn't clarify whether this includes read/write operations, permissions required, potential side effects (e.g., data modification), error handling, or transaction behavior. This is a significant gap for a tool that could be destructive.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness4/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is concise and front-loaded with the main purpose in the first sentence. The 'Args' section is clear but could be integrated more smoothly. It avoids unnecessary fluff, though it's slightly fragmented between the statement and parameter note.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's potential complexity (executing arbitrary SQL), lack of annotations, and an output schema (which helps), the description is incomplete. It doesn't address safety, scope, or behavioral traits needed for proper use. However, the output schema mitigates some gaps by documenting return values.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The description adds minimal semantics: it names the parameter ('query') and indicates it's an 'SQL command.' However, schema description coverage is 0%, and the description doesn't elaborate on syntax, supported SQL types, or constraints beyond what the basic schema provides. With one parameter, the baseline is 4, but the lack of detail reduces it to 3.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's purpose: 'Execute an SQL commands on the openGauss server.' It specifies the verb ('Execute') and resource ('SQL commands'), though it doesn't explicitly differentiate from sibling tools like get_table_definition or list_tables_in_current_schema, which are read-only queries versus this general execution tool.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides no guidance on when to use this tool versus alternatives. It doesn't mention that siblings like get_table_definition or list_tables_in_current_schema might be preferred for specific read operations, or that this tool can handle both read and write queries. There's no context on prerequisites or exclusions.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get_current_user_and_schemaB
  3.2/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden of behavioral disclosure but only states what the tool does, not how it behaves. It doesn't cover aspects like whether this is a read-only operation, authentication requirements, rate limits, or the format of returned data, leaving significant gaps.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is extremely concise and front-loaded, using a single sentence that directly states the tool's function without any wasted words. Every part of the sentence earns its place by clearly conveying the core action and resources.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's complexity (simple retrieval with no parameters) and the presence of an output schema, the description is adequate but minimal. It states what is retrieved but doesn't provide context on why or how this differs from other tools, making it complete only at a basic level.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The tool has 0 parameters, and the schema description coverage is 100%, so there's no need for parameter details in the description. The baseline for such cases is 4, as the description appropriately avoids redundant information and focuses on the tool's purpose.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's purpose with specific verbs ('get') and resources ('current schema and current user'), making it immediately understandable. However, it doesn't differentiate from sibling tools like 'get_table_definition' or 'list_tables_in_current_schema' that also retrieve schema-related information, which prevents a perfect score.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides no guidance on when to use this tool versus alternatives. It doesn't mention scenarios like needing user context versus schema structure, or how it differs from siblings such as 'execute_query' for data retrieval, leaving the agent without usage context.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• list_tables_in_current_schemaB
  3.4/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries full burden but only states what the tool does, not how it behaves. It doesn't disclose whether this requires specific permissions, what format the output takes (though output schema exists), whether it's paginated, or if there are rate limits. The description is minimal and lacks behavioral context beyond the basic operation.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, efficient sentence that states exactly what the tool does with zero wasted words. It's appropriately sized for a simple list operation and front-loads the core functionality immediately.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's simplicity (0 parameters, output schema exists), the description is minimally adequate but lacks context about permissions, output format details, or connection requirements. While the output schema handles return values, the description doesn't provide helpful context about what 'current schema' means operationally or how this interacts with sibling tools.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The tool has zero parameters, and schema description coverage is 100% (empty schema). The description correctly indicates no parameters are needed by not mentioning any, which aligns perfectly with the schema. For zero-parameter tools, a baseline of 4 is appropriate when the description doesn't incorrectly suggest parameters.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the verb ('List') and resource ('table names in current schema'), making the purpose unambiguous. It specifies 'in current schema' which distinguishes it from potential sibling tools that might list tables across schemas or databases. However, it doesn't explicitly differentiate from 'get_table_definition' which retrieves table structure rather than just names.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies usage context ('current schema') but doesn't provide explicit guidance on when to use this tool versus alternatives like 'execute_query' for custom SQL queries or 'get_table_definition' for detailed table information. No when-not-to-use scenarios or prerequisites are mentioned.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.