Server Quality Checklist

Tool Scores

• renameDocumentOrNotebookEntryC
  2.6/5.0
  Behavior1/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden of behavioral disclosure. It only says 'Renames' with no information about side effects, permissions, return values, or consequences of renaming. The ':return:' placeholder is empty, revealing no details about the response.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness2/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is short but not well-structured. The first sentence earns its place, but the lines ':param doc_id:' and ':return:' are empty placeholders that add no value. A concise description should avoid such filler and provide substantive information.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a mutation tool without annotations or output schema, the description is insufficiently complete. It lacks details on return values, error conditions, required permissions, or the exact meaning of doc_id. The simple action is stated, but the overall context is missing.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters2/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 0%, so the description must compensate. It does explain 'name' as 'the new name', but 'doc_id' receives no explanation at all. The schema itself only lists types (=integer|string for doc_id), leaving its meaning and format entirely unspecified.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's purpose with a specific verb ('Renames') and resource ('document or notebook entry'), distinguishing it from sibling tools like get_documents (read-only) or createNewNotebook (creation). The action is unambiguous.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  No guidance is provided for when to use this tool versus alternatives. There is no mention of prerequisites, exclusions, or scenarios where a different tool would be more appropriate. The description simply states the action without contextual cues.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• tagDocumentOrNotebookEntryC
  2.9/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description carries the full burden of behavioral disclosure. It only states the basic action without revealing side effects, permissions, or return behavior. No indication of whether tags are overwritten or appended.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness3/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The main sentence is concise, but the ':param:' and ':return:' placeholders are redundant filler that add no value. The structure could be improved by removing these empty docstring remnants.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the lack of annotations and output schema, the description should provide more context about what happens when tagging, return values, and constraints. It is incomplete and leaves the agent guessing about critical behavioral details.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters2/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The schema already describes the 'tags' parameter, but 'doc_id' has no description. The description merely repeats placeholder names (':param doc_id:', ':param tags:') without adding any meaning. With only 50% coverage, the description fails to compensate.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the action (tags) and resource (document or notebook entry), and it distinguishes this tool from siblings like renameDocumentOrNotebookEntry or createNotebookEntry. The core sentence is specific and unambiguous.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  No guidance is provided on when to use this tool vs. alternatives, prerequisites, or exclusions. The description does not mention whether tagging is additive, replaces existing tags, or requires the resource to exist.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• downloadFileB
  3/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries the transparency burden. It does disclose a key behavioral trait: saving results to a file-system location, which implies a side effect beyond a simple API read. However, it does not mention error handling, permissions, overwrite behavior, or whether the tool returns anything besides writing the file.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, short sentence that front-loads the verb 'Get' and immediately conveys the action and required inputs. No unnecessary words or repetition.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  With no annotations, no output schema, and a very brief description, the agent is left without critical context such as expected return values, failure modes, or prerequisites. The tool is simple but still underdescribed for safe and correct invocation.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters2/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 0%. The description mentions 'file id' and 'file-system location', which slightly clarifies the roles of file_id and file_path, but it does not provide format details, path types, or additional meaning. Given zero schema coverage, the description minimally compensates.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description states the tool gets file contents using an ID and saves to a file system path. This is a specific verb-resource pairing and is distinguished from sibling tools that deal with documents/notebooks rather than raw file downloads. However, 'get' is slightly generic and could be interpreted as retrieve vs. download.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides no guidance on when to use this tool instead of siblings like get_documents or get_single_Rspace_document. No exclusions or alternative scenarios are mentioned, leaving the agent to infer usage.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get_documentsB
  3.2/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description must carry the full burden of behavioral disclosure. It mentions a limit of 100 documents per call, but omits critical details such as ordering definition, pagination mechanism, return format, or any side effects. This is insufficient for a tool with no annotation support.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness4/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single sentence with no redundant wording, providing the core purpose and a key limit. However, it contains a double space typo ('most recent RSpace') and lacks structured detail, slightly detracting from clarity.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's simplicity (1 parameter, no output schema, no annotations), the description is incomplete. It does not clarify how page_size affects results, what 'most recent' means, or how to retrieve additional documents beyond the first page. This leaves the agent with significant unanswered questions.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters2/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 0% since the description does not mention page_size. The 'up to 100 at a time' phrase hints at a limit but does not explain how page_size behaves (e.g., default, max, or how to control pagination). The description fails to compensate for the schema's lack of detail.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool retrieves recent RSpace documents, with a specific resource (documents) and action (gets). It distinguishes itself from sibling tools like get_single_Rspace_document by indicating it handles multiple documents, and the 'up to 100 at a time' clause adds scope.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies usage when needing recent documents, but does not specify when not to use it or mention alternatives. There is no exclusionary guidance, but the 'most recent' phrasing provides minimal context for typical use cases.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get_single_Rspace_documentB
  3.3/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description carries the full burden of behavioral disclosure. It does not explicitly declare the operation as read-only, nor does it describe return format, error handling, or any side effects. The only added detail—'numeric id or string globalId'—is largely redundant with the schema's anyOf type, providing minimal beyond-annotation value.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single sentence that is front-loaded with the primary action and resource. It contains no unnecessary words and is extremely efficient while still conveying essential information.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a simple one-parameter tool with no output schema or annotations, the description adequately conveys the tool's purpose and identifier requirements. However, it could be more complete by mentioning what the response contains or how errors are handled, especially given the lack of an output schema.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The schema provides only a minimal 'Doc Id' title with no description, and its coverage is 0%. The description compensates by clarifying that the parameter accepts a numeric id or a string globalId, adding meaningful context about the parameter's format and purpose beyond the schema.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the action (gets) and resource (a single RSpace document), and it specifies accepted identifier types (numeric id or string globalId). It is distinct from the sibling get_documents by emphasizing 'single', but it does not explicitly name the alternative, preventing a perfect score.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  No guidance is provided on when to use this tool versus alternatives like get_documents. The description does not mention any contexts, exclusions, or alternative tools, leaving the agent to infer usage from the name and description alone.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• createNewNotebookA
  3.5/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description carries full responsibility for behavioral disclosure, but only states the core action. It does not mention whether the name must be unique, whether authentication is needed, whether the operation is reversible, or what the response contains (e.g., notebook ID). This is a significant gap for a mutation tool.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, concise sentence with no filler or redundancy. Every word contributes to the meaning, making it easy to parse quickly.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  The tool is simple with one parameter and no output schema, so the description is partly adequate. However, it lacks behavioral details (e.g., return value, failure conditions) and does not reference sibling tools, leaving the agent without full context to make an informed invocation.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The input schema already provides 100% coverage with a clear description for the 'name' parameter, so the schema does the heavy lifting. The tool description adds no additional parameter semantics, warranting the baseline score of 3.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description 'Creates a new RSpace notebook' uses a specific verb ('creates') and resource ('RSpace notebook'), clearly distinguishing it from the sibling 'createNotebookEntry' which targets entries within notebooks. The purpose is unambiguous and immediately actionable.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The usage context is implied: use this tool when you need to create a notebook. However, there is no explicit guidance on when to prefer this over the sibling 'createNotebookEntry' or any prerequisites or edge cases, leaving the agent to infer from the name alone.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• createNotebookEntryA
  3.5/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description is the sole source of behavioral disclosure. It only says 'Adds content,' which implies mutation, but does not disclose side effects, required permissions, return values, or error behaviors. This is a significant gap for a write operation with no annotation-based safety cues.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single sentence, front-loaded with the action, and contains no redundant information. It is concise and efficient, fitting within the typical character limit.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a simple create operation with no output schema and no annotations, the description provides the core purpose but lacks contextual details such as what happens on success, whether the notebook_id must be validated, or any return value. It is minimally adequate but leaves room for missing information.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The input schema already provides descriptions for all three parameters (name, notebook_id, text_content) with 100% coverage. The tool description adds no extra meaning beyond what the schema provides, so the baseline score of 3 is appropriate.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the action ('Adds content') and the target resource ('a new notebook entry in an existing notebook'). It distinguishes itself from sibling tools like createNewNotebook (which creates a new notebook rather than adding an entry to an existing one).

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The phrase 'in an existing notebook' implies the prerequisite that the notebook must already exist, but it does not explicitly state when to use this tool versus alternatives such as createNewNotebook. No exclusions or when-not-to-use guidance is provided.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• getAuditEventsA
  4.1/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are present, so the description carries the full burden. It discloses that this is a getter and lists filter capabilities, but it does not describe the return format, pagination, or potential limitations. The read-only nature is implied but not explicit, and it doesn't mention whether filters combine.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  Single concise sentence with a focused bulleted list of filters. No fluff, front-loaded purpose.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a 4-param read-only tool with no output schema, the description is somewhat complete, but it fails to explain expected response structure, whether filters are ANDed, or if there are limits. Given no annotations or output schema to assist, more detail would be warranted.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema coverage is 0%, so the description must compensate. It maps all four schema fields (username, global_id, date_from, date_to) with meaningful semantics: username(s), a single document id, and ISO8601 date format. However, it uses 'document id' instead of schema's 'global_id', creating some ambiguity, and 'username(s)' implies multiple values but the schema defines a single string.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  Description uses specific verb 'Gets' plus resource 'audit trail of all actions performed in RSpace.' It clearly differentiates from sibling document tools (get_documents, get_single_Rspace_document) by focusing on audit events. The optional filters are listed, further clarifying scope.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  Description implies when to use: when an audit trail of all RSpace actions is needed. It clearly states optional filters, providing usage context. However, it offers no explicit exclusions or references to alternative tools (e.g., get_documents for document content), so it doesn't fully meet the 5-criterion.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• statusA
  4.3/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries the burden. It accurately describes the tool's behavior as a read-only status check with no side effects, which is sufficient for a zero-parameter tool. It does not detail the exact response format, but the simplicity of the operation reduces the need.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  Single sentence, front-loaded with the action, no redundant words. Every word earns its place.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness5/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the trivial nature (no parameters, no output schema), the description fully captures what the tool does. An agent can understand when to invoke it and what to expect at a high level.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The tool has zero parameters, so there is nothing to explain. Baseline of 4 is appropriate since the description is not required to compensate for missing parameter documentation.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description uses a specific verb 'determines' with a clear resource ('RSpace server') and outcome ('returning its status'). It clearly distinguishes from sibling tools which focus on documents, notebooks, audit events, and file downloads.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies this is a health-check tool to be used when checking server availability, but it does not explicitly state when to use it or mention alternatives. The sibling list makes it clear this is not for document operations, but no direct exclusions or alternative references are provided.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.