Server Quality Checklist

Tool Scores

• planist_propose_page_editA
  3.5/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  Discloses a key behavioral trait: the submission is a proposal that goes through human review and atomic write-back, which adds value beyond the tool name. Yet without annotations, it omits details about return values, whether the submission is asynchronous, failure modes, or follow-up actions.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  A single, direct sentence that front-loads the action and outcome. No filler or repetition; every word contributes to understanding the tool's purpose.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  The description gives the essential purpose and process, but with no annotations or output schema, it lacks detail on the proposal submission lifecycle, expected response, error handling, and post-submission steps. It is adequate for basic understanding but not fully complete for safe invocation.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The input schema covers 100% of parameters with clear descriptions for pageId, summary, and markdownContent. The tool description adds no additional parameter semantics, so the baseline of 3 applies.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the action: 'Submit a page edit proposal' with a specific resource and process ('for human review and atomic transaction write-back'). It distinguishes from direct edit/update tools by emphasizing the proposal nature, though it doesn't explicitly contrast with siblings like planist_update_variable.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  Implies usage context through 'for human review and atomic transaction write-back', indicating this tool is for proposing edits that require review. However, it gives no explicit guidance on when to use this vs. other tools (e.g., direct updates) or exclusions.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• planist_read_pageA
  3.7/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description carries the full burden. It discloses that the operation is a read and lists possible representations, which adds some context. However, it is ambiguous whether all representations are returned or if one is chosen based on some unstated condition, and there is no mention of permission requirements, error behavior, or output format nuances.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, well-structured sentence that front-loads the action and resource, followed by clarifying details. There is no redundancy or unnecessary words, making it an efficient and model-friendly description.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a one-parameter read tool, the description is fairly adequate, but the 'or' between AST, Markdown, and structural block representation leaves ambiguity about the actual output. Since there is no output schema, this missing detail is noteworthy and prevents a higher score.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema coverage is 100%, so the schema already fully documents the single parameter. The description repeats 'Stable ID' from the schema description without adding extra semantic meaning or usage details, so it stays at the baseline.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description uses a specific verb ('Read') with a clear resource ('Planist page') and specifies the output types (AST, Markdown, structural block representation) and the identifier (Stable ID). This clearly distinguishes it from sibling tools like planist_list_pages, which lists pages, and the variable-related tools.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies the tool is used to fetch a page's representation when you have its Stable ID, but it does not explicitly state when to use it over alternatives or mention any exclusions. There is no guidance on selecting between the representation types or when a different tool might be more appropriate.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• planist_get_variableA
  3.8/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description carries the transparency burden. It discloses the read-only nature via 'Get' and outlines the returned fields, but provides no detail on error behavior (e.g., missing variable) or side effects. This is adequate but not rich for a read operation.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, front-loaded sentence that immediately states the action and the resource. Every word contributes value; there is no redundancy or filler.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  The tool is simple (one parameter, no output schema) and the description covers what the operation does and what it returns. Minor gaps like not-found behavior and output format are present, but the core invocation context is sufficiently complete given the tool's simplicity.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema coverage is 100% for the single parameter variableKey, including an example. The description adds no additional meaning beyond the schema, so a baseline score of 3 is appropriate.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description uses the specific verb 'Get' with the resource 'project variable', and specifies the exact return payload (current value, type contract, binding references). This clearly distinguishes it from sibling tools like list_variables (listing) and update_variable (modifying).

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies usage for retrieving a single variable by key, but it does not explicitly state when to prefer this over list_variables or other siblings. No direct exclusions or alternatives are mentioned, leaving the guidance implicit rather than explicit.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• planist_list_pagesA
  4/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries the burden. It states 'List all accessible pages', clearly implying a read-only operation, but it does not disclose other behavioral traits such as pagination, sorting, or any additional side effects. This is adequate for a simple list operation but lacks depth.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, concise sentence that front-loads the action and resource, with no redundant or extra information. Every word contributes value.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a simple listing tool with one optional parameter and no output schema, the description sufficiently conveys the tool's purpose and scope. It could mention return structure, but that is not strictly necessary for such a straightforward operation.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The only parameter, kindFilter, has a complete description in the schema. The tool description enumerates the page types (docs, sheet, slide, edgeless, design, dashboard), which aligns with the parameter's allowed values but does not add extra semantics beyond what the schema already provides.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly identifies the action (List), the resource (pages), and the scope (all accessible pages in the Planist project workspace). It also enumerates supported page types, distinguishing it from sibling tools like planist_read_page and planist_list_variables.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies usage: call this when you need to see all accessible pages in the workspace. However, it does not explicitly mention alternatives or when not to use it, though the tool's purpose is distinct enough from siblings that context is clear.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• planist_list_variablesA
  4/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description carries the transparency burden. The verb 'List' clearly implies a read operation, and the domain context (Project variable substrate and binding locations) adds useful scope, but the description omits details such as whether results are paginated, what metadata is returned, or any authorization requirements.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, front-loaded sentence that conveys the action, target, and scope without redundancy. Every clause earns its place.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a parameterless list operation, the description provides sufficient context about what is being listed and the domain scope. There is no output schema, but the description's 'List all...' strongly implies a list result; adding return shape would be a minor enhancement.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The input schema is empty and there are zero parameters, so the baseline is 4. There is no parameter information needed, and the description does not introduce new parameter-like semantics.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description uses the specific verb 'List' with a clear resource: 'all reactive typed variables in the Project variable substrate'. It distinguishes this listing tool from sibling tools like planist_list_pages and planist_get_variable by specifying variable-bound contexts (Sheet cells, Dashboard KPIs, Docs, Workflows).

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies usage for enumerating all reactive typed variables, especially the 'List all' phrasing and scope mentions. However, it does not explicitly state when to prefer this over planist_get_variable or planist_update_variable, nor does it provide exclusions or alternative guidance.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• planist_update_variableA
  4/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries full responsibility for disclosing behavioral traits. It explicitly mentions that updating triggers reactive UI updates across Sheet cells, Dashboard widgets, and Docs, which is a non-obvious side effect. It also references the 'Plan loop' context. Missing are permission requirements, reversibility, or failure modes, but the disclosed reactive behavior adds significant value beyond the schema.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is two sentences, front-loaded with the primary action in the first sentence. The second sentence adds valuable behavioral context without redundancy. Every word earns its place; it is appropriately sized for a simple update tool.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a 3-parameter, 100% schema-covered update tool with no output schema, the description is largely complete. It explains what the tool does, the trigger effect on the reactive UI, and the loop context. It does not mention prerequisites like permissions or error handling, but these are not critical for a straightforward variable update, and the schema covers parameter semantics. A score of 4 reflects that it goes beyond the minimum viable description.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 100%, so the baseline is 3. The description does not add parameter-level details beyond what the schema already provides. It repeats 'typed' and 'strict type contract' from the schema but does not clarify value formats, constraints, or optionality beyond the schema descriptions. No compensation needed, but also no added value.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's action: 'Update a typed project variable value.' This is a specific verb+resource combination. The sibling tools are all read-only or propose operations (list, read, get, propose), so 'update' uniquely distinguishes this as the mutation tool for variables.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies usage (when you need to change a variable value) but does not explicitly contrast with alternatives or state exclusions. It provides useful context about reactive UI updates and the 'Execute -> Variable -> Plan loop,' which helps the agent understand the impact, but it does not say 'use this instead of get_variable for modifying values.'

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.