Server Quality Checklist

Tool Scores

• notion_update_pageC
  2.9/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries full burden but lacks critical behavioral details. It mentions update operations but doesn't disclose permission requirements, whether changes are reversible, error handling, or response format. For a mutation tool with zero annotation coverage, this is insufficient.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness4/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, efficient sentence that front-loads the core purpose and lists additional capabilities. It avoids redundancy and wastes no words, though it could be slightly more structured for clarity.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a mutation tool with 5 parameters, no annotations, and no output schema, the description is incomplete. It lacks behavioral context, error information, and guidance on proper usage, leaving significant gaps for an AI agent to operate effectively.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 100%, providing detailed documentation for all 5 parameters. The description adds minimal value beyond the schema by listing icon, cover, and archive/restore as capabilities, but doesn't explain parameter interactions or usage nuances. Baseline 3 is appropriate when schema does heavy lifting.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the verb 'Updates' and resource 'properties of a Notion page', with additional capabilities for icon, cover, and archive/restore operations. It distinguishes from siblings like notion_create_page (creation) and notion_retrieve_page (reading), though not explicitly named.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  No guidance on when to use this tool versus alternatives is provided. The description mentions what it can do but doesn't specify prerequisites, constraints, or differentiate from sibling tools like notion_retrieve_page_property for property-specific operations.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• notion_create_pageB
  3.2/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden of behavioral disclosure. It states the tool creates a new page, implying a write operation, but fails to mention critical behavioral aspects such as required permissions, rate limits, error conditions, or what happens on success (e.g., returns a page ID). This leaves significant gaps for an AI agent.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is extremely concise with just two sentences that directly state the tool's purpose and a key usage note. It is front-loaded with the core action and wastes no words, making it easy for an AI agent to parse quickly.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the complexity (5 parameters with nested objects, no output schema, and no annotations), the description is incomplete. It doesn't address what the tool returns, error handling, or behavioral constraints, which are crucial for a creation tool with multiple parameters. The high schema coverage helps but doesn't compensate for the lack of output and behavioral context.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The schema description coverage is 100%, meaning all parameters are documented in the input schema. The description adds no additional parameter semantics beyond what's already in the schema, such as explaining the relationship between 'parent' and 'properties' or providing examples. This meets the baseline for high schema coverage.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the action ('Creates a new page') and resource ('in Notion'), which provides a specific verb+resource combination. However, it doesn't explicitly distinguish this tool from its sibling 'notion_update_page' beyond the creation vs. update distinction, missing an opportunity for clearer sibling differentiation.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides some usage context by mentioning 'Can be a child of a page or database,' which implies when to use it for hierarchical page creation. However, it lacks explicit guidance on when to choose this tool over alternatives like 'notion_update_page' or prerequisites for successful invocation.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• notion_retrieve_page_propertyB
  3.3/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries the full burden of behavioral disclosure. It mentions a constraint ('properties with more than 25 references'), which adds some context, but fails to cover key aspects like whether this is a read-only operation, potential rate limits, authentication needs, or error handling. For a tool with no annotations, this leaves significant gaps in understanding its behavior.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is highly concise with only two sentences, each serving a clear purpose: the first states the tool's function, and the second provides usage guidance. There is no wasted text, and it is front-loaded with the core action, making it efficient and well-structured.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's moderate complexity (4 parameters, no output schema, no annotations), the description is somewhat complete but has notable gaps. It clarifies the purpose and offers basic usage guidance, but without annotations or an output schema, it lacks details on behavioral traits, return values, and broader context, making it adequate but not fully comprehensive.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The input schema has 100% description coverage, clearly documenting all four parameters (page_id, page_size, property_id, start_cursor) with their purposes and constraints. The description doesn't add any additional parameter details beyond what the schema provides, so it meets the baseline score of 3 where the schema does the heavy lifting.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the action ('Retrieves') and resource ('a specific property of a Notion page'), making the purpose understandable. However, it doesn't explicitly differentiate from sibling tools like 'notion_retrieve_page' (which retrieves the entire page rather than a specific property), so it doesn't reach the highest score for sibling distinction.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides some usage context by specifying 'Use for properties with more than 25 references,' which implies when to prefer this tool over alternatives. However, it doesn't explicitly mention when not to use it or name specific alternatives (e.g., 'notion_retrieve_page' for properties with fewer references), leaving the guidance somewhat implied rather than comprehensive.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• notion_retrieve_pageA
  3.8/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden. It discloses that the tool returns page properties rather than content, which is useful behavioral context. However, it doesn't mention authentication needs, rate limits, error handling, or whether the operation is read-only (implied by 'retrieves' but not explicit).

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is two concise sentences with zero waste. The first sentence states the core purpose, and the second clarifies the return scope, both earning their place by adding value beyond the tool name.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a simple retrieval tool with 100% schema coverage and no output schema, the description is reasonably complete. It clarifies the return type (properties vs. content), which addresses a key ambiguity. However, without annotations or output schema, it could benefit from mentioning authentication or error scenarios.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 100%, so the schema already documents both parameters (page_id and filter_properties). The description doesn't add any parameter-specific details beyond what the schema provides, such as format examples for page_id or use cases for filter_properties.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the specific action ('Retrieves'), target resource ('a Notion page by ID'), and scope ('Returns page properties, not page content'). It distinguishes from siblings by specifying it retrieves the page itself rather than creating, updating, or retrieving specific properties.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies usage when needing page properties by ID, but doesn't explicitly state when to use this tool versus alternatives like notion_retrieve_page_property for specific properties or notion_update_page for modifications. No exclusions or prerequisites are mentioned.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.