Server Quality Checklist

Tool Scores

• list_documentsA
  3.8/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  Discloses listing behavior and case-insensitive filtering. Lacks details on pagination, ordering, or return format (full documents vs metadata). Without annotations, description carries full burden and is moderately transparent.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  Single concise sentence, front-loaded with main action, no unnecessary words.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  No output schema, and description omits return format, pagination, or limits. For a listing tool, this is a significant gap reducing completeness.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema covers both parameters (100% coverage). Description adds 'case-insensitive' which is already in schema; adds no new meaning beyond schema.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  Clearly states verb 'List', resource 'documents', scope 'in a space', and optional filter. Distinguishes from siblings (list_spaces for spaces, publish_file for publishing).

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  Explicitly mentions when to use (listing documents with optional title filter). No explicit when-not-to-use, but sibling tools provide context for alternatives.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• list_spacesA
  4.1/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries full burden. It indicates a read-only list operation scoped to the team, which is adequate. No mention of permissions or error states, but for a simple listing, it suffices.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  Two brief sentences deliver the purpose and a key usage hint with no wasted words.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  The description explains what the tool does and its relation to publish_file, but lacks details about the output format (e.g., fields like slug and name). With no output schema, more detail would improve completeness.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  There are no parameters, and schema coverage is 100%. The description adds value by explaining the output's purpose (slug for publishing), which helps the agent use the returned data.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the verb 'List' and resource 'spaces in your team'. It distinguishes from siblings list_documents and publish_file by focusing on spaces.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  Provides context by linking spaces to publishing documents, implying use before publish_file. However, it does not explicitly mention when not to use it or alternatives.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• publish_fileA
  4.2/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description must fully disclose behavior. It reveals that files are read from disk by path and are suitable for large files, and that slug reuse creates versions. However, it omits error conditions, return format details beyond 'URL', and any authentication or permission requirements. This is adequate but not comprehensive.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  Three short, front-loaded sentences: first states overall purpose and output, second addresses a practical concern (file path and large files), third covers versioning behavior. No extraneous information; every sentence serves a purpose.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a tool with 6 parameters and no output schema, the description covers the core workflow (upload, get URL) and key parameter behaviors (defaults, versioning). It lacks details on what exactly the tool returns (e.g., JSON with URL and metadata) and any error handling, but is otherwise sufficient for basic usage.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema coverage is 100% with good descriptions, but the tool description adds value by explaining how to obtain spaceSlug ('call list_spaces'), the versioning implication of slug, defaults for title and visibility, and the purpose of tags. This enriches parameter understanding beyond the individual schema entries.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the action ('Upload a local .html/.htm file'), the resource ('to a StelaSpace space'), and the output ('get back a permanent, shareable URL'). It is distinct from sibling tools (list_documents, list_spaces) which are purely read-only or listing operations.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides a prerequisite ('call list_spaces to find valid slugs'), mentions versioning behavior ('Reusing a slug publishes a new version'), and notes file size handling ('large files work fine'). However, it does not explicitly state when not to use this tool or discuss alternatives beyond listing spaces.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.