Server Quality Checklist

Tool Scores

• fetch_pinterest_boardB
  3.2/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description must fully disclose behavior. It mentions the count limit and that pin.it short links are accepted, but it does not describe side effects such as file writing to out_dir, overwrite behavior, failure modes, rate limits, or whether authentication is required. For a download tool, this is insufficient transparency—it appears to write files but does not explain what happens on existing files or errors.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness4/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, efficient sentence that front-loads the primary action and includes a useful parenthetical about short links. It avoids unnecessary words and is easy to scan. It loses a point because it could be slightly more organized with parameter mentions, but it is otherwise concise.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a tool with three parameters, no annotations, no output schema, and 0% schema description coverage, the description is not complete enough. It covers the main purpose and two parameters partially, but leaves out behavioral details (e.g., what happens when files exist, error handling) and the out_dir parameter entirely. An agent would have to infer too much to use this tool correctly.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters2/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 0%, so the description must compensate. It partially explains 'count' (up to count images) and 'board_url' (including short links), but it does not mention 'out_dir' at all. Given that out_dir is a parameter with a default, the description should at least state that it specifies the output directory. The explanation is incomplete, especially since only two of three parameters are addressed.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's action (download), the resource (full-resolution images from a Pinterest board), and a key capability (accepting pin.it short links). It is distinct from sibling tools like search_pinterest_images, get_pinterest_boards, and get_pinterest_board_info, which focus on searching, listing, or fetching metadata rather than downloading image files.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The usage context is implied through the verb 'download' and the reference to 'images from a Pinterest board,' but there is no explicit statement of when to prefer this tool over alternatives or any exclusions. For example, it does not say 'Use this when you need to download images; use search_pinterest_images to find boards.' The guidance is indirect and relies on the user inferring from the purpose.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• search_pinterest_imagesB
  3.3/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description carries the full burden of behavioral disclosure. It reveals the tool downloads files (a side effect) and specifies 'full-resolution images,' but omits critical details such as whether it creates the output directory, handles overwrites, requires authentication, or returns any path information. This is minimal behavioral context for a tool with side effects.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, front-loaded sentence that wastes no words. It conveys the action, scope, and key parameter semantics immediately, with backticked placeholders for clarity. Adequately concise without sacrificing essential information.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  The tool has 3 parameters, no output schema, and no annotations. The description covers the basic search-and-download action but fails to explain the output directory parameter, potential return values (e.g., local file paths), error-handling behavior, or any prerequisites. An agent would lack critical information needed to call this tool correctly and predict its side effects.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters2/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 0%, so the description must compensate. It explicitly references `query` and `count` (clarifying count as a maximum), but completely ignores `out_dir`, which is a significant parameter controlling where downloads are saved. The schema itself provides defaults and titles, but the description adds little semantic value beyond that.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states a specific verb combination ('Search' and 'download') with a specific resource (Pinterest images) and a quantifiable output (up to `count` full-resolution images). It distinctly differentiates from sibling tools like `get_pinterest_boards` and `fetch_pinterest_board`, which deal with board metadata rather than image search and download.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The purpose is unambiguous and naturally implies when to use it (searching for images), but the description does not explicitly state when not to use it or mention alternatives. The distinction from board-related siblings is implicit via the name and description, but no explicit routing guidance is provided.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get_pinterest_boardsA
  3.6/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description carries the full burden. It reveals that the tool returns board urls and pin counts, which implies a read-only listing operation. However, it does not explicitly state that it is read-only, nor does it mention authentication requirements, rate limits, or whether it returns all boards or has any limit. It adds value beyond the schema by specifying the output fields, but lacks depth on side effects or constraints.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, concise sentence with no wasted words. It front-loads the main purpose and the specific output fields. It is appropriately sized for a simple listing tool.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a tool with one parameter and no output schema, the description provides enough to call it correctly: it states the input (user) and the key output (url and pin count). It could mention pagination or limits, but for a basic listing operation, this is nearly complete. It does not leave critical gaps that would prevent a correct invocation.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The schema offers zero description coverage, so the description must compensate. It implicitly ties the 'username' parameter to the Pinterest user whose boards are listed, giving context. However, it does not elaborate on formatting, validation, or optional aspects. This is a minimal but functional clarification of the parameter's role.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the action (list), the resource (Pinterest user's boards), and the specific data returned (url and pin count). It distinguishes itself from sibling tools like search_pinterest_images (search images) and get_pinterest_board_info (likely detailed info on a single board) by focusing on listing boards with basic metadata.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  No guidance is provided on when to use this tool versus alternatives. The description does not mention prerequisites, exclusions, or a typical scenario where this tool is preferred over siblings like fetch_pinterest_board or get_pinterest_board_info. An agent must infer usage from the description alone.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get_pinterest_board_infoA
  4/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries the full burden. It discloses the core behavior (returns name and pin count) and that it accepts short links, which is useful. However, it does not explicitly state that this is read-only or describe any side effects, error handling, or authentication requirements. For a simple lookup, this is acceptable but not richly transparent.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, concise sentence that front-loads the primary purpose and returns the exact information. It includes a relevant note about short links without any fluff. Every word earns its place, and it is easily scannable.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a simple single-parameter lookup tool with no output schema or annotations, the description covers the essential context: what it does, what input it expects, and what output it provides (name and pin count). It lacks details about error responses or whether authentication is needed, but the tool's simplicity means an agent likely has enough information to call it correctly.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The schema provides only a parameter named 'board_url' with a title 'Board Url' and no description (0% coverage). The description compensates by explaining that the parameter is a URL of a board and that pin.it short links are accepted, giving the agent concrete guidance on what value to provide. This adds significant meaning beyond the bare schema.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's action ('look up') with a specific resource ('Pinterest board') and the exact output ('name and total pin count'). It also notes that it accepts pin.it short links, which adds specificity. This differentiates it from sibling tools like get_pinterest_boards (likely lists boards) and fetch_pinterest_board (likely fetches full board details) without needing to open schemas.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies when to use this tool (when you need just the name and total pin count of a board) but does not explicitly state alternatives or exclusions. It does not mention when to prefer get_pinterest_boards or fetch_pinterest_board. There is no clear 'use this instead of X' guidance, so it's adequate but not explicit.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.