Server Quality Checklist

Tool Scores

• register_chokaC
  2.6/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden of behavioral disclosure. It states the tool can register fishing results, implying a write/mutation operation, but doesn't cover aspects like whether it requires authentication, what happens on success/failure, if it's idempotent, or any rate limits. This is a significant gap for a tool that likely modifies data.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness4/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, efficient sentence ('釣果登録が行えます'), which is appropriately concise. It front-loads the core action without unnecessary details. However, it could be slightly improved by integrating key usage hints from the schema, but it's not wasteful.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool has no annotations, no output schema, and involves mutation (registering data), the description is incomplete. It doesn't explain what the tool returns, error conditions, or behavioral traits like side effects. For a 4-parameter write tool, this lack of context makes it inadequate for safe and effective use by an AI agent.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 100%, with all parameters well-documented in the input schema (e.g., FishID from upload_file, FishSize in centimeters). The description adds no additional meaning beyond the schema, so it meets the baseline of 3 where the schema handles parameter semantics adequately.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose3/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description '釣果登録が行えます' translates to 'You can register fishing results,' which provides a basic verb+resource (register + fishing results). However, it's vague about what specifically is being registered (fish details from parameters) and doesn't distinguish from sibling tools like 'upload_file' or 'get_recipe.' It states the action but lacks specificity about scope or differentiation.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  No explicit guidance on when to use this tool versus alternatives is provided. The description doesn't mention prerequisites like needing to run 'upload_file' first, which is hinted at in the parameter descriptions but not in the tool description itself. There's no context on when-not-to-use or comparisons with siblings, leaving usage unclear.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get_recipeC
  2.9/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries full burden for behavioral disclosure. It states the tool generates recipes but doesn't describe what that entails (e.g., format, length, whether it's AI-generated, if it includes cooking steps). It lacks information on permissions, rate limits, or error handling, leaving significant gaps for a tool that likely performs a complex operation.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness4/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, efficient sentence in Japanese that directly states the tool's function and inputs. It's front-loaded with the core purpose and avoids unnecessary words, though it could be slightly more structured (e.g., separating purpose from input explanation).

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a recipe generation tool with 3 required parameters and no annotations or output schema, the description is incomplete. It doesn't explain what the output looks like (e.g., text recipe, structured data), how recipes are generated, or any behavioral aspects like response format or limitations. The schema covers inputs well, but the overall context for using the tool is insufficient.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 100%, so the schema already documents all three parameters thoroughly. The description adds minimal value beyond the schema by mentioning the parameters in context ('ユーザプロンプトと前回取得した魚名、魚IDを元に'), but doesn't provide additional syntax, format details, or usage examples that aren't already in the schema descriptions.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's purpose: 'レシピ生成' (recipe generation) based on user prompts and previously obtained fish information. It specifies the inputs (user prompt, fish name, fish ID) but doesn't distinguish itself from sibling tools like 'register_choka' or 'upload_file', which appear unrelated to recipe generation.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides no guidance on when to use this tool versus alternatives. It doesn't mention prerequisites (e.g., needing fish identification first), exclusions, or how it relates to sibling tools. Usage is implied through the input parameters but not explicitly stated.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• upload_fileC
  2.9/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries the full burden of behavioral disclosure. It mentions that fish names and IDs are returned, but doesn't describe error handling, file format requirements, size limits, authentication needs, or rate limits. For a tool that processes images and returns data, this leaves significant behavioral gaps.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness4/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is concise and front-loaded with the main purpose in the first sentence. The second sentence adds useful supplementary information about return values. Both sentences earn their place, though it could be slightly more structured (e.g., separating purpose from return details more clearly).

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's complexity (image processing and identification), lack of annotations, and no output schema, the description is incomplete. It doesn't cover behavioral aspects like error conditions, file requirements, or response format details beyond mentioning JSON. For a tool with no structured safety or output information, more context is needed.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The schema description coverage is 100%, with the parameter 'filename' fully documented in the schema. The description doesn't add any parameter-specific information beyond what's in the schema (e.g., no additional context about image formats or constraints). With high schema coverage, the baseline score of 3 is appropriate as the description doesn't compensate but doesn't need to.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's purpose: '魚の画像を渡すと魚名が返ります' (when you pass a fish image, it returns the fish name). It specifies the verb (upload/process image) and resource (fish identification), though it doesn't explicitly differentiate from sibling tools like 'get_recipe' or 'register_choka'. The purpose is clear but lacks sibling differentiation.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides no guidance on when to use this tool versus alternatives. It doesn't mention prerequisites, when not to use it, or how it differs from sibling tools like 'get_recipe' or 'register_choka'. The only implied usage is for fish image identification, but no explicit alternatives or context is provided.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.