Server Quality Checklist

Tool Scores

• check-zopio-statusA
  3.7/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description carries the full burden of behavioral disclosure. It conveys a read-only status check, which implies no mutation, but it does not explicitly state side-effect freedom, return format, or error behavior. This is adequate but minimal.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single focused sentence with no filler. It front-loads the action and the object of the check, making it highly scannable.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a no-input, no-output-schema tool, the description gives the core purpose but omits what the caller should expect in the response, such as a status code, a report, or structured data. Without an output schema, this is a noticeable gap.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The tool has zero parameters and 100% schema description coverage, so there are no parameter details for the description to add. This meets the baseline for zero-parameter tools.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description states a specific verb ('kontrol eder' / checks) and a clear resource ('Zopio kurulumunun ve çalışan uygulamaların durumu' - the status of Zopio installation and running applications). This clearly distinguishes it from sibling tools that create, set up, or stop the app.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  No usage guidance is provided. The description does not state when to prefer this tool over siblings, nor does it specify typical scenarios like verifying a setup before or after running setup/stop tools.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• create-complete-applicationA
  3.8/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries the full behavioral burden. It usefully discloses strict rules: only Zopio framework, only TypeScript files, no JavaScript, no manual Next.js/React setup. However, it does not mention prerequisites such as needing setup-zopio-app first, nor what a successful call returns or whether existing files might be affected.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness4/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is organized into clear sections: rules, usage, and examples. It front-loads the most important constraints and keeps the overall length reasonable, though some constraints are repeated and the exclamation-heavy style adds noise.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a one-parameter tool with no output schema, the description covers input, examples, and hard constraints fairly well. However, it does not explain the expected output/return of the creation process or the dependency on setup-zopio-app, which are relevant gaps for an agent invoking the tool safely.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The userRequest parameter is fully documented in the schema with description and examples, and the tool description repeats similar examples and constraints. The description adds no significant semantic detail beyond what the schema already provides, so the baseline score of 3 is appropriate.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description immediately identifies the tool as a fully automatic application generator using the Zopio framework and TypeScript, with explicit constraints. This clearly distinguishes it from the sibling tools (setup, stop, check status) since its role is to create the application itself.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description and parameter schema clearly state that this tool should be used for any natural-language application request, with examples of typical requests. It does not explicitly name alternatives or exclusion cases, but the usage context is unambiguous for app generation.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• stop-zopio-appA
  3.8/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the behavioral disclosure burden. It states the core behavior (stopping a running Zopio app) and the all-or-specific scope, which is useful. However, it does not disclose side effects, reversibility, or impact on data/configuration, so the agent is left to infer those aspects.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is two short sentences, front-loads the main verb and resource, and every sentence adds meaningful information. There is no filler or unnecessary detail.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a simple one-parameter tool with no output schema and no annotations, the description is largely complete: it tells the agent what action is performed, what targets are possible, and what happens if the optional parameter is omitted. It could add a note about verification or recovery steps, but the complexity is low enough that the description is sufficient for correct invocation.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The input schema has 100% description coverage and already explains the appType enum and the default behavior when omitted. The tool description essentially restates this (specific or all applications) without adding additional semantic detail, so it meets the baseline but does not exceed it.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the action ('durdurur') and the resource ('Zopio uygulamasını'), and distinguishes this from the sibling tools by specifying that it stops a running application rather than creating, setting up, or checking status. The scope (specific or all applications) is also explicit.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies the tool should be used when the user wants to stop a running Zopio application, and it gives a clear condition for the parameter (if not specified, all applications are stopped). However, it does not explicitly mention when not to use it or direct the agent to alternatives such as check-zopio-status or setup-zopio-app.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• setup-zopio-appA
  3.9/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden of explaining behavior. It only says 'setup' and 'start components separately' but does not disclose what the setup actually does, whether it overwrites or creates resources, prerequisites, side effects, or whether it is long-running. This is a significant gap for a setup-type tool.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is compact: a warning, a routing instruction, and a purpose statement. It is front-loaded and every sentence earns its place without unnecessary filler.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a single-parameter tool with a fully documented enum, the description provides enough to decide when to use it. However, because there are no annotations and no output schema, the lack of behavioral context about what setup entails and what consequences it may have leaves the description incomplete for safe invocation.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The input schema fully documents the single appType parameter with an enum and descriptions, so the schema covers parameter semantics completely. The description adds no additional parameter-level detail, keeping this at the baseline of 3.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description states a clear purpose: setting up specific Zopio components individually ('Zopio'nun belirli bileşenlerini ayrı ayrı başlatmak'). It also explicitly distinguishes itself from create-complete-application, which is the normal path, so an agent can tell them apart.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines5/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description gives explicit usage conditions: 'Sadece özel durumlar için!' (only for special cases) and directly names the alternative for normal requests: 'Normal uygulama talepleri için create-complete-application kullan.' This leaves no ambiguity about when to select this tool.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.