Server Quality Checklist

Tool Scores

• enter_weather_forecast_city_israelA
  4.2/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  The description discloses the immediate behavior and outcome: it types a city name and a list opens. However, no annotations are provided, and the description does not mention side effects such as overwriting existing text, waiting for results, or what happens if no city matches. This leaves some behavioral gaps.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is short, front-loaded, and every sentence earns its place: the action, the outcome, the prerequisite, and the parameter explanation. There is no redundant or filler content.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a low-complexity tool with a single parameter and an output schema, the description is largely complete. It gives the prerequisite, the action, the expected outcome, and parameter guidance. What is missing is mostly non-critical detail about error conditions or subsequent steps, which are hinted at by the sibling tool names.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The schema provides only a string parameter named 'city' with 0% description coverage. The tool description compensates by explaining that the value must be a Hebrew city name and gives concrete examples, which is sufficient semantic guidance for this single parameter.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's action: entering a city name into the search field on the forecast page, with the expected outcome that a matching city list opens. This is distinct from the sibling tools (open, select, get content), so the agent can tell it apart without opening schemas.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description explicitly says to run this after open_weather_forecast_israel, giving clear sequencing context. It does not mention when not to use it or describe alternatives, but the prerequisite alone is strong guidance for this pipeline-style tool.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get_weather_forecast_content_israelA
  4.2/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  Annotations are absent, so the description carries the full burden. It discloses that the tool reads and cleans text content without modifying the page, but it does not describe failure behavior (e.g., what happens if no forecast page is open) or any side effects. A 3 reflects adequate but not rich behavioral disclosure.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  Two compact sentences in Hebrew, front-loaded with the action and purpose, followed by the prerequisite. Every sentence earns its place with no redundancy.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  With an output schema present and zero parameters, the description provides the essential context: what the tool does, its RAG purpose, and its required predecessor. It could add more detail on the 'cleaning' step or error conditions, but nothing critical is missing for an agent to invoke it correctly.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The tool has zero parameters, so parameter semantics are trivially satisfied. The description appropriately focuses on behavior rather than parameters, matching the baseline 4 for tools with no parameters.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description states a specific action ('retrieves and cleans the text content of the currently open forecast page in the browser') with a clear resource and scope. It is easily distinguished from sibling tools like open_weather_forecast_city_israel and select_weather_forecast_city_israel because it explicitly targets the already-open page and mentions its RAG purpose.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description explicitly says 'יש להריץ לאחר select_weather_forecast_city_israel' (must run after select_weather_forecast_city_israel), giving clear sequential context. It does not list when-not-to-use cases, but the prerequisite effectively routes the agent away from using it prematurely.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• select_weather_forecast_city_israelA
  4.5/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description carries the burden of behavioral disclosure. It discloses the interaction behavior (select first dropdown item) and the waiting behavior (wait for forecast page load), which goes well beyond the tool name. Minor details like timeouts or failure handling are not covered, but they are not essential for this simple step.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  Two compact Hebrew sentences, each earning its place: the first defines the action and result, the second states the prerequisite. There is no filler or repetition.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness5/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a zero-parameter UI automation step with an output schema present, the description provides everything needed: what to do, what to wait for, and the required preceding step. Nothing material is missing.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The tool has zero parameters and the schema coverage is 100%, so the baseline is 4. The description correctly adds no parameter documentation because there are no parameters to explain.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description states a specific action—selecting the first item from the autocomplete city list—and an outcome: waiting for the forecast page to load. It names the prerequisite sibling tool, distinguishing it from the surrounding flow despite being brief.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description explicitly says it must be run after enter_weather_forecast_city_israel, giving clear sequencing guidance. It does not discuss cases where an alternative should be used, but for this narrow step the context is clear.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• open_weather_forecast_israelA
  4.7/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description carries the full burden and it clearly discloses the core behavior: opening a new browser and navigating to a specific website. It adds a useful behavioral constraint about ordering, though it does not mention potential loading waits or failure behavior, which are minor for a simple navigation step.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is two short sentences with no filler. The primary action is front-loaded, and the critical sequencing instruction is delivered in the second sentence, making it easy to parse.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness5/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a zero-parameter navigation tool with an output schema, the description is complete enough: it states the action, the target site, and the required ordering relative to city entry or selection. No critical information is missing for correct invocation.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The tool has zero parameters and 100% schema description coverage, so there is no parameter semantic burden for the description to add. The baseline of 4 applies because the absence of parameters makes the schema trivially complete.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description states a specific verb and resource: it opens a new browser and navigates to the forecast page of weather2day.co.il. It also distinguishes itself from siblings by explicitly positioning this as the first step before entering or selecting a city.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines5/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description explicitly states when to use the tool: 'must always be run first, before entering or selecting a city.' This gives clear sequencing relative to sibling tools like enter_weather_forecast_city_israel and select_weather_forecast_city_israel, leaving no ambiguity about when it applies.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.