Server Quality Checklist

Tool Scores

• get_cheapest_hoursA
  3.6/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries full burden. It only describes the tool's function without disclosing any behavioral traits (e.g., data source, latency, error handling, or whether it's a read operation). A read operation is implied but not confirmed.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness4/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is concise with two sentences, front-loading the purpose. It is efficient and avoids excess text, though it could be slightly expanded for completeness.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  The description explains what the tool does but not the output format or how results are returned. Given no output schema, this is a gap. However, the tool's simplicity and clear parameters partially compensate.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema coverage is 100%, so the schema already documents all parameters. The description does not add any parameter-specific meaning beyond what the schema provides, maintaining a baseline of 3.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool finds the N cheapest hours of the day for a price zone, with concrete use cases like scheduling EV charging. It distinguishes from siblings (e.g., get_current_price, get_price_forecast) by focusing on cheapest hours.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  Provides clear context on when to use (scheduling appliances) and includes a natural language query example in Danish. Does not explicitly exclude cases or mention alternatives, but the context is sufficient.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get_today_pricesA
  3.7/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description must fully disclose behavior. It states the tool returns 'all 24 hourly electricity prices', but lacks details such as whether prices are in order, the unit (e.g., DKK/kWh), or any timezone considerations. No mention of data source, update frequency, or potential delays.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is extremely concise at two sentences. The first sentence states the core functionality and defaults, and the second provides a usage hint. There is no unnecessary text, and every word contributes meaning.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  The tool has 3 parameters with no output schema, so the description should partially compensate. It mentions 'all 24 hourly electricity prices' but does not specify the structure (e.g., list of objects with hour and price) or any units. This is adequate but leaves room for improvement.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 100%, so the baseline is 3. The description does not add any extra meaning beyond what the schema already provides for each parameter (area, mode, date). The enums and defaults are well-documented in the schema, so the description offers no additional value.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool gets all 24 hourly electricity prices for a given date in a price zone, and includes a specific use case hint: 'elpriser i dag / time for time'. This distinguishes it from sibling tools like get_current_price (single current price) and get_price_forecast (forecast).

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides explicit context with 'Use for "elpriser i dag / time for time"', indicating when to use it. However, it does not explicitly exclude other scenarios or mention alternatives like get_cheapest_hours, which could be used for filtering. The sibling names help but are not referenced.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• find_net_companyA
  3.8/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations provided. The description mentions it's a lookup operation but does not disclose whether it's read-only, what side effects exist, or what the output format is. This is insufficient for behavioral transparency.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single concise sentence plus a usage hint, with no unnecessary words or redundancy. It is well-structured and front-loaded with the core purpose.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a simple tool with 2 parameters and no output schema, the description covers the purpose and usage. Lacks return value information, but given simplicity, it is nearly complete.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Input schema provides clear descriptions for lat and lng (WGS84). The description adds context about locality but not additional parameter meaning. Schema coverage is 100%, so baseline 3 applies.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's function: lookup a Danish net company by latitude/longitude. It provides context ('needed to compute the exact total price for an address') and includes a Danish query phrase, effectively distinguishing it from sibling price-related tools.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description gives a specific use case and query example ('Use for "hvilket netselskab har jeg"'). It implicitly guides usage, but does not explicitly mention when not to use or provide alternatives, though sibling tools are clearly unrelated.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get_current_priceA
  3.8/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description must disclose behavioral traits. It only states the tool's purpose, with no information about read-only nature, side effects, rate limits, or data freshness. For a simple query tool, this is insufficient.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is extremely concise, consisting of two short sentences that efficiently convey purpose and usage context. Every word adds value.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a simple tool with no output schema and no annotations, the description is adequate but lacks details like data source or refresh rate. It is complete enough given the low complexity, but could be slightly improved.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The input schema has 100% description coverage for both parameters (area and mode) with detailed enum descriptions. The tool description adds no additional meaning beyond the schema, so baseline score of 3 is appropriate.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool gets the current Danish electricity price for a price zone, using a specific verb and resource. It includes a usage example in Danish, and implicitly distinguishes from sibling tools like 'get_price_forecast' or 'get_today_prices' by focusing on the current hour.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description explicitly says 'Use for ...' with example user queries, indicating when to use. However, it does not provide when-not-to-use or mention alternatives, though sibling tools cover other temporal queries.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get_price_forecastA
  4/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries full burden. It discloses the time horizon (7 days) and the data source distinction (actual vs estimate). However, it does not mention the return format, potential error conditions, or any other behavioral traits like rate limits. Adequate but not comprehensive.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  Two sentences front-load the key information: the tool's capability and a usage hint. Every word earns its place; no fluff. Excellent conciseness.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool has no output schema and moderate complexity (2 params, 7-day forecast), the description is fairly complete: it explains the time range, data source distinction, and provides a usage hint. It does not describe the output format, which would improve completeness, but the essential context is conveyed.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema coverage is 100% with detailed descriptions for both parameters (enum values explained). The description adds minimal extra context (price zone and mode meanings are already covered in schema). Baseline 3 is appropriate as the description does not significantly enhance parameter understanding beyond the schema.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool gets a 7-day electricity price forecast for a price zone. It distinguishes between actual day-ahead prices and weather-corrected estimates, and provides a concrete use case in Danish. The purpose is specific and differentiates from sibling tools like get_current_price or get_today_prices.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description includes a usage hint ('Use for elpriser de næste dage / prognose') which indicates when to apply it. It does not explicitly mention when not to use it or compare to alternatives, but the context of siblings and the forecast nature provides implicit guidance. Close to a 5 but lacks explicit exclusions.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.