Server Quality Checklist

Tool Scores

• get_etf_profileB
  3.3/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  Discloses that include_gettex uses a WebSocket and can block outside trading/network conditions. No annotations exist, so description carries full burden; lacks disclosure on authentication, rate limits, or read-only nature.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness4/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  Three sentences with clear front-loading of purpose, followed by contents and a behavioral note. No fluff, but could be slightly more structured.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Description explains main purpose and includes list of output fields, but fails to describe expand_allocations and timeout_seconds. Given 0% schema coverage and 4 parameters, this is insufficient.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  With schema coverage at 0%, description adds meaning for isin (required) and include_gettex (explains blocking). But expand_allocations and timeout_seconds are not mentioned, leaving gaps.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool returns comprehensive ETF profile data for one ISIN, listing included fields. It distinguishes from sibling tools like search_etfs and get_chart by focusing on a single ISIN's full profile.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  Implies usage when detailed ETF profile is needed, and warns against using include_gettex=true unnecessarily due to blocking. However, no explicit when-to-use vs alternatives or exclusions.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get_chartA
  3.9/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description carries full burden for behavioral disclosure. It mentions some parameter behavior (e.g., unclosed for current day, limit capped at 5000) but does not state that the tool is read-only, idempotent, or any rate limits/authentication needs.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness4/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is well-structured with a clear purpose followed by parameter list. Some lines are slightly verbose (e.g., columns enumeration), but every sentence adds value. Could be tightened slightly without losing clarity.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given 8 parameters and no annotations, the description covers parameter semantics well but lacks behavioral context (e.g., read-only nature, error scenarios). Output schema exists so return details are handled elsewhere, but missing safety cues lower completeness.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters5/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema coverage is 0%, yet the description explains all 8 parameters with format, defaults, examples (e.g., columns list, date format YYYY-MM-DD), and constraints (limit capped at 5000). This fully compensates for the schema deficit.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool returns historical ETF performance chart data for one ISIN. This verb+resource combination distinguishes it from siblings like compare_charts (multiple ISINs) and get_etf_profile (profile data).

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The purpose implies usage for a single ISIN historical data, providing clear context. However, it does not explicitly exclude when to use alternatives like compare_charts or mention conditions like required authentication.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get_live_quoteA
  4.1/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  Since no annotations are provided, the description carries full burden for behavioral disclosure. It mentions the WebSocket feed, limitation to gettex/EUR, behavior outside trading hours (initial quote possible), and enforced timeout. This is good coverage for a live quote tool.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  Description is very concise: two sentences front-loading the purpose and adding behavioral context. No wasted words or repetition.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  The description covers tool source, limitation, and behavioral quirks. With an output schema present, return value details are not needed. It is almost complete; could mention data freshness or real-time nature explicitly.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters2/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 0%, so description needs to add meaning to the 2 parameters. It clarifies the quote is from gettex in EUR but does not explain the isin parameter or how timeout_seconds is related to the mentioned timeout. The timeout mention is vague and not explicitly linked to the parameter.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  Description clearly states it returns the latest live quote for an ETF from gettex in EUR. The verb 'Return' and specific resource (live quote for ETF from gettex in EUR) distinguish it from sibling tools like get_chart or search_etfs.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  Description explains the tool uses justETF's WebSocket feed, supports only gettex/EUR, and mentions behavior outside trading hours with a timeout. It provides clear context for when to use the tool, though it doesn't explicitly mention when not to use or suggest alternatives.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• compare_chartsA
  4.2/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description must carry the full burden. It details inputs but omits behavioral traits such as rate limits, data frequency, or what happens with large ISIN lists. The existence of an output schema partially compensates, but more transparency is needed.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is front-loaded with a clear one-liner followed by a bulleted parameter list. Every sentence serves a purpose, with no redundancy or wasted words.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the output schema exists, return value explanation is not needed. The description covers most inputs but omits pagination parameters and error handling. For a 9-parameter tool, it is reasonably complete.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  With 0% schema description coverage, the description adds significant meaning to all listed parameters (e.g., enumerations for currency, dates, input_value, output_value). However, it fails to mention limit and offset (pagination), which are present in the schema.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  Description clearly states 'Compare historical chart series for multiple ETFs,' specifying a distinct verb and resource, and distinguishes from sibling tools like get_chart (single ETF) and search_etfs (search only).

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description covers parameter meanings but lacks explicit guidance on when to use compare_charts versus alternatives or exclusions. However, the context from sibling tools implies it is for multi-ETF comparison, making usage relatively clear.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• search_etfsA
  4.7/5.0
  Behavior5/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description fully covers behavioral traits: query handling logic, default strategy, pagination with limit/offset, and a 5000 row cap. This is sufficient for a read-only search tool.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness4/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is well-structured with a clear purpose sentence followed by parameter list, but it is somewhat lengthy. One or two sentences could be trimmed without losing clarity.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness5/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  With 11 parameters and no annotations, the description covers every parameter's behavior and default values. An output schema exists (not shown), which would cover return format, making the description complete for this tool.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters5/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The schema has zero documentation coverage, but the description provides detailed explanations for all 11 parameters, including examples (e.g., asset_class like 'class-equity', region like 'World'). It adds significant meaning beyond the schema structure alone.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool searches the justETF screener and returns ETF overview rows. It uses a specific verb ('search') and resource ('justETF screener'), and distinguishes from sibling tools like compare_charts and get_etf_profile which serve different purposes.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description explains query behavior (ISIN vs free-text) and strategy options, but does not explicitly state when to use this tool vs alternatives. However, siblings are clearly separate functions, so usage context is apparent.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.