Server Quality Checklist

Tool Scores

• search_flightsA
  3.7/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden of behavioral disclosure. It transparently describes the return payload (best_flights/other_flights, price_insights), the booking_token for booking links, and the departure_token for one-way results, adding context beyond the schema. It does not mention rate limits, error conditions, or pagination, but for a read-only search tool, the core behavioral traits are well disclosed.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness4/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is organized into three compact paragraphs: purpose and return values, token behavior, and capability summary. It front-loads the core purpose and packs dense information without unnecessary fluff. It is somewhat long but proportional to the tool's complexity, and every sentence contributes meaningful detail.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given 29 parameters, no output schema, and 12 sibling tools, the description is remarkably complete. It covers the return structure, token handling, supported trip types, and filter options. Missing are explicit caveats like mutual exclusivity (partially in schema), pagination, or route limitations, but these are secondary for initial selection and invocation.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The schema already provides 100% coverage of all 29 parameters with detailed descriptions and enums, so the additional value is inherently limited. The description adds a high-level filter overview ('nonstop only, max price, cabin class, specific airlines, departure/arrival time windows, layover duration, connecting airport exclusions, and emissions'), helping an agent group related parameters, but it does not introduce new semantic details for individual parameters beyond what the schema already states.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description opens with a specific verb and resource: 'Search for flights using Google Flights data via SerpAPI.' It clearly enumerates the return fields (price, duration, stops, etc.) and tokens (booking_token, departure_token), making the tool's function concrete and distinct from generic search tools. However, it does not explicitly contrast with any of the 12 sibling tools, so it stops short of full differentiation.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies usage scenarios by stating it 'Supports one-way, round-trip, and multi-city' and listing filters, which tells an agent what configurations are possible. However, it provides no explicit guidance on when to choose this tool over siblings like search_flights_flexible or explore_destinations, nor does it mention any exclusions or limitations.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• compare_airport_pricesA
  4.2/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description carries the full burden of behavioral disclosure. It reveals that the tool searches airports in parallel, consumes one API credit per airport, has a default of 5 and max of 10 airports, and sorts results by cheapest price. This is valuable beyond a simple statement of purpose, though it does not describe the return format.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is three tight sentences: a clear purpose statement, an illustrative example, and key constraints/behavior. Every sentence earns its place with no redundant prose, and the most important information is front-loaded.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's complexity (13 parameters, no output schema), the description provides honest selection context: what it does, when to use it, and how cost/sorting behave. It does not describe the result structure, but for choosing the right tool among siblings, the description is sufficiently complete, and the rich schema covers input requirements.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 100%, so the description does not need to restate parameter meanings. It does add a link between max_airports and API credit cost ('Uses one API credit per airport searched (default 5, max 10)'), but this is more behavioral than parameter-semantic. Baseline 3 is appropriate since the schema already handles parameter documentation.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description opens with a specific verb and resource: 'Find the cheapest departure airport for a trip by searching from all major airports near a location in parallel.' This clearly distinguishes the tool from siblings like find_cheapest_arrival_airport and search_flights by focusing on departure-airport comparison.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  Provides a concrete example of when to use it ('Should I fly from East Midlands, Birmingham, or Manchester to Buenos Aires?') which makes the intended use case clear. It does not explicitly name alternatives or say when not to use it, but the example plus the parallel search concept imply the comparison scenario.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• find_cheapest_arrival_airportA
  4.2/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description carries the full burden. It discloses that it compares airports in parallel, consumes one API credit per airport (default 5, max 10), and returns results sorted by price. This is useful behavioral context beyond a generic 'search'.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is three sentences that pack the purpose, use cases, and cost model with no fluff. It is front-loaded with the core function and each sentence adds value.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given 13 parameters and no output schema or annotations, the description provides the essential context: how the tool works, example prompts, cost implications, and result ordering. It doesn't detail return fields, but that's not required given the description's scope. A 4 is appropriate.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The input schema already documents all 13 parameters thoroughly (100% coverage). The description adds the default/max of max_airports, which is already in the schema, and doesn't introduce additional semantic meaning beyond confirming the use of arrival_location. Baseline 3 applies.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool finds the cheapest airport to fly into at a destination by comparing airports in parallel. It provides concrete example questions and explicitly names itself as the arrival-side counterpart to compare_airport_prices, distinguishing it from siblings.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description frames when to use it via examples and the phrase 'arrival-side counterpart to compare_airport_prices,' implying the primary use case is choosing among arrival airports. It doesn't explicitly list exclusions but gives clear context, warranting a 4.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get_booking_optionsA
  4.2/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries the full burden. It discloses that the tool returns booking options from different airlines/OTAs with direct links, which is useful. However, it does not mention whether the operation is read-only, any side effects, or requirements like the need to pass all original request parameters (departure_id, arrival_id, outbound_date) alongside the token. The description adds some behavioral context but lacks depth.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is two sentences, front-loaded with the primary purpose, and every sentence earns its place. It clearly states what the tool does, how to use it, and what to expect in return without any filler.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the absence of an output schema, the description explains the high-level return content (booking options from airlines/OTAs with direct links and price breakdown). It covers the essential workflow and expected output. It could mention more about the structure of the returned links or any prerequisites, but for a straightforward retrieval tool it is fairly complete.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema coverage is 100%, giving the baseline of 3. The description adds meaningful context by explaining that booking_token originates from a previous flight search and is used to fetch options. This clarifies the role of the token beyond the schema description. It also hints at why the original parameters are needed, adding value beyond the structured definitions.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description uses a specific verb ('Get') and a clear resource ('booking links and price breakdown for a specific flight'). It explicitly mentions the required input (booking_token) and distinguishes this tool from siblings like search_flights and get_return_flights, which are flight search tools, not booking-option retrieval tools.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description clearly instructs when to use this tool: after obtaining a booking_token from search_flights or get_return_flights. It implies the proper workflow without listing exclusions or alternatives, but the context is clear enough. No explicit 'when not to use' is provided, but the usage context is well stated.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get_return_flightsA
  4.2/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description must disclose behavioral traits itself. It does reveal a key dependency: it must be used after an outbound search with a departure_token. The read-only nature is implied by 'get' but not explicitly stated, and there's no mention of return format, pagination, errors, or rate limits. This meets minimum viability but leaves gaps.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is two sentences: the first states purpose and usage context, the second gives the critical input instruction. Every word earns its place, and it's front-loaded with the primary purpose.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a tool with no output schema and no annotations, the description covers the essential workflow and key parameter. It clearly explains when to use it and what input to pass. However, it doesn't describe the response shape or any caveats about token validity or matching logic, which would be useful for a flight search tool with this many siblings.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  All parameters have schema descriptions (coverage 100%), so the baseline is 3. The description adds value by explicitly highlighting the departure_token and explaining its role in connecting to the outbound search, which goes beyond the schema's per-field descriptions.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's function: 'get matching return flight options for a selected outbound flight.' This specific verb+resource structure distinguishes it from sibling tools like search_flights (general search) and plan_multi_stop_trip (itinerary planning).

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  It gives explicit context: 'After searching one-way outbound flights, use this...' and instructs to 'Pass the departure_token from the outbound search result.' This clearly defines the prerequisite workflow. However, it doesn't explicitly mention alternatives or when not to use it, so it lacks the full explicit exclusions that a 5 would require.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• plan_open_jaw_tripA
  4.2/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description carries the full burden. It discloses that it searches all nearby departure airports at once, compares two directions, returns ranked options with flight details and booking tokens, and uses 4 API credits total. These are important behavioral disclosures beyond a simple 'plan a trip' statement.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is concise and front-loaded, starting with the core purpose, then an example, then the detailed options and output. Every sentence earns its place, and it avoids redundancy or fluff.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's complexity (14 parameters, no output schema), the description provides a good high-level overview of the output (ranked options, flight details, booking tokens) and the cost (4 API credits). It could go deeper into the return structure, but for a planning tool with no output schema, this is a solid summary.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema coverage is 100% with detailed parameter descriptions already in the schema. The tool description reiterates the roles of destination_a and destination_b but adds little beyond the schema. The baseline of 3 applies because the description does not significantly enhance parameter understanding beyond what the schema provides.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's purpose: 'Plan an open-jaw trip visiting two destinations — fly into one country and out of another without backtracking.' This is a specific verb+resource, and the example ('Nottingham to Argentina and Chile in October') helps distinguish it from sibling tools like search_flights or plan_multi_stop_trip.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides clear context with the ideal use case example and explains the two itinerary directions. It does not explicitly mention when not to use this tool or alternatives, but the example and focus on open-jaw trips give a solid sense of when it is appropriate.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• explore_destinationsA
  4.3/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden of behavioral disclosure. It states what the tool returns ('a list of destinations with flight price, hotel price, best travel dates, flight duration, and stops') and describes two distinct usage modes. It also gives a concrete example of domestic flight exploration. This goes beyond a simple restatement, though it stops short of mentioning limitations like result size or pagination. Given the read-only nature, this level of transparency is solid.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness4/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is moderately long but every sentence contributes useful information. It opens with the core purpose, then describes outputs, then usage modes, then filters, and closes with a practical domestic example. There is no filler or redundancy; it is well-structured and earn its length, though a few sentences could be tightened without loss.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a tool with 20 parameters, no output schema, and no annotations, the description provides a strong contextual overlay. It covers return values, flexible vs. specific date usage, filters, and a niche use case. It doesn't explicitly explain all 20 parameters, but the schema handles that. The description is sufficient for an agent to understand when and how to use the tool, especially given the sibling context. It could mention edge cases (e.g., parameter precedence), but this is not a major gap.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Although schema coverage is 100% (baseline 3), the description adds meaningful parameter semantics beyond the schema. It explains parameter combinations: 'Use month + travel_duration for flexible date search, or outbound_date + return_date for specific dates' and gives filter guidance: 'Filter by interest (beaches, skiing, history, etc.) or region using arrival_area_id.' It also provides a concrete example for arrival_id (AEP) to clarify domestic usage. This adds context not present in the schema.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's function: 'Discover flight destinations and prices from a departure airport using Google Travel Explore.' It uses a specific verb (discover) with a clear resource (destinations/prices) and provides concrete examples like 'Where can I fly from London in June?' This distinguishes it from siblings such as search_flights, which would focus on specific flight searches, and it explicitly mentions open-ended holiday planning, making the purpose unmistakable.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description gives clear guidance on when to use the tool: 'Ideal for open-ended holiday planning' with examples of queries. It also differentiates between flexible date search (month + travel_duration) and specific dates (outbound_date + return_date), and highlights a special use case for domestic flights. While it doesn't explicitly name alternatives or say 'when not to use,' the context strongly implies the tool is for exploratory discovery rather than specific flight booking, and the sibling list provides natural alternatives.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• find_airportsA
  4.4/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden. It discloses return fields ('IATA code, name, city, country, and any additional cities/regions served') and shows example outputs. It does not cover edge cases like no matches, but for a read-only search tool this is adequate.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  Three sentences, front-loaded with purpose. Each sentence serves a role: definition, usage context, and return value details. No filler or redundancy.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Despite no output schema, the description explains return content and gives examples of behavior. It covers purpose, usage, and output, which is complete for a low-complexity lookup tool. Minor gap: no mention of limit behavior, but that's in the schema.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema coverage is 100% for both parameters, providing baseline 3. The description adds meaningful context for 'query' with examples and clarification of accepted input types (city, region, country, airport name), going beyond the schema's generic description.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description opens with a specific verb and resource: 'Find airport IATA codes by city, region, country, or airport name.' It clearly scopes the tool's function and distinguishes it from flight-search siblings by positioning it as a pre-flight resolution step.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  Explicit usage guidance is provided: 'Use this before searching flights to resolve place names to airport codes.' It also gives concrete examples (Nottingham, Argentina) that illustrate when it is especially useful, though it does not explicitly mention alternatives or exclusions.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• find_stopover_flightsA
  4.4/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description discloses API credit costs (2/3 credits), automatic airport resolution, and the precise date scheduling logic. It also notes the optional return leg. There's no mention of response format or error behavior, but the key behavioral traits are covered.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  Two short paragraphs plus a concise example, with no filler. The most important info (what and how) is upfront.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a 13-param tool with no output schema, the description covers the core workflow, cost, and optional return leg. It doesn't describe result structure, but given the schema's full parameter coverage, the tool's behavior is sufficiently specified.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  While schema covers all 13 params, the description adds the temporal relationship (outbound_date + stopover_days) and clarifies the optional return_date behavior. It also emphasizes the auto-resolution of stopover_location, though that's already in the schema.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description opens with a specific verb ('Search') and resource ('a split itinerary via a stopover city'), then illustrates with an example (LHR → Dubai → NRT). It clearly distinguishes from sibling tools like simple search_flights or plan_multi_stop_trip by defining the stopover structure.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  It provides a clear scenario and the structural logic of the search (origin→stopover, stopover→destination, optional return). It doesn't explicitly name alternative tools or when not to use it, but the use case is evident. The example and optional return mention provide context.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• search_flights_flexibleA
  4.4/5.0
  Behavior5/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries full burden and delivers by disclosing API credit cost per date (capped at 30 days), error handling for individual date failures, and the sorted result format. This goes beyond basic safety profiles and gives agents crucial operational detail.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is two short paragraphs, front-loaded with the core purpose and followed by essential cost/error details. Every sentence adds value, with no redundant or filler content.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's complexity (13 parameters) and lack of output schema, the description covers the key aspects: purpose, use case, cost, error behavior, and result shape. It does not detail the returned result fields, but the schema and sibling tools provide additional context, making this adequate though not exhaustive.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 100%, so the baseline is 3. The description itself does not add significant parameter-level meaning beyond what the schema provides, though it contextualizes the date range and output format. It neither compensates nor detracts from the schema coverage.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool searches flights across a range of dates to find the cheapest day, with a specific verb and resource. It also specifies the output (one result per date sorted by price) and provides an example use case, distinguishing it from sibling tools like search_flights.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides clear context for when to use this tool via the 'ideal for' phrase, targeting flexible-date searches. It does not explicitly name alternatives or exclusions, but the use case is clear enough for an agent to select it appropriately.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• check_price_insightsA
  4.5/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description carries the full burden. It discloses the return payload (lowest price, typical range, price level, context string), the round-trip auto-detection, and the API credit cost. This goes beyond basic purpose, though edge-case behaviors (e.g., invalid dates, missing data) are not covered.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  Two sentences deliver purpose, output details, an example, behavior, and cost. Every clause earns its place; no redundancy or fluff.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness5/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Despite 9 parameters and no output schema, the description covers the essential behavioral context: what the tool returns, how round-trip vs one-way is inferred, and resource cost. It complements the schema well and gives the agent a solid understanding of when and how to invoke it.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema coverage is 100%, so baseline is 3. The description adds meaningful context: return_date omission indicates one-way, and 'route' implies departure_id/arrival_id are the key pair. This enriches the parameter semantics without repeating schema details.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description uses a specific verb+resource ('Check whether flight prices for a route are currently cheap, typical, or expensive') and names the returned data ('price_insights data'). It clearly distinguishes this from sibling flight tools like search_flights or search_price_calendar by focusing on price level assessment of a specific route.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The intended use case is explicit: determine if prices are cheap, typical, or expensive for a route. It also clarifies behavior for round-trip vs one-way via return_date presence. No explicit alternatives or when-not-to-use are stated, but the sibling list makes the tool's niche clear.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• plan_multi_stop_tripA
  4.7/5.0
  Behavior5/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description discloses key behaviors: parallel leg search, automatic airport resolution (e.g., 'Patagonia' → BRC, USH, FTE, PUQ, BBA), per-leg API credit usage, and output format (cheapest per leg plus up to 3 alternatives).

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is compact yet dense: purpose, use case, example, credit cost, and output format all in a few sentences without redundancy.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness5/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given no annotations or output schema, the description covers the essential context: what the tool does, when to use it, how it behaves (parallel search, airport resolution, credits), and what it returns (cheapest per leg + alternatives). This is sufficient for an agent to select and invoke correctly.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema covers 100% of parameters with descriptions, so baseline is 3; the description adds semantic context for the trip parameter (parallel leg search, last stop date unused) and location resolution, justifying a 4.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description opens with 'Plan a multi-leg trip by searching each leg in parallel,' a specific verb+resource, and positions it as 'Ideal for internal/domestic routing within a multi-country holiday,' distinguishing it from sibling tools like search_flights and plan_open_jaw_trip.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description gives clear context ('Ideal for internal/domestic routing within a multi-country holiday') and a concrete example, implying when to use it instead of single-flight or open-jaw search tools, though it doesn't explicitly name exclusions.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• search_price_calendarA
  4.7/5.0
  Behavior5/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description carries the full burden. It clearly states behavioral details: return must be after outbound, capped at 30 combinations, searched in parallel, sorted by price, trip_days calculated, and 1 API credit per combination (max 30). This is rich, non-obvious context.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  Three sentences: purpose, behavior, and cost. Front-loaded with the main verb and resource. No filler or repetition of schema fields.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness5/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Despite lacking an output schema, the description covers purpose, input combination logic, constraints, performance limit, cost, and output ordering. This is fully sufficient for an agent to select and invoke the tool correctly.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema coverage is 100%, so baseline is 3. The description adds value by explaining how the date parameters interact (grid of outbound+return pairs, return must be after outbound, cap of 30 combos) and the output sorting, which goes beyond individual parameter descriptions.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description opens with a clear verb and resource: 'Search a grid of outbound + return date combinations to find the cheapest week to fly.' It also gives a concrete example question ('What's the cheapest combination of July departure and August return for LHR-JFK?') that distinguishes it from sibling tools like search_flights or search_flights_flexible.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides strong contextual cues for when to use this tool (comparing date ranges to find cheapest combination) via the example question. However, it does not explicitly state when NOT to use it or mention alternatives such as search_flights_flexible, leaving some ambiguity.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.