Server Quality Checklist

Tool Scores

• find_meeting_timesA
  3.7/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations, so description carries full burden. It explains that it analyzes calendars and returns ranked options with timestamps, implying read-only behavior. However, it does not explicitly state it does not modify data, nor does it mention error handling or limitations.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  Two concise sentences: first states core purpose, second adds output usage guideline. No redundant or extraneous information, every sentence adds value.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  With 4 parameters, a nested preferences object, and no output schema, the description covers purpose and output format but lacks details on behavior (e.g., ranking logic, no-slot handling, error conditions). Completeness is adequate but not thorough.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Input schema has 100% description coverage, so schema already details all parameters. The description adds no additional parameter-level information beyond schema, earning the baseline score of 3 for high coverage.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  Description clearly states the tool finds available meeting time slots that work for all attendees, using specific verbs and resource. It distinguishes from siblings: check_calendar_availability likely checks a single slot, and create_calendar_event creates an event, while this tool focuses on finding times.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  Provides guidance on using the output timestamps for event creation, but does not explicitly state when to use this tool versus siblings or when not to use it. Implicitly, it is for finding slots before creating events, but lacks explicit context.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• create_calendar_eventA
  3.8/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description covers key behaviors (sending invitations, UTC timezone). However, it omits potential side effects, permissions, or error handling, leaving some gaps.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is two sentences, front-loading the primary action and adding only essential context. No filler or redundancy.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given 6 parameters (fully described in schema) and no output schema, the description provides sufficient context for event creation with invitations and timezone. Return value and error cases are missing but not critical.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema coverage is 100%, so the description adds minimal value beyond the schema. It reiterates the instruction to use times from find_meeting_times, which is helpful but not substantial.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states it creates a calendar event and sends email invitations, distinguishing it from sibling tools like check_calendar_availability and find_meeting_times.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides context (event appears on calendars, UTC timezone) but does not explicitly state when to use this tool versus its siblings or any prerequisites.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• check_calendar_availabilityA
  4/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries full burden. It states the tool returns busy/free status and uses UTC timezone, which is good. However, it doesn't disclose details such as whether event names are returned, limitations on calendar types, or how it handles all-day events.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is extremely concise: two sentences with no wasted words. It front-loads the core purpose and includes key usage context (UTC timezone) efficiently.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's simplicity (4 parameters, no nested objects, no output schema), the description is mostly complete. It explains inputs, defaults, timezone, and return type (busy/free). Could add more on exact output structure, but not required due to low complexity.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 100%, setting baseline at 3. The description adds value by specifying default start and end times (09:00 and 17:00) and that all times are in UTC, which are not in the schema. This helps the agent understand parameter behavior.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the verb ('Check'), resource ('free/busy status of people's calendars'), and scope ('one or more people, specific date and time range'). It distinguishes itself from siblings: 'create_calendar_event' (creating events) and 'find_meeting_times' (finding meeting times) are different tools.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description mentions that all times are in UTC and provides default times, but it doesn't explicitly state when to use this tool versus alternatives (e.g., 'find_meeting_times') nor when not to use it. Usage is implied but lacks explicit guidance.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.