Server Quality Checklist

Tool Scores

• delete_memoryA
  4.1/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries full burden of behavioral disclosure. It effectively describes critical behavioral constraints: batching requirements, forbidden usage patterns (multiple calls, search-delete loops, simulation of modifications), and prerequisites (explicit user request with IDs). It doesn't mention error handling, confirmation prompts, or irreversible nature, but covers most essential behavioral aspects for a deletion tool.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness4/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is well-structured with Trigger, Purpose, STRICT RULES, and Parameters sections. Each sentence serves a purpose, though the STRICT RULES section could be more concise. The information is front-loaded with clear purpose and critical constraints. Minor redundancy exists between the Purpose statement and parameter description.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a deletion tool with no annotations and no output schema, the description provides substantial context about usage constraints, behavioral rules, and alternatives. It covers the destructive nature implicitly through the strict rules. Missing elements include error handling details and confirmation mechanisms, but overall it's quite complete for guiding safe tool invocation.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 100% with the parameter clearly documented as 'List of memory IDs to delete'. The description adds minimal value beyond the schema by mentioning the parameter in the Parameters section but doesn't provide additional context about ID format, validation, or constraints. Baseline 3 is appropriate given the comprehensive schema coverage.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states 'Delete memories by ID' which is a specific verb+resource combination. It distinguishes from sibling tools by mentioning 'use add_feedback instead' when no ID is provided, though it doesn't explicitly differentiate from all siblings like search_memory. The purpose is unambiguous but could be more comprehensive about sibling differentiation.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines5/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides explicit usage rules including when to use (user explicitly asks to delete AND provides IDs), when NOT to use (no ID provided, to simulate modifications), and alternatives (use add_feedback instead). The STRICT RULES section gives clear guidance on batching, forbidden patterns, and prerequisites.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• add_messageA
  4.3/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden of behavioral disclosure. It effectively describes critical behavioral traits: the mandatory auto-invocation pattern ('AUTO-INVOKED: After every answer'), strict rules about what it can/cannot do (e.g., no modifications), and operational constraints ('CRITICAL: NEVER use this tool as part of a modification workaround'). It doesn't mention performance characteristics like rate limits or error handling, but provides substantial behavioral context beyond basic functionality.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness3/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is appropriately sized but not optimally structured. It uses clear section headers (Trigger, Purpose, STRICT RULES, Parameters, Notes), which helps organization. However, it contains some redundancy (e.g., repeating the mandatory execution in multiple places) and could be more streamlined. Every sentence earns its place, but the formatting could be more efficient.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness5/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's complexity (mandatory invocation pattern, strict rules about memory handling) and the absence of both annotations and output schema, the description provides complete contextual information. It covers purpose, triggers, strict operational rules, parameter expectations, and notes about client/orchestrator requirements. This is sufficient for an agent to understand when and how to use this tool correctly in the broader system context.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 100%, so the schema already documents both parameters thoroughly. The description adds minimal value beyond the schema: it clarifies that conversation_first_message is 'used to generate the user_id' (though schema says 'conversation_id'), and specifies that messages array must contain both user and assistant roles. However, these details are largely redundant with the schema's descriptions and required fields.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description explicitly states the tool's purpose: 'Save dialogue history (REQUIRED) and record NEW memories.' It distinguishes from siblings by specifying it's for new memories only, not modifications (unlike add_feedback) or deletions (unlike delete_memory). The verb 'save' and resource 'dialogue history/memories' are specific.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines5/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides explicit when-to-use rules: 'MANDATORY EXECUTION: You MUST call this tool after EVERY single answer' and 'ALWAYS use this tool for NEW memories.' It also specifies when-not-to-use: 'FORBIDDEN: Do NOT use `add_feedback` or other tools for adding new memories' and 'FORBIDDEN: Do NOT use this tool to modify/update existing memories.' It names the alternative tool (add_feedback) and provides clear exclusions.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• search_memoryA
  4.3/5.0
  Behavior5/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden of behavioral disclosure. It extensively documents critical behavioral traits: the mandatory auto-invocation protocol, the 'Four-Step Judgment' process for memory safety, the presence of AI speculations and noise in results, and the requirement to filter memories before use. It also specifies output constraints like not mentioning internal system terms. This provides comprehensive behavioral context beyond what a basic schema would offer.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness2/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is excessively long (over 500 words) and includes extensive procedural instructions that belong in agent guidelines rather than a tool description. While well-structured with sections like 'Purpose', 'Usage requirements', 'Critical Protocol', and 'Parameters', it contains significant redundancy and over-specification that doesn't earn its place in a tool description. The core purpose and usage could be communicated in 20% of this length.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the complexity of memory retrieval with safety protocols and no output schema, the description provides substantial context about what the tool does, how to use it, and how to handle results. It covers the retrieval purpose, mandatory invocation pattern, memory safety protocols, parameter usage, and result handling. The main gap is the lack of output schema documentation, but the description compensates by explaining how to process the returned memories.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 100%, so the schema already documents all three parameters. The description adds some additional context about 'query' ('should be a concise summary of the current user message') and 'memory_limit_number' ('defaults to 20'), but these details are largely redundant with the schema. The description doesn't add significant semantic value beyond what the structured schema provides.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description explicitly states the purpose as 'MemOS retrieval API. Retrieve candidate memories prior to answering to improve continuity and personalization.' This is a specific verb ('retrieve') + resource ('memories') combination that clearly distinguishes it from sibling tools like add_feedback, add_message, and delete_memory which perform different operations.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines5/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides explicit usage requirements: 'MUST be auto-invoked by the client before generating every answer (including greetings like "hello"). Do not wait for the user to request memory/MCP/tool usage.' It also specifies when to proceed without memories: 'If none are relevant, proceed to answer normally.' This gives clear guidance on when and how to use this tool versus alternatives.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• add_feedbackA
  4.6/5.0
  Behavior5/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries full burden and excels. It discloses critical behavioral traits: the tool is a 'FIRE AND FORGET' operation with a strict retry policy (no checking, retrying, or sleeping), it handles deletion without IDs, and it forbids certain agent behaviors (e.g., constructing 'Change X to Y' requests). These details go beyond basic function and guide agent interaction effectively.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness4/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is well-structured with clear sections (Trigger, Purpose, STRICT RULES, Parameters) and uses bullet points for readability. While comprehensive, it is slightly verbose due to repetitive emphasis (e.g., multiple 'FORBIDDEN' clauses). Every sentence serves a purpose, but some redundancy could be trimmed for optimal conciseness.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness5/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's complexity (handles modification and deletion without IDs), lack of annotations, and no output schema, the description is highly complete. It covers purpose, usage rules, behavioral constraints, parameter guidelines, and sibling differentiation. The detailed retry policy and content rules address potential agent misunderstandings, making it sufficient for safe and effective use.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 100%, so the baseline is 3. The description adds minimal value: it reiterates that feedback_content should contain 'only the user's intent' and forbids verbose narratives, which slightly clarifies the schema's 'clear, concise' description. However, it doesn't provide significant additional meaning for other parameters beyond what the schema already documents.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description explicitly states the tool's purpose: 'Modify/Delete existing memories based on natural language feedback.' It distinguishes from siblings by specifying usage when 'NO ID is provided' (unlike delete_memory which likely requires IDs) and for modification/update (unlike add_message which creates new memories). The 'Trigger' section reinforces this with specific scenarios.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines5/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides explicit, structured guidelines: STRICT RULE 1 defines when to use (modify/update/delete without IDs) and when not to use (implied: use delete_memory with IDs, add_message for additions). It names alternatives (delete_memory, add_message) in the retry policy and sibling context. The rules clearly demarcate this tool's scope from other tools.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.