Server Quality Checklist

Tool Scores

• list_videosC
  2.4/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description must disclose behavior, but it only states the result includes statistics. It does not reveal pagination through the cursor/limit parameters, ordering, or whether a valid account context is required, which is critical for a listing operation.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness4/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, short sentence, making it highly concise and easy to parse. However, its brevity comes at the cost of substance; it is efficient but under-specified, which keeps it from being excellent.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  The tool has no output schema and no annotations, and the description does not explain the return format, pagination behavior, or the scope of 'the account's videos'. This is inadequate for a listing tool with pagination parameters, as the agent cannot infer when all videos are returned versus a page.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters1/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The description neither mentions limit nor cursor and provides no semantics for these parameters. Schema coverage is 0%, so the description fails to compensate, leaving the agent without guidance on pagination or result size control.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly identifies the resource ('the account's videos') and adds a distinguishing feature ('with their statistics'). However, it uses a noun phrase rather than an explicit verb, relying on the tool name 'list_videos' to convey the action. This is sufficient to separate it from video_stats, which likely focuses on individual video statistics.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines1/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  There is no mention of when to choose this tool over siblings such as video_stats or post_status. The description provides no context for use cases, prerequisites, or exclusions, leaving the agent to guess.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• video_statsB
  3.2/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are present, so the description carries the full burden. The verb 'View' implies a read-only operation, but the description does not explicitly state that no data is modified, nor does it disclose any limitations or response format. The ambiguous phrasing further weakens transparency, preventing a higher score.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness4/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is one sentence and front-loaded with the action. It is concise, but the grammatical ambiguity reduces structural clarity, so it earns a 4 rather than 5.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  The tool is simple with one parameter and no output schema. The description conveys the basic purpose, but lacks details on return structure or expected behavior (e.g., missing IDs, performance). For a tool of this complexity, the gaps prevent a higher score.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  With only one parameter and 0% schema description coverage, the description must compensate. It clarifies that video_ids are 'specific video ids', aligning with the schema, but does not elaborate on array semantics, acceptable ID formats, or behavior when multiple IDs are provided. It adds some meaning but leaves gaps.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  Description states the tool views counts for specific video IDs, which identifies the resource and action. However, the phrasing 'View, like, comment and share counts' is grammatically ambiguous, potentially reading as a list of verbs (view, like, comment, share) rather than metric types (view count, like count, etc.). This prevents a perfect score.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides no guidance on when to use this tool versus siblings like list_videos or creator_info. It does not mention prerequisites (e.g., obtaining video IDs) or exclude cases where this tool would be inappropriate.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• post_statusA
  3.6/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description carries full burden. It does not disclose any behavioral traits beyond 'poll'—no mention of return format, whether to repeat calls, rate limits, or side effects. This is a significant gap.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single concise sentence with no wasted words, making it highly efficient and front-loaded.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Despite its simplicity, the description lacks essential behavioral details and workflow context. An agent may not know what the poll returns or whether to poll repeatedly, making the tool's use incomplete.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The description adds meaning by indicating the publish_id comes from post_video, which is helpful. However, it does not elaborate on format or constraints, so it provides only moderate compensation for the schema's 0% description coverage.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool polls a publish_id returned by post_video, providing a specific verb ('poll') and resource (publish_id). It also distinguishes itself from siblings by referencing post_video, making its purpose unambiguous.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies usage after post_video, as it says to poll a publish_id 'returned by post_video.' This gives clear context for when to use the tool, though it does not explicitly list exclusions or alternatives.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• post_videoA
  4/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description carries the full burden and does a good job: it discloses the return format (publish_id), the behavioral difference between upload (drafts) and publish (direct post), and a platform-specific caveat (private until audit passes). This goes beyond a simple action statement, though it omits details like error handling or reversibility.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is concise and well-structured: the first sentence states the primary action and return value, then the second paragraph explains the modes. Every sentence adds value, and the front-loaded structure makes the purpose immediately clear.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given 7 parameters, no schema descriptions, no annotations, and no output schema, the description covers the core purpose and mode behavior, but it leaves the majority of parameters unexplained. It's minimally viable but has clear gaps for a tool with this complexity.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters2/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The input schema has 0% description coverage, so the description must compensate, but it does not. It never mentions any parameter (e.g., dry_run, privacy_level, caption) and only vaguely refers to modes without linking them to parameters. The description adds minimal value beyond schema field names.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the action 'Upload a video to the authorized account' and adds a distinct return value ('Returns a publish_id to poll'), differentiating it from sibling tools like post_status and list_videos. This is a specific verb+resource statement with no ambiguity.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides clear context on when to use the tool and the two modes (upload vs. publish), including the audited app requirement for publish mode. While it doesn't explicitly mention alternatives or when not to use it, the mode explanation gives practical usage guidance that helps an agent decide how to invoke it.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• creator_infoA
  4.6/5.0
  Behavior5/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description carries full burden and succeeds: it discloses that the endpoint is Direct-Post-only, gated on video.publish, unavailable in upload mode, and automatically consulted to avoid rejected posts due to unsupported privacy_level. It also lists the returned fields, providing strong behavioral context.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is compact and front-loaded: a scannable list of returned fields followed by two sentences of critical context. No filler or repetition.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness5/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a zero-parameter, no-output-schema info tool, the description covers what the tool returns (nickname, privacy levels, duration cap, interaction toggles), when it runs, and why it is needed. It leaves no major gaps for a pre-post lookup.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The tool has zero parameters, so there is nothing for the schema to describe; the description confirms it is a no-input lookup of fixed creator properties. Baseline 4 is appropriate because no parameter explanation is needed.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description opens with the data the tool exposes ('Nickname, allowed privacy levels, duration cap, interaction toggles'), making it clear this is a creator-info lookup, and later explains its role before direct posts. It lacks an explicit verb like 'retrieves' or 'returns,' so it falls just short of the strongest purpose statement, but it is unmistakably distinct from sibling tools.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines5/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description explicitly states when to use it ('Consulted automatically before a direct post'), when not ('unavailable — and unnecessary — in upload mode'), and explains the underlying TikTok permission gating on video.publish. It gives clear context with no need for alternative tool mentions.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• health_checkA
  4.9/5.0
  Behavior5/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description carries full burden. It discloses the exact endpoint and scope used ('/v2/user/info/ (user.info.basic)'), the rationale for avoiding creator_info, and the behavioral checks performed. This is substantial context well beyond a mere purpose statement.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  Two sentences, front-loaded with the core purpose, followed by a concise technical justification. Every word earns its place; no redundancy or filler.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness5/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a zero-parameter, no-output-schema health check, the description fully explains what the tool checks, why it exists, and the specific infrastructure choice. The context about upload-only setups is especially valuable for an agent deciding when this is the right call.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The tool has zero parameters, so the empty schema is fully covered. The description correctly does not invent parameter details. Per rubric, 0 params earns a baseline 4; no additional semantic explanation is needed.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states what the tool does: 'Credentials refresh, account reachable, and which posting mode is active.' It also distinguishes itself from sibling tools by explicitly contrasting its backing endpoint with creator_info, making its scope obvious.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines5/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  It provides explicit when-not guidance by explaining that creator_info is a Direct Post endpoint gated on video.publish and would fail on upload-only setups. This tells the agent to prefer health_check over creator_info for health monitoring in such configurations.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.