Server Quality Checklist

Tool Scores

• registerA
  4.2/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description carries full burden. It discloses key behavioral traits: free, no signup, returns bearer token with trial, human verification for more credits, no payment processor connected. It doesn't mention any side effects or destructive actions, but for a registration tool, this is sufficient.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness3/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is somewhat verbose and stream-of-consciousness, containing multiple sentences about the free trial and human verification. It could be more concise while preserving the essential information. The first sentence does front-load the purpose.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's simplicity (2 optional parameters, no output schema, no annotations), the description is quite complete. It explains the return value (bearer token, verification_uri_complete), how to use the result, and parameter purposes. It lacks details on errors or multiple calls, but for a registration tool, it's sufficient.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The input schema has no descriptions (0% coverage). The description adds meaning: 'label: a short name for this key, optional' and 'purpose: why you want web access, shown to your human on the activation page.' This provides context beyond the schema.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states it creates a Pagewatch API key, with specific verb+resource ('Create a pagewatch api key'). It distinguishes from sibling tools (read_page, screenshot, pdf, balance) which use the key.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description explains the usage flow: first register to get a token, then use it with other tools. It also tells what to do when the trial runs out (hand verification_uri_complete to your human). However, it doesn't explicitly state 'use this tool before the others' or mention prerequisites.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• read_pageA
  4.3/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  Discloses key behaviors: JavaScript rendering, robots.txt compliance, automatic trial key creation, and refusal to bypass blocked sites. No annotations exist, so description carries full burden well.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness4/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  Well-structured with main description followed by parameter details. Some redundancy (e.g., 'optional' repeated) but overall efficient and easy to parse.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Covers return format (clean markdown, metadata), auth behavior, and JS handling. Missing specifics on error scenarios or limitations, but adequate for typical use.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema coverage 0%, but description explains each parameter's purpose (url required, api_key optional with auto-creation, wait_for_selector for CSS selector, scroll for lazy content). Adds significant meaning.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  Clearly states it loads a web page and returns clean markdown with metadata, differentiating from siblings like screenshot, pdf, register, and balance by focusing on text content extraction.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  Provides context for use: handles JavaScript, respects robots.txt, and explains optional parameters. Lacks explicit when-not-to-use or alternatives, but sibling tools are distinct.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• screenshotA
  4.4/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  Description discloses consent overlay hiding, robots.txt compliance, free trial key creation, and return data format. With no annotations provided, this is thorough, though it omits error handling and authentication requirements beyond the optional api_key.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is efficiently structured: opens with the core purpose and result, then lists parameter details. Every sentence adds value, no redundancy.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness5/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given no output schema, the description adequately explains the return value (base64 image, final URL, pixel size) and the free trial key. All parameters are covered, and behavioral details are included. No significant gaps.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters5/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Each of the 7 parameters is explicitly explained in the description, including default values and optional behavior. The schema has no descriptions (0% coverage), so the description fully compensates, adding meaning to url, api_key, full_page, width, height, format, and wait_for_selector.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  Description clearly states the tool captures a screenshot of a web page in a real browser and returns base64 image data, final URL, and pixel size. It is distinct from sibling tools like read_page and pdf.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  No explicit when-to-use or comparison to alternatives is given. Usage is implied (visual capture), but the description does not guide the agent away from using this tool when text extraction (read_page) or PDF generation (pdf) is more appropriate.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• balanceA
  4.6/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries the burden. It discloses that it returns credits, prices, and an activation link if needed. It does not mention side effects or idempotency, but the read-only nature is implied.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is two sentences plus a parameter line, concise and front-loaded with the main action. Every sentence adds essential information.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness5/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the simple tool with a single optional parameter and no output schema, the description adequately covers what the tool does and how to use it. It explains the return values (credits, prices, activation link) sufficiently.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters5/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  With 0% schema description coverage, the description fully compensates by explaining the api_key parameter's purpose and when to provide it (if environment variable is not set), adding significant value beyond the schema.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states that the tool checks remaining free credits, per-call prices, and provides an activation link if the key is not activated. It uses specific verbs and resource, and is distinct from sibling tools which operate on pages.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description explains when to use the tool (to check balance info) and how to pass the api_key if the environment variable is not set. However, it does not explicitly mention when not to use it or provide alternatives among siblings.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• pdfA
  4.6/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations exist, so the description fully carries the behavioral burden. It discloses that it respects robots.txt, returns base64 data, and handles api_key with free trial creation. It does not mention failure modes or rate limits, but these are acceptable for a simple conversion tool.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is concise and front-loaded with the core purpose. It uses a brief paragraph followed by a clear list of parameter descriptions with no redundant information.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness5/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Despite no output schema or annotations, the description provides all necessary context: input options, output format, important behaviors like robots.txt and api_key handling, and parameter constraints. It is complete for this tool's complexity.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters5/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The description explains all five parameters in detail, including the mutually exclusive nature of url/html, allowed paper sizes, landscape orientation, and api_key behavior. This adds significant meaning beyond the bare schema, compensating for 0% schema coverage.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool renders a web page or raw HTML into a PDF and returns it as base64 data. It specifies the verb 'Render' and the resource, and it is distinct from sibling tools like read_page and screenshot.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides clear context for when to use the tool (converting URL or HTML to PDF) and explains the mutually exclusive requirement. However, it does not explicitly compare to sibling tools or state when not to use it.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.