Server Quality Checklist

Tool Scores

• debeka_open_pageA
  3.8/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  Beyond the annotations, the description discloses that the tool launches a Chromium browser, defaults to showing the UI, navigates to a specific form, and returns a success message with page title or an error. This is useful behavioral context not present in the annotation hints.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness3/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is well-structured with sections and examples, but the opening sentence and the next sentence overlap ('Opens...' and 'launches... navigates...'). The Args section also duplicates the schema, making the description slightly less tight than it could be.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a single-parameter browser-opening tool, the description covers invocation behavior, return values, and example usage. It does not mention cleanup via debeka_close or the broader workflow, but the tool is simple enough that these are not critical gaps.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The schema already fully describes the headless parameter with its default and meaning. The description repeats essentially the same information without adding new semantic detail, so it earns the baseline for full schema coverage.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  Description states a specific verb ('Opens'), resource ('Debeka Leistungsauftrag form page'), and browser behavior ('launches a Chromium browser and navigates'). It clearly stands apart from siblings like debeka_submit, debeka_screenshot, and debeka_close.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description gives parameter-level usage via examples ('headless=false to see the browser', 'headless=true for automated processing'), but it does not explain when to choose this tool over siblings or mention sequencing with tools like debeka_fill_credentials/debeka_submit. Usage context is implied, not explicit.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• debeka_screenshotA
  3.9/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  Annotations already declare readOnlyHint=true, idempotentHint=true, and destructiveHint=false, so the safety profile is covered. The description adds the return behavior (saved confirmation vs. base64), but does not provide much additional behavioral context such as potential file overwrite, image size implications, or failure behavior.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness4/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is concise and front-loaded with the core purpose. The Args/Returns sections are somewhat redundant with the input schema, but they are clearly structured and add no unnecessary filler.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a tool with one optional parameter and read-only, idempotent, non-destructive annotations, the description covers the key behavior and return value. Minor missing details like image format or behavior when no page is loaded are not critical for this low-complexity tool.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 100%, so the schema already fully documents the single optional output_path parameter. The description repeats the same semantics without adding new information, so the baseline of 3 is appropriate.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states a specific action and resource: 'Takes a screenshot of the current browser page.' This is distinct from the sibling tools like debeka_submit, debeka_fill_credentials, or debeka_open_page, so an agent can immediately tell what this tool does.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The phrase 'Useful for verifying the current state of the form before submitting' gives a concrete, actionable context for when to use the tool. It does not explicitly name alternatives or exclusions, but the intended timing relative to form submission is clear.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• debeka_upload_documentsA
  3.9/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  Annotations already indicate this is a write operation (readOnlyHint=false, idempotentHint=false). The description adds that the tool returns a success message listing uploaded files or error details, and implies state change by 'uploads.' It does not address failure modes, duplicate uploads, or file size limits, but it does not contradict the annotations.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness4/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is well-organized into summary, args, returns, and example, with the key prerequisite called out early. The first two sentences are somewhat redundant ('Uploads PDF documents...' followed by 'This tool uploads...'), but overall it is compact and scannable.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a single-parameter tool with strong schema coverage, the description is sufficient: it names the prerequisite tools, describes the input, and states expected return behavior. It does not detail every edge case or failure scenario, but nothing essential is missing for correct invocation.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 100%, so the schema already documents file_paths as an array of absolute PDF file paths. The description mostly restates this and adds an example. That example is helpful but does not add significant new semantic meaning beyond the schema.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states a specific action (upload PDFs), the target resource (the Debeka Leistungsauftrag form), and the accepted input. This distinguishes it from sibling tools like debeka_fill_credentials or debeka_submit, which perform different steps in the same workflow.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description gives explicit ordering guidance: 'Make sure to call debeka_open_page and debeka_fill_credentials first.' This is valuable workflow context. However, it does not mention when not to use this tool or name alternative approaches, so it stops short of a 5.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• debeka_submitA
  4/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  The annotations already declare readOnlyHint=false, destructiveHint=true, and idempotentHint=false, so the description's emphasis on 'actually submitting' largely reinforces this rather than adding new behavioral insight. It does add a small extra behavioral detail by promising a success message or error details on return, which is useful given no output schema.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is brief and every sentence earns its place: the purpose, a necessary warning, and the return behavior. The warning is appropriately prominent for a destructive tool, and there is no redundant filler.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a zero-parameter tool, the description covers what it does, the destructive consequence, and the expected return format. It could be more explicit about the workflow prerequisite that the form must already be filled and documents uploaded, but the sibling tool names and the data-correctness warning provide enough implied guidance.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The input schema has zero properties and additionalProperties=false, so there are no parameters to document. A baseline of 4 is appropriate because the description cannot add meaning to parameters that do not exist.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description uses a specific verb, 'Submits,' with a concrete resource, the 'Debeka Leistungsauftrag form.' This clearly distinguishes it from sibling tools like debeka_fill_credentials and decor_upload_documents, which handle preparation rather than final submission.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The warning 'Make sure all data is correct first' implies this is the final submission step and should not be run prematurely. However, it does not explicitly state that the agent should first run debeka_fill_credentials and debeka_upload_documents, nor does it name alternatives or exclusions.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• debeka_get_page_infoA
  4.2/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  Annotations already declare readOnlyHint, idempotentHint, and destructiveHint false, so the safety profile is covered. The description adds value by disclosing exact return contents (URL, title, form elements) and framing the tool as a diagnostic inspection, going beyond the structured annotations.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is compact: one purpose sentence, one usage context sentence, and a three-item return list. Every line earns its place and the main action is front-loaded.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness5/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a zero-parameter, read-only inspection tool with a simple output, the description is complete: it states what it does, when it is useful, and what it returns. The annotations handle side-effect and idempotency guarantees, so no critical operational detail is missing.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The tool has zero parameters and the schema's property list is empty with 100% coverage, so there is nothing for the description to add. The baseline of 4 applies because no parameter documentation is needed.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool gets current page structure and enumerates specific outputs (URL, title, form elements), which makes its purpose concrete. However, it does not explicitly differentiate itself from sibling tools such as debeka_screenshot, so sibling distinction is implied rather than stated.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description gives a clear use context: debugging when the form structure may have changed. It does not state when not to use the tool or mention alternative siblings, so it stops short of full routing guidance.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• debeka_fill_credentialsA
  4.3/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  Annotations already cover read-only vs. mutating behavior and idempotency. The description adds useful behavioral context: it operates on the already-open form, fills credential fields, and returns a success message or error details. This is sufficient for the agent to predict the tool's effect.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is well-structured: purpose sentence, prerequisite, Args list, Returns note, and a concrete example. Every section earns its place and the most important usage constraint is front-loaded.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness5/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a tool with 5 simple parameters, no output schema, and no nested objects, the description is complete: it states what the tool does, the required precondition, all parameter semantics through schema plus example, and the return behavior.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 100%, so the schema already documents every parameter. The description repeats the param meanings and adds a concrete example plus an 'optional' marker for telefon, but does not add substantial new semantic meaning beyond the schema.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description opens with a specific verb and resource: 'Fills in all personal data fields on the Debeka Leistungsauftrag form.' It clearly separates this tool from siblings like debeka_submit, debeka_upload_documents, and debeka_screenshot by focusing on credential/personal-data entry.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description explicitly instructs the agent to call debeka_open_page first, which establishes the required ordering and context. It does not enumerate alternatives or exclusions, but the 'open Debeka form' prerequisite and the tool's specific fill role are enough to guide usage.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• debeka_closeA
  4.5/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  The description adds useful behavioral context beyond the annotations: it closes the browser instance, frees resources, and returns a confirmation. The annotations already indicate idempotence and non-destructiveness, so the description's resource-freeing note and return-value statement are meaningful supplements without contradicting the annotations.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is short and front-loaded, with the primary action stated in the first sentence. Every sentence earns its place: the trigger context, the resource-freeing rationale, and the return value are all concise and relevant.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness5/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a zero-parameter tool with no output schema, the description is complete: it states what happens, why to call it, when to call it, and what to expect in return. No additional context is needed for an agent to select and invoke this tool correctly.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The tool has no parameters, and the schema has complete coverage. The description does not need to explain parameter semantics, and it adds value by clearly stating the tool's side effect and return value instead.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description uses the specific verb 'Closes' with a clear resource ('the browser instance'), and the context 'when you're done with the Debeka form' makes the tool's role unambiguous. It is clearly distinct from sibling tools like debeka_open_page or debeka_submit, which perform different actions on the form.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description explicitly states when to call this tool: when done with the Debeka form to free up resources. It does not mention when not to call it or list alternatives, but the 'done with the form' trigger is sufficient for a simple close operation, and no sibling tool serves the same purpose.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.