Server Quality Checklist

Tool Scores

• awtrix_notifyB
  3.4/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  Annotations already communicate open-world behavior and non-idempotency, and the description adds that the notification is pushed instantly with high priority. It does not disclose auth needs, rate limits, or stacking/replacement behavior, but it does not contradict the annotations either.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single front-loaded sentence that states the essential action and destination with no filler. Every word earns its place.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  The core call is clear, but the description is minimal for a tool with 9 parameters and several sibling tools. It does not explain optional parameter relationships, duplicate-notification behavior, or when to prefer test_render; the presence of an output schema and annotations softens but does not fill these gaps.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters2/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 0%, and the description provides no prose about any of the 9 parameters. The schema's names and defaults are somewhat informative, but the description fails to compensate for the coverage gap, such as what 'text' should contain or how icon/color/sound values are formatted.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly names the action ('Push'), the object ('notification'), and the destination ('AWTRIX display'), and adds the distinguishing 'instant, high-priority' quality. This makes it easy to separate from sibling tools that manage apps, settings, or device state.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  There is no explicit guidance on when to use this tool versus alternatives such as awtrix_test_render or awtrix_upsert_app. The phrase 'instant, high-priority' weakly implies a use case, but the agent has to infer the right context from the tool name and siblings.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• awtrix_upsert_appA
  3.5/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  Annotations provide idempotentHint and destructiveHint=false, and the description aligns by saying 'create or update' and 'persistent'. It adds useful context about the app living in the display carousel and being persistent, but it does not disclose nuances like the effect of the 'save', 'lifetime', or 'lifetime_mode' parameters on persistence, or whether updating an existing app overwrites prior configuration. No contradiction with annotations exists.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single sentence with no wasted words. It is front-loaded with the operation ('Create or update') and immediately clarifies the resource and location ('persistent custom app in the display carousel').

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Despite having an output schema (so return values need not be explained), the high parameter count, nested TextSegment definition, and zero parameter descriptions make the overall description insufficient. An agent would not know how to construct a valid 'text' payload, when 'save' should be true, or what lifetime/lifetime_mode mean, so the tool cannot be reliably invoked correctly from the description alone.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters1/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The input schema has 10 parameters and 0% description coverage, so the description must compensate by explaining parameter meaning. It does not mention a single parameter (name, text, icon, save, color, repeat, rainbow, duration, lifetime, lifetime_mode), leaving the agent to rely solely on schema titles and defaults. This is insufficient for a schema of this complexity.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The descrip states a specific verb ('Create or update' — an upsert) and a specific resource ('persistent custom app' in the 'display carousel'). This clearly distinguishes it from siblings such as awtrix_delete_app, awtrix_notify, and awtrix_set_settings because it targets custom app lifecycle management, not deletion, notification, or settings.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description clearly conveys when to use this tool: when the goal is to create or update a persistent custom app in the carousel. It does not explicitly name alternatives or state exclusions, but the context is strong enough that an agent can infer the intended use versus notify or delete siblings.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• awtrix_delete_appA
  3.8/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  Annotations already declare idempotentHint and destructiveHint, so the core behavioral safety profile is covered. The description adds context beyond the annotations by specifying exactly what is destroyed or affected: a custom app's presence in the display cycle. No contradiction exists between the description and annotations.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single front-loaded sentence with no filler. It states the action, target, scope, and parameter mechanism efficiently.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  The tool is simple: one required parameter, an output schema is present, and annotations cover idempotency and destructive behavior. The description covers the essential target and parameter. Minor gaps remain around exact-name matching and the precise meaning of 'from the display cycle', but nothing critical is missing for basic invocation.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 0%, and the description only indicates that removal happens 'by name'. This adds meaning beyond the raw schema by relating the 'name' parameter to the custom app identifier, but it does not clarify expected format, uniqueness, or matching behavior. For a single simple parameter, this is adequate but minimal.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description uses a specific verb ('Remove'), identifies the exact resource ('a custom app from the display cycle'), and specifies the selection mechanism ('by name'). This clearly distinguishes it from sibling tools like awtrix_upsert_app, which creates or updates an app rather than deleting it.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  No explicit guidance is given about when to use this tool versus alternatives, nor are exclusions or prerequisites mentioned. The intended use is only implied by the tool's name and purpose, not stated.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• awtrix_set_settingsA
  3.9/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  Annotations already declare idempotentHint=true, destructiveHint=false, and openWorldHint=true, so the description is not required to restate safety behavior. The description adds a bit of context by listing what settings are affected, but it does not disclose side effects, persistence, or range constraints beyond the schema.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, compact sentence that states the action and the key areas affected. It is front-loaded with the verb and wastes no words.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a simple three-parameter settings tool with an output schema and safety-related annotations, the description is mostly sufficient. It could mention that all parameters are optional and independently updatable, but the schema already conveys that through defaults and nullability.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters2/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 0%, so the description bears the responsibility for explaining parameters. It only paraphrases the property names (brightness, transitions, power) without adding meaning about value ranges, units, null semantics, or the effect of each flag. The schema reveals defaults but little explanatory content.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description uses a specific verb ('Configure') and clearly identifies the resource (display settings) while naming the three configurable areas: brightness, transition animations, and screen power state. This distinguishes it from the sibling tools like awtrix_notify, awtrix_upsert_app, and awtrix_delete_app.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description makes the tool's purpose clear enough that an agent can infer when to use it: whenever display-level settings need to be changed. It does not explicitly state when not to use it or name alternatives, but the context is unambiguous given the sibling tool names.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• awtrix_test_renderA
  4/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  Annotations already include readOnlyHint=true and idempotentHint=true, lowering the burden on the description. The description adds useful specificity by stating 'no hardware side-effects', clarifying what read-only means in this hardware context. It does not contradict the annotations.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single focused sentence with the action front-loaded and the key safety qualifier stated immediately. Every word earns its place; there is no repetition, filler, or structural waste.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  With annotations covering safety, an output schema covering return shape, and schema defaults for optional parameters, the description is just barely viable for a minimal call using only the required `text` parameter. However, it lacks guidance on the notification/app distinction and advanced fields, and relies heavily on the provided schema and the agent's domain inference.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters2/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 0%, yet the description provides essentially no parameter-level guidance. It only echoes the 'notification/app payload' concept, which maps to the `kind` enum, but gives no help on ten other parameters, including TextSegment, rtttl, wakeup, rainbow, and color. The description fails to compensate for the missing schema descriptions.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states a specific action, 'Validate and preview', applied to a defined resource, 'rendered notification/app payload'. It also distinguishes itself from hardware-affecting siblings by explicitly noting 'no hardware side-effects', leaving no ambiguity about what the tool is for.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides clear context that this is a safe preview/validation operation, implying it should be used instead of side-effecting tools like awtrix_notify when testing payloads. It does not explicitly name alternatives or exclusion conditions, so it stops short of a 5.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• awtrix_get_device_stateA
  4.5/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  Annotations already declare readOnlyHint, openWorldHint, and idempotentHint, so the safety profile is covered. The description adds useful behavioral nuance by saying 'current' and 'if available,' signaling that values may change over time and that the active app field can be absent. This is meaningful context beyond the annotations.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  A single, well-structured sentence states the action and the list of returned metrics with no filler. The most important scoping word ('current') appears upfront, and the optionality of the active app is handled compactly.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness5/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  With no parameters, an output schema present, and annotations covering idempotence/read-only behavior, the description is sufficient for an agent to invoke the tool correctly. It states exactly what hardware metrics will be returned and does not need to cover return formatting because the output schema exists.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The tool has zero parameters, so the description has no parameter burden to carry. The baseline for zero-parameter tools is 4, and there is nothing here that reduces the score; the description instead clarifies what the returned metrics are.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description uses a specific verb ('Return') and names the exact resource: current AWTRIX hardware metrics (battery, lux, temperature, active app). It clearly distinguishes this read-only tool from the mutating/action siblings like awtrix_delete_app, awtrix_notify, and awtrix_upsert_app without needing to open the schema.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description makes it clear this is the status/read tool by saying 'Return current...' while all sibling tools are actions or mutations. It does not explicitly state when not to use it, but the context is clear enough that an agent would select this for reading hardware state rather than for changing anything.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.