Server Quality Checklist

Tool Scores

• search_filingsA
  4.2/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full disclosure burden and delivers key behavioral traits: it returns metadata only (not matching text, so the URL must be followed) and ranks by keyword relevance rather than company size. These are genuine surprises the agent would not know from annotations or schema. It could add pagination or rate-limit details, but the core quirks are disclosed.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness4/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single dense paragraph that front-loads the core purpose and return shape, then delivers use-case and exclusion guidance, then two critical behavioral caveats. Every sentence adds value; it is slightly long as a wall of text but well-organized and efficient.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness5/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a search tool with 6 params, 100% schema coverage, no output schema, and no annotations, the description is comprehensive: it covers the date scope, return format, use case, exclusions, ranking behavior, and the metadata-only caveat. There are no obvious gaps for an agent to safely invoke this tool.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema coverage is 100%, so the input schema already documents all 6 parameters including the company lookup behavior and the exact-phrase quote syntax. The description adds no additional parameter-level detail beyond the schema, so the baseline of 3 is appropriate since the structured schema does the heavy lifting.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description uses a specific verb+resource combination ('Search the full text of SEC filings from 2001 onward') and clearly states what it returns (matching filings with company, form type, date, link). It distinguishes itself from the sibling list_company_filings by emphasizing full-text search across all filings vs. what appears to be a per-company listing function.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description explicitly states when to use it ('find how public companies discuss a topic in their own words') and provides clear exclusions ('Do not use for stock prices, financial figures, or private companies'). It lacks an explicit pointer to the sibling alternative tool, but the use-case framing and negative guidance are strong.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• list_company_filingsA
  4.4/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description carries the behavioral disclosure burden. It discloses ordering (newest first), internal ticker/company resolution, and the fact that unfiltered results are dominated by Form 4 filings. It does not explicitly state read-only behavior or return format, but 'List' makes this reasonably clear.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  Four concise sentences, each with a purpose: action/scope, usage context, company resolution, and filtering guidance. No wasted words, and the most important information is front-loaded.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a simple list tool with three well-documented parameters, the description covers selection criteria, invocation behavior, and filtering advice. It does not describe return fields, but with no output schema the agent can still reasonably infer it returns a list of filings. Slightly more detail on return shape would make it fully complete.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema coverage is 100%, so the schema already documents company, forms, and limit, including the Form 4 warning. The description reinforces the ticker/company resolution and filter-by-form guidance, but does not add substantively new parameter semantics beyond what the schema provides.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description opens with 'List filings a specific public company submitted, newest first,' which clearly identifies the resource and operation. It also distinguishes itself from the sibling search_filings by contrasting recent-reports-by-company with word-based searching.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines5/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  Explicitly states when to use the tool: 'Use when the user names a company and wants its recent reports rather than searching for particular words.' It also gives practical guidance on filtering by form type, which helps the agent decide how to invoke it appropriately.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.