Skip to main content
Glama
yuki777

sigsci-mcp-server

by yuki777

sigsci-mcp-server

MCP server implementation for the Signal Sciences (Fastly NGWAF) API.

日本語版はこちら → README.ja.md

Implements the Code execution with MCP approach to minimize context consumption from tool definitions.

Features

  • Progressive Disclosure: Dynamically discover and load only the tools you need

  • 40+ API tools: Read-only corp/site APIs supported

  • Type-safe: Fully typed with TypeScript

  • MCP compliant: Built on the Model Context Protocol SDK

Related MCP server: Shannon Lite MCP

Usage

Configure for Cursor / Claude Desktop

  • Add to ~/.cursor/mcp.json or claude_desktop_config.json:

{
  "mcpServers": {
    "sigsci-mcp-server": {
      "command": "npx",
      "args": ["-y", "https://github.com/yuki777/sigsci-mcp-server"],
      "env": {
        "SIGSCI_EMAIL": "your-email@example.com",
        "SIGSCI_TOKEN": "your-api-token"
      }
    }
  }
}

Available Tools

Corp tools

Tool

Description

sigsci_list_corps

List corporations

sigsci_get_corp

Get corporation details

sigsci_get_corp_report

Get attack report

sigsci_list_corp_activity

List corp activity events

sigsci_list_corp_users

List corp users

sigsci_get_corp_user

Get corp user details

sigsci_list_corp_rules

List corp rules

sigsci_get_corp_rule

Get corp rule details

sigsci_list_corp_tags

List corp signal tags

sigsci_get_corp_tag

Get corp signal tag details

sigsci_list_corp_lists

List corp lists

sigsci_get_corp_list

Get corp list details

sigsci_list_corp_integrations

List corp integrations

sigsci_get_corp_integration

Get corp integration details

sigsci_list_cloudwaf_instances

List CloudWAF instances

sigsci_list_cloudwaf_certs

List CloudWAF certificates

Site tools

Tool

Description

sigsci_list_sites

List sites

sigsci_get_site

Get site details

sigsci_list_site_activity

List site activity events

sigsci_list_site_members

List site members

sigsci_get_site_member

Get site member details

sigsci_list_site_rules

List site rules

sigsci_get_site_rule

Get site rule details

sigsci_list_templates

List rule templates

sigsci_get_template

Get rule template details

sigsci_list_configured_templates

List configured templates

sigsci_get_configured_template

Get configured template details

sigsci_list_site_tags

List site signal tags

sigsci_get_site_tag

Get site signal tag details

sigsci_list_site_lists

List site lists

sigsci_get_site_list

Get site list details

sigsci_list_alerts

List alerts

sigsci_get_alert

Get alert details

sigsci_search_requests

Search requests

sigsci_get_request

Get request details

sigsci_get_request_feed

Get request feed

sigsci_list_events

List events

sigsci_get_event

Get event details

sigsci_list_suspicious_ips

List suspicious IPs

sigsci_list_rate_limited_ips

List rate-limited IPs

sigsci_get_whitelist

Get whitelist

sigsci_get_blacklist

Get blacklist

sigsci_list_agents

List agents

sigsci_get_agent

Get agent details

sigsci_list_top_attacks

List top attacks

sigsci_get_timeseries

Get timeseries data

Meta tools (for Progressive Disclosure)

Tool

Description

sigsci_search_tools

Search tools by keyword

sigsci_list_tool_categories

List tools by category

Using Progressive Disclosure

This MCP server implements Anthropic’s recommended Code execution with MCP approach.

Problems with traditional MCP

  1. Tool definitions consume context: Preloading all definitions costs many tokens

  2. Redundant intermediate results: API responses can flood context as-is

How this server addresses them

  1. On-demand tool discovery: Use sigsci_search_tools and sigsci_list_tool_categories to find only what you need

  2. Control detail level: detailLevel lets you choose name-only/with descriptions/full definitions

  3. Tool definitions as resources: Access tool definition files as MCP resources

Example

// 1. Check categories first
await sigsci_list_tool_categories({ detailLevel: "name" });

// 2. Search for the needed tools
await sigsci_search_tools({ keyword: "request", detailLevel: "description" });

// 3. Call only the needed tools
await sigsci_search_requests({
  corpName: "my-corp",
  siteName: "my-site",
  q: "tag:XSS",
});

Development

# Dev mode (watch)
npm run dev

# Build
npm run build

# Lint
npm run lint

# Test
npm test

License

MIT

References

Available Tools

48 tools
sigsci_get_agentC

Get details of a specific agent

ParametersJSON Schema
NameRequiredDescriptionDefault
corpNameYesThe name of the corporation
siteNameYesThe name of the site
agentNameYesThe name of the agent

TDQS

C2.9/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations provided, and the description does not disclose behavioral traits such as read-only nature, authentication requirements, or error handling (e.g., what happens if agent not found). Minimal transparency for a read operation.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is concise with a single sentence. However, it could be structured to include more context without adding length.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

No output schema and sparse description. Lacks explanation of returned data, error scenarios, or prerequisites. Incomplete for a tool with no annotations or output schema.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with descriptions for all three parameters. The description adds no additional meaning beyond what the schema provides, so baseline 3 applies.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool retrieves details of a specific agent. Although it doesn't explicitly differentiate from sibling tools like 'sigsci_list_agents', the name and context imply a single-resource retrieval. Could be more precise about what 'details' include.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives like 'sigsci_list_agents' or other get tools. Missing context on prerequisites or when this tool is appropriate.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

sigsci_get_alertC

Get details of a specific alert

ParametersJSON Schema
NameRequiredDescriptionDefault
corpNameYesThe name of the corporation
siteNameYesThe name of the site
alertIdYesThe ID of the alert

TDQS

C2.9/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Without annotations, the description must disclose behavioral traits. It only says 'Get', implying a read operation, but does not clarify no side effects, required permissions, or rate limits. For a tool with no annotations, this is insufficient.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, efficient sentence with no unnecessary words. It is front-loaded with the verb and resource, making it easy to parse.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given no output schema, the description should hint at the return value (e.g., 'including attributes such as type, severity, and status'). It only says 'details', which is vague. Additionally, it lacks usage context compared to sibling tools.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, with each parameter having a clear description. The tool description adds no additional meaning beyond the schema, so baseline score of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description 'Get details of a specific alert' clearly states the verb 'Get' and resource 'alert', indicating a retrieval operation. It is specific to a single alert but does not differentiate from sibling tools like 'sigsci_list_alerts' which lists all alerts.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus alternatives. For instance, it could mention that 'sigsci_list_alerts' is used for listing alerts, while this tool retrieves a single alert by ID. The lack of context makes it harder for an agent to decide.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

sigsci_get_blacklistC

Get blacklist for a site

ParametersJSON Schema
NameRequiredDescriptionDefault
corpNameYesThe name of the corporation
siteNameYesThe name of the site

TDQS

C2.9/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description must convey behavioral traits. 'Get' implies read-only, but no confirmation of idempotency, permissions, or side effects is given.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Extremely concise, single sentence with front-loaded verb and object. However, it may be too brief, lacking essential details.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

No output schema and no annotations; the description fails to explain the blacklist content, response format, or any constraints, leaving the agent underinformed.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Both parameters are fully described in the schema (100% coverage). The description adds no additional meaning beyond the schema, meeting the baseline.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states 'Get blacklist for a site', clearly specifying the verb and resource. It distinguishes from other get tools like sigsci_get_whitelist by resource name, but lacks definition of 'blacklist'.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives. No context or exclusions provided.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

sigsci_get_configured_templateB

Get details of a specific configured template

ParametersJSON Schema
NameRequiredDescriptionDefault
corpNameYesThe name of the corporation
siteNameYesThe name of the site
templateIdYesThe ID of the configured template

TDQS

B3.3/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations provided; description does not disclose behavioral traits such as read-only nature, required permissions, or potential side effects for a simple get operation.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Extremely concise (7 words), front-loaded with the key action and resource, no unnecessary text.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Adequate for a simple get tool with a clear purpose, but lacks context on what 'configured template' means and response format, given no output schema.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema covers all 3 parameters with descriptions (100% coverage), so description adds no additional meaning beyond what schema provides.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description uses specific verb 'Get details' and resource 'configured template', clearly distinguishing from sibling tools like sigsci_list_configured_templates and sigsci_get_template.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool vs alternatives like sigsci_get_template. Does not mention prerequisites or contextual cues.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

sigsci_get_corpB

Get details of a specific corporation by name

ParametersJSON Schema
NameRequiredDescriptionDefault
corpNameYesThe name of the corporation

TDQS

B3.1/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations provided, and the description does not disclose behavioral traits (e.g., permissions, error handling, rate limits). For a simple read operation, more context would be helpful.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, no redundancy. Directly communicates the tool's purpose without extraneous information.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's simplicity (one parameter, no output schema), the description is minimally adequate. However, it lacks information on return value structure or uniqueness constraints.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, and the description mentions 'by name' which aligns with the sole parameter. However, the description adds no additional meaning beyond the schema's description of 'corpName'.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states 'Get details of a specific corporation by name', specifying the verb and resource. It distinguishes from list tools but does not explicitly differentiate from other get tools like sigsci_get_corp_list.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives such as sigsci_list_corps or other get tools. Lacks context on prerequisites or use cases.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

sigsci_get_corp_integrationB

Get details of a specific integration in a corporation

ParametersJSON Schema
NameRequiredDescriptionDefault
corpNameYesThe name of the corporation
integrationIdYesThe ID of the integration

TDQS

B3.3/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, and the description does not disclose any behavioral traits such as side effects, permissions, or error handling. It only states the basic action without additional context.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, concise sentence with no unnecessary words. It is front-loaded and to the point.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the simplicity of the tool (single get operation) and lack of output schema or annotations, the description is minimally adequate. It does not explain return value structure, but for a straightforward retrieval, it is acceptable.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so the description does not add meaning beyond the schema. Both parameters are clearly documented in the schema, meeting the baseline.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states it retrieves details of a specific integration within a corporation, using a precise verb and resource. It distinguishes from the sibling tool 'sigsci_list_corp_integrations' which lists all integrations.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives like list tools. The description does not specify that it requires an integration ID or that it is for single integration retrieval.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

sigsci_get_corp_listB

Get details of a specific list in a corporation

ParametersJSON Schema
NameRequiredDescriptionDefault
corpNameYesThe name of the corporation
listIdYesThe ID of the list

TDQS

B3.1/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations provided; description only states 'Get details' with no mention of read-only nature, error handling, or permissions. Does not add behavioral context beyond input schema.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, no filler. Efficient but minimal.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

No output schema or annotations; description is too sparse for a tool that returns details. Does not hint at return structure or result format.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the description adds no additional meaning beyond what the parameter descriptions already provide. Baseline of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description specifies 'Get details of a specific list in a corporation', which is a clear verb+resource combination. It distinguishes itself from siblings like sigsci_get_corp (gets corporation details) and sigsci_list_corp_lists (lists all lists).

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives (e.g., sigsci_list_corp_lists for listing all lists). Lacks any context about prerequisites or conditions.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

sigsci_get_corp_reportC

Get attack overview report for a corporation

ParametersJSON Schema
NameRequiredDescriptionDefault
corpNameYesThe name of the corporation
fromNoPOSIX Unix timestamp to start
untilNoPOSIX Unix timestamp to end

TDQS

C2.9/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description must disclose all behavioral traits. It only says 'get', implying a read operation, but nothing about permissions, output format, or side effects. The agent cannot infer what the report includes or how to handle the response.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence that efficiently conveys the core purpose. It is front-loaded with the verb 'Get'. While brief, it avoids unnecessary words, though slightly more detail could improve usability without harming conciseness.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a tool with 3 parameters and no output schema, the description is incomplete. It fails to specify the report's content, default time ranges, or response structure, leaving the agent without critical context to use the tool correctly.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

All three parameters have descriptions in the schema (100% coverage), so the baseline is 3. The description adds no additional meaning beyond the schema; it does not explain how from/until affect the report or what corpName represents.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool retrieves an attack overview report for a corporation, which is a specific resource. However, it does not differentiate itself from sibling tools like sigsci_list_top_attacks, which may also relate to attacks.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus alternatives. The description lacks context about prerequisites, use cases, or exclusions, leaving the agent to guess its role among many similar get/list tools.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

sigsci_get_corp_ruleB

Get details of a specific rule in a corporation

ParametersJSON Schema
NameRequiredDescriptionDefault
corpNameYesThe name of the corporation
ruleIdYesThe ID of the rule

TDQS

B3.3/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The description implies a read-only operation ('Get details'), but does not explicitly state side effects, permissions, or idempotency. With no annotations, the description provides minimal behavioral context.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, concise sentence with no unnecessary words. It is immediately understandable.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple get tool with two documented parameters, the description is adequate but lacks mention of return value structure or output format. It meets minimum viability but could add more context.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so the description adds no additional meaning beyond the parameter names and descriptions. The description does not elaborate on how to use the parameters.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states 'Get details of a specific rule in a corporation', specifying the verb (Get) and resource (rule). It differentiates from list_corp_rules by indicating a single rule, but does not explicitly distinguish from sigsci_get_site_rule.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus alternatives like sigsci_get_site_rule or sigsci_list_corp_rules. There is no mention of prerequisites or workflow.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

sigsci_get_corp_tagB

Get details of a specific signal tag in a corporation

ParametersJSON Schema
NameRequiredDescriptionDefault
corpNameYesThe name of the corporation
tagNameYesThe name of the signal tag

TDQS

B3.3/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations provided; description only says 'Get details', implying a safe read operation. No disclosure of authorization needs, rate limits, or response format. Minimal behavioral context.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, to the point, no extraneous information. Front-loaded with verb and resource, efficiently communicates purpose.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Simple tool with 2 params and no output schema. Description is adequate but could be improved by mentioning typical response fields (e.g., tag details). Complete enough for a read operation.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema has 100% coverage with descriptions for both parameters. Description adds no additional meaning beyond the schema, so baseline score applies.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states verb 'Get details' and resource 'specific signal tag in a corporation'. Name and context differentiate from siblings like sigsci_list_corp_tags (list) and sigsci_get_site_tag (site scope), but no explicit differentiation in description.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Usage is implied from name and description: use to retrieve a single tag by corpName and tagName. No explicit when-to-use or alternatives given, but minimal guidance is intrinsic.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

sigsci_get_corp_userB

Get details of a specific user in a corporation

ParametersJSON Schema
NameRequiredDescriptionDefault
corpNameYesThe name of the corporation
emailYesThe email address of the user

TDQS

B3.3/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description must convey behavioral traits. It indicates a read operation ('Get details') but omits critical information: no mention of permissions, side effects, or response structure. This is insufficient for a low-complexity tool.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, highly efficient sentence with no redundant or irrelevant content. It communicates the core purpose clearly and concisely.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The description is adequate for the tool's low complexity (2 parameters, no output schema), but it lacks detail on the response format and any behavioral guarantees. Some completeness is missing, especially given the absence of annotations.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema has 100% coverage with clear parameter descriptions. The tool description adds no additional meaning beyond the schema, so it meets the baseline for high coverage without exceeding it.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description 'Get details of a specific user in a corporation' clearly identifies the action (get), resource (specific user), and scope (in a corporation). It effectively distinguishes from sibling tools like sigsci_list_corp_users by focusing on a single user retrieval.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus alternatives such as sigsci_list_corp_users for listing all users. The description lacks explicit usage context or exclusions, leaving the agent without direction for selection.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

sigsci_get_eventC

Get details of a specific event

ParametersJSON Schema
NameRequiredDescriptionDefault
corpNameYesThe name of the corporation
siteNameYesThe name of the site
eventIdYesThe ID of the event

TDQS

C2.4/5.0
Behavior1/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, and the description does not disclose any behavioral traits (e.g., read-only, authentication needs, rate limits, or side effects). The agent has no insight beyond the function's basic purpose.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is extremely concise (5 words) and front-loaded. For a simple retrieval tool, this brevity is acceptable, though it could be slightly more informative without being wasteful.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given no output schema and no annotations, the description fails to explain what 'details' are returned or any additional context about the event scope. The tool's behavior is underspecified for a 3-parameter action.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so baseline is 3. The description adds no additional meaning beyond the schema's parameter descriptions, which are self-explanatory identifiers.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose3/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description 'Get details of a specific event' indicates the action (get) and resource (event details), but it is vague and does not distinguish from many sibling 'get_*' tools like sigsci_get_request or sigsci_get_alert.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus alternatives like sigsci_list_events or other get_* tools. The description lacks context for usage decisions.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

sigsci_get_requestA

Get details of a specific request by ID

ParametersJSON Schema
NameRequiredDescriptionDefault
corpNameYesThe name of the corporation
siteNameYesThe name of the site
requestIdYesThe ID of the request

TDQS

A3.5/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations provided; description says 'Get' which implies read-only. No additional behavioral traits disclosed (e.g., permissions, idempotency). Adequate for a simple read operation.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single, clear sentence with no wasted words. Front-loaded with essential information.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple getter with 3 parameters, the description is adequate but lacks details about the return value (the request details). Without output schema, more context would be beneficial.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% (all parameters have descriptions). Description adds no extra meaning beyond what schema already provides.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states 'Get details of a specific request by ID', specifying a single request retrieval. Distinguishes from sibling search_requests (which searches) and other get tools (different resources).

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives like sigsci_search_requests. Implies use when you have a request ID, but no explicit context.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

sigsci_get_request_feedC

Get request feed for a site within a time range

ParametersJSON Schema
NameRequiredDescriptionDefault
corpNameYesThe name of the corporation
siteNameYesThe name of the site
fromYesPOSIX Unix timestamp to start (must be within 168 hours, on minute boundary)
untilYesPOSIX Unix timestamp to end (must be 5+ minutes ago, on minute boundary)
tagsNoComma-separated list of tags to filter by

TDQS

C2.9/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries the full burden for behavioral transparency. It does not mention safety, destructive potential, rate limits, or response characteristics beyond the basic 'get' action.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence front-loaded with the verb and resource. It contains no unnecessary words and is appropriately concise.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the absence of an output schema, the description should provide hints about the return format or what a 'request feed' entails. It does not, leaving the agent unclear about what to expect.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so the schema already documents all parameters. The description adds minimal extra value by vaguely referencing a time range, but does not enhance understanding of individual parameters.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action 'Get' and resource 'request feed' with a time range constraint. However, it does not differentiate from similar tools like 'sigsci_get_request' or 'sigsci_search_requests', which could cause confusion.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus alternatives such as 'sigsci_get_request' or 'sigsci_search_requests'. The description lacks context for appropriate usage.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

sigsci_get_siteA

Get details of a specific site

ParametersJSON Schema
NameRequiredDescriptionDefault
corpNameYesThe name of the corporation
siteNameYesThe name of the site

TDQS

A3.8/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations provided, the description carries the full burden. It states 'get details' without specifying side effects, permissions, or behavior like error handling. For a simple read operation, this is adequate but could be more informative.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, concise sentence without any extraneous information. Every word is necessary.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple get tool with required parameters and no output schema, the description is largely complete. It could mention behavior when the site is not found, but it is sufficient for selecting and invoking the tool.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Both parameters have descriptions in the schema (100% coverage), so the description adds no additional meaning. The baseline is 3, and the description does not exceed that.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description 'Get details of a specific site' uses a clear verb (get) and resource (site), and implies it targets one specific site. This distinguishes it from sibling list tools like sigsci_list_sites and other get tools that retrieve different entities.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description does not explicitly state when to use this tool over alternatives. It implicitly conveys it is for a single site by the parameter requirements, but no direct comparison to list or other get tools is provided.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

sigsci_get_site_listB

Get details of a specific list in a site

ParametersJSON Schema
NameRequiredDescriptionDefault
corpNameYesThe name of the corporation
siteNameYesThe name of the site
listIdYesThe ID of the list

TDQS

B3.2/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries full burden for behavioral disclosure. It does not state whether the operation is read-only, requires specific authentication, or has rate limits. The lack of any behavioral traits reduces transparency.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single concise sentence with no redundancy. It is front-loaded with the verb and resource, though it could be slightly more informative without losing conciseness.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a 3-required-parameter tool with no output schema or annotations, the description is minimal. It does not explain return values or side effects, but the purpose is clear. Adequate but not complete.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with parameter descriptions in the schema. The description adds 'specific list' context but does not enhance meaning beyond the schema's parameter descriptions. Baseline score of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action ('Get details') and the resource ('a specific list in a site'). It distinguishes from sibling tools like `sigsci_list_site_lists` by implying retrieval of a single list's details rather than listing all lists.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No when-to-use or when-not-to-use guidance is provided. It does not mention alternatives such as `sigsci_list_site_lists` for listing all lists, leaving the agent to infer usage without explicit context.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

sigsci_get_site_memberA

Get details of a specific site member

ParametersJSON Schema
NameRequiredDescriptionDefault
corpNameYesThe name of the corporation
siteNameYesThe name of the site
emailYesThe email address of the member

TDQS

A3.5/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries the full burden. It does not disclose any behavioral traits such as read-only nature, authentication needs, or error handling. The description only states the purpose.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence of 8 words, efficiently conveying the core purpose without any wasted words or padding.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple retrieval tool with no output schema, the description is minimally adequate. However, it could provide more context about what 'details' are returned, but given the rule that if no output schema exists the description needn't explain return values, this is borderline.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the baseline is 3. The description adds no additional meaning beyond what the schema already provides for the three required parameters.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action ('Get details') and the resource ('a specific site member'). It implicitly distinguishes from the sibling tool 'sigsci_list_site_members' which lists all members.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit guidance on when to use this tool versus alternatives. Usage is implied by the purpose but no when-not or exclusion criteria are provided.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

sigsci_get_site_ruleA

Get details of a specific rule in a site

ParametersJSON Schema
NameRequiredDescriptionDefault
corpNameYesThe name of the corporation
siteNameYesThe name of the site
ruleIdYesThe ID of the rule

TDQS

A3.5/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations provided; description only says 'Get' suggesting read-only, but doesn't disclose any behavioral traits like required permissions, rate limits, or side effects. The description carries the full burden in absence of annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, front-loaded with key action and resource. No unnecessary words, concise and efficient.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Tool is simple with 3 required params and no output schema. Description is minimal but adequate for a straightforward get operation. Lacks details on response structure or any special behaviors.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema has 100% description coverage for all three parameters (corpName, siteName, ruleId). The description adds no additional meaning beyond what the schema already provides, so baseline of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'Get details' and the resource 'a specific rule in a site'. It distinguishes itself from siblings like sigsci_get_site (site details) and sigsci_list_site_rules (list all rules).

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit guidance on when to use this tool versus alternatives. It implies single-rule retrieval by ruleId, but no mention of when to use list vs get, or any prerequisites.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

sigsci_get_site_tagA

Get details of a specific signal tag in a site

ParametersJSON Schema
NameRequiredDescriptionDefault
corpNameYesThe name of the corporation
siteNameYesThe name of the site
tagNameYesThe name of the signal tag

TDQS

A3.5/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description must carry the full burden. It only states 'Get details' which implies a read operation, but does not disclose any behavioral traits such as authorization requirements, error handling, or side effects.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, short sentence (10 words) that front-loads the purpose. Every word is necessary and there is no redundancy or fluff.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the simple nature of a 'get' operation with three string parameters and no output schema, the description is adequate but minimal. It does not mention return value format, possible error conditions, or usage context beyond the basic purpose.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

All three parameters are fully described in the schema with clear names and descriptions. The tool description adds no additional meaning beyond what the schema already provides. With 100% schema coverage, the baseline of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action ('Get details'), the resource ('specific signal tag'), and the scope ('in a site'). It distinguishes from sibling tools like sigsci_list_site_tags (which lists all tags) and other 'get' tools for different resources.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage for fetching a single tag's details, but does not explicitly state when to use it versus alternatives like list tools. No exclusions or context for choosing this tool over siblings are provided.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

sigsci_get_templateC

Get details of a specific rule template

ParametersJSON Schema
NameRequiredDescriptionDefault
corpNameYesThe name of the corporation
siteNameYesThe name of the site
templateIdYesThe ID of the template (e.g., CVE-2025-55182)

TDQS

C2.7/5.0
Behavior1/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries full burden. It only states 'Get details of a specific rule template' without mentioning any behavioral traits like idempotency, permissions, error conditions, or side effects. Completely insufficient.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, no waste. However, no structure or front-loading of key info beyond the bare minimum. Slightly under-specified but concise.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple 'get' tool with 3 required parameters and no output schema, the description is minimal but lacks any return value info or usage hints. Given no annotations, it leaves gaps for an AI agent.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100% (all parameters have descriptions). The description adds no extra meaning beyond what the schema already provides. Baseline 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description 'Get details of a specific rule template' clearly states the verb (Get) and resource (rule template). It distinguishes from siblings like 'sigsci_list_templates' and 'sigsci_get_configured_template' by focusing on 'template' without 'configured', though it doesn't explicitly differentiate.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus siblings like 'sigsci_list_templates' or 'sigsci_get_configured_template'. No context, exclusions, or alternative suggestions provided.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

sigsci_get_timeseriesB

Get timeseries request data for a site

ParametersJSON Schema
NameRequiredDescriptionDefault
corpNameYesThe name of the corporation
siteNameYesThe name of the site
fromNoPOSIX Unix timestamp to start
untilNoPOSIX Unix timestamp to end
tagNoFilter by tag
rollupNoRollup interval in seconds

TDQS

B3.1/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries the full burden of behavioral disclosure. It only states the action and resource, omitting critical details like whether the operation is read-only, permission requirements, data format (aggregated time buckets), or pagination.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single concise sentence with no redundant information. However, for a tool with 6 parameters and no annotations, it may be overly brief; a slightly expanded description could improve completeness without sacrificing conciseness.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the absence of an output schema and annotations, the description leaves significant gaps. It does not explain what the returned timeseries data represents, how to interpret results, or any constraints (e.g., maximum time range). The agent lacks essential context for correct usage.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema provides full coverage (100%) for all 6 parameters, so the description adds minimal extra meaning. The phrase 'timeseries request data' implicitly relates to the time-range and rollup parameters, but does not clarify their usage beyond the schema's descriptions.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states the specific action (get) and resource (timeseries request data) with a clear scope (for a site). It effectively distinguishes from sibling tools that retrieve other entities like agents, alerts, or individual requests.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus alternatives such as sigsci_get_request or sigsci_search_requests. The agent receives no hints about appropriate contexts (e.g., aggregating data over time) or exclusions.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

sigsci_get_whitelistB

Get whitelist for a site

ParametersJSON Schema
NameRequiredDescriptionDefault
corpNameYesThe name of the corporation
siteNameYesThe name of the site

TDQS

B3.1/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The description implies a read-only operation ('get'), which is non-destructive. However, it does not disclose any potential side effects, authorization requirements, or return format. With no annotations, the description provides minimal behavioral insight.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is extremely concise (5 words) and front-loaded with the core purpose. It wastes no words, though could benefit from a brief elaboration on what a whitelist is.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the simple input schema (2 params) and no output schema, the description should clarify what the tool returns (e.g., list or single whitelist). It does not, leaving the agent uncertain about the response structure.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema covers 100% of parameters (corpName, siteName) with descriptions. The tool description adds no extra meaning beyond the schema, so it meets the baseline but does not enhance understanding.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description 'Get whitelist for a site' clearly states the action (get) and resource (whitelist), with site as the scope. It distinguishes from sibling tools like sigsci_get_blacklist, but does not explicitly differentiate from other similar get tools.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus alternatives like sigsci_get_blacklist or sigsci_list_sites. There is no mention of prerequisites or context for invocation.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

sigsci_list_agentsB

List all agents for a site

ParametersJSON Schema
NameRequiredDescriptionDefault
corpNameYesThe name of the corporation
siteNameYesThe name of the site

TDQS

B3/5.0
Behavior1/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description should disclose behavioral traits but only says 'List all agents for a site', omitting pagination, authentication, or data scope details.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

A single concise sentence that is front-loaded and contains no superfluous words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a list tool with no output schema, the description is too minimal; it doesn't mention return value structure, filtering, or important behavioral context.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with clear parameter descriptions. The tool description adds no additional meaning, achieving baseline score.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'list' and resource 'agents' with scope 'for a site', distinguishing it from sibling 'sigsci_get_agent' which likely retrieves a single agent.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives (e.g., sigsci_get_agent for specific agents) or any conditions for usage.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

sigsci_list_alertsC

List all alerts for a site

ParametersJSON Schema
NameRequiredDescriptionDefault
corpNameYesThe name of the corporation
siteNameYesThe name of the site

TDQS

C2.9/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are present, so the description bears full responsibility. It states 'list all alerts,' implying a read-only operation, but provides no details about pagination, rate limits, authentication requirements, or error behavior. The lack of any behavioral disclosure beyond the basic operation leaves the agent uninformed about important constraints.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, concise sentence that directly states the tool's purpose. It is front-loaded with the key action and resource. However, it could include more useful information without becoming verbose. It earns its place but could be more informative.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the lack of an output schema and the presence of many sibling tools, the description is too minimal. It does not explain what an alert is, the format of the returned data, or mention pagination or limitations. The tool is part of a complex domain, and the description fails to provide enough context for an agent to use it correctly without external knowledge.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema has 100% coverage with descriptions for both parameters (corpName, siteName). The description adds no additional meaning beyond the schema, which already explains what these parameters are. With full schema coverage, a baseline of 3 is appropriate, as the description does not enhance understanding of parameters.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description 'List all alerts for a site' clearly states the verb (list) and resource (alerts) with a scope (for a site). However, it does not distinguish itself from many sibling list tools that also operate on a site, such as sigsci_list_events or sigsci_list_site_rules. The purpose is clear but not uniquely positioned among similar tools.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus alternatives. There are many sibling list tools, but the description does not mention when 'list alerts' is appropriate compared to 'get_alert' or other list tools. No when-to-use, when-not-to-use, or alternative suggestions.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

sigsci_list_cloudwaf_certsA

List all CloudWAF certificates in a corporation

ParametersJSON Schema
NameRequiredDescriptionDefault
corpNameYesThe name of the corporation

TDQS

A3.8/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description must cover behavioral traits. It correctly indicates a read operation but omits details like response format, pagination, or authentication needs. For a simple list operation, this is adequate but not comprehensive.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, clear sentence with no unnecessary words. It is highly concise and front-loaded with the core action.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's simplicity (1 parameter, list operation), the description is nearly complete. It lacks mention of the return type or structure, but the context of sibling tools provides a pattern. It could benefit from noting that it returns a list of certificates.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, and the parameter description already states it is the corporation name. The tool description adds no additional meaning beyond the schema, so baseline of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states the verb 'List', the resource 'CloudWAF certificates', and the scope 'in a corporation'. It clearly distinguishes from the sibling tool 'sigsci_list_cloudwaf_instances' which lists a different resource.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies the tool is for listing certificates, but provides no explicit guidance on when to use it versus other list tools or alternatives. No prerequisites or exclusions are mentioned.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

sigsci_list_cloudwaf_instancesC

List all CloudWAF instances in a corporation

ParametersJSON Schema
NameRequiredDescriptionDefault
corpNameYesThe name of the corporation

TDQS

C2.8/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Without annotations, the description carries the full burden of disclosing behavioral traits. It only states 'list all', which implies a read operation, but does not specify if results are paginated, ordered, or what data is returned. No details on rate limits, destructive potential, or idempotency.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness3/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence, very concise, but it lacks essential details. While brevity is valued, the tool's purpose and context are under-specified. Better structure could include key behavioral hints upfront.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given no output schema and a single parameter, the description should explain the return format or typical use case. Currently, it does not specify what 'CloudWAF instances' are returned (e.g., names, IDs, status). This undermines completeness for an agent selecting the tool.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% (corpName described in schema). The description adds no additional meaning beyond the schema's parameter description. Baseline 3 is appropriate as it neither contradicts nor enriches the schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action (list) and resource (CloudWAF instances) with scope (in a corporation). It effectively distinguishes from siblings like 'list_agents' or 'list_sites' by specifying the unique resource type. However, it could be more precise about what constitutes a CloudWAF instance.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No usage guidelines are provided. The description lacks any indication of when to use this tool versus alternatives, prerequisites, or context. For example, it doesn't mention if the user needs specific permissions or how to find the corpName.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

sigsci_list_configured_templatesB

List configured templated rules for a site

ParametersJSON Schema
NameRequiredDescriptionDefault
corpNameYesThe name of the corporation
siteNameYesThe name of the site

TDQS

B3.3/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries the full burden of behavioral disclosure. It fails to state whether the tool is read-only, what it returns, or any side effects. For a listing tool, these details are typically expected.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single concise sentence with no unnecessary words. It is efficiently front-loaded with the key action and resource.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the simplicity of the tool (2 required params, no output schema, no nested objects), the description is minimally adequate. However, it lacks context about what 'configured templated rules' are, pagination, or how results are ordered. It does not fully compensate for the lack of annotations.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema has 100% description coverage for both parameters (corpName, siteName). The description adds no additional meaning beyond the schema, which already describes the parameters. Baseline score of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description 'List configured templated rules for a site' clearly specifies the verb (list) and the resource (configured templated rules). It distinguishes from sibling tools like sigsci_list_templates, which lists available templates, while this lists configured ones for a site.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No usage guidance is provided. The description does not indicate when to use this tool versus alternatives such as sigsci_get_configured_template or sigsci_list_templates, nor does it mention prerequisites or context.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

sigsci_list_corp_activityB

List activity events for a corporation

ParametersJSON Schema
NameRequiredDescriptionDefault
corpNameYesThe name of the corporation
limitNoNumber of entries per page
pageNoPage number

TDQS

B3.1/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, and the description does not disclose any behavioral traits such as pagination behavior, sorting order, or authentication requirements beyond what is in the input schema.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single concise sentence with no wasted words. However, it lacks structure or additional context that might help the agent.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the lack of output schema and annotations, the description is too minimal. It does not explain what 'activity events' are, how results are ordered, or how this differs from sigsci_list_site_activity.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so the baseline is 3. The description does not add any additional meaning beyond the schema descriptions for the parameters.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description 'List activity events for a corporation' uses a specific verb and resource, clearly distinguishing this tool from siblings like sigsci_list_corp_rules or sigsci_list_corp_users.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is given on when to use this tool versus alternatives. With many sibling list tools, the absence of when-to-use advice is a notable gap.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

sigsci_list_corp_integrationsB

List all integrations in a corporation

ParametersJSON Schema
NameRequiredDescriptionDefault
corpNameYesThe name of the corporation

TDQS

B3.4/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are present, so the description carries the full burden. It implies a read-only operation by listing integrations, but does not disclose any additional behavioral traits such as pagination, required permissions, or response format. For a simple list, this is minimally adequate.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence that is front-loaded and contains no extraneous information. Every word contributes to the purpose, making it highly concise and efficient.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's simplicity (one required parameter, no output schema, no nested objects) and the absence of annotations, the description provides sufficient information for an agent to understand the basic operation. However, it could be improved by noting that the result is a list of integration objects.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The parameter 'corpName' is fully described in the schema (100% coverage), so the description adds no extra meaning. The description does not elaborate on the parameter beyond what the schema already provides, resulting in a baseline score of 3.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'List' and the resource 'integrations' scoped to 'a corporation'. It effectively communicates the tool's purpose, though it does not explicitly distinguish it from the sibling 'sigsci_get_corp_integration' which retrieves a single integration.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus alternatives like sigsci_get_corp_integration for a specific integration. The agent is left to infer usage without any comparative context.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

sigsci_list_corp_listsB

List all lists in a corporation

ParametersJSON Schema
NameRequiredDescriptionDefault
corpNameYesThe name of the corporation

TDQS

B3.1/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are present, and the description is minimal. It does not disclose any behavioral traits such as read-only nature, permissions needed, or what 'lists' entails. The agent cannot infer safety or side effects.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single concise sentence with no extraneous information, earning its place.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple list tool with one required parameter and no output schema, the description is minimally adequate. However, it could be improved by clarifying the nature of 'lists' to help distinguish from similar tools.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The schema coverage is 100% and already describes the 'corpName' parameter. The description adds no additional meaning beyond the schema, so it meets the baseline of 3.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'List' and the resource 'all lists in a corporation'. However, among siblings like sigsci_list_corp_tags and sigsci_list_corp_rules, it does not differentiate what 'lists' specifically refers to (e.g., custom lists, IP lists).

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus alternatives. The description does not mention context, exclusions, or comparisons to sibling tools.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

sigsci_list_corp_rulesA

List all rules in a corporation

ParametersJSON Schema
NameRequiredDescriptionDefault
corpNameYesThe name of the corporation
typeNoThe type of rule to filter by
pageNoPage number
limitNoNumber of entries per page (default: 100, max: 1000)

TDQS

A3.5/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description must fully disclose behavior. It states the tool lists rules (read operation) but does not reveal that pagination parameters (page, limit) are available, nor does it mention the type filter. Lacks details on whether the operation is read-only, destructive, or requires specific permissions.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence that efficiently conveys the core function. No extraneous words or redundant information. Perfectly concise for the task.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

No output schema exists, so the description should hint at return format (e.g., array of rules). It does not. With 4 parameters, a simple list operation, the description is functional but lacks completeness about pagination or filtering behavior. Adequate but not thorough.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, and parameter descriptions are present in the schema. The description does not add additional meaning beyond 'list all rules in a corporation'. It does not explain how parameters like type, page, or limit affect the result. Baseline 3 is appropriate since schema handles parameter documentation.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description 'List all rules in a corporation' clearly states the verb (list), resource (rules), and scope (corporation). It distinguishes this tool from siblings like sigsci_list_site_rules (site-level) and sigsci_get_corp_rule (single rule), making purpose unambiguous.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage for listing corporation-level rules but does not explicitly state when to use this tool versus alternatives like sigsci_list_site_rules or sigsci_get_corp_rule. No when-not-to-use guidance or prerequisite conditions are provided.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

sigsci_list_corpsA

List all corporations accessible to the authenticated user

ParametersJSON Schema
NameRequiredDescriptionDefault

No parameters

TDQS

A4.3/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations provided; description is basic but adequate. It indicates a read-only list operation with no destructive behavior. Could mention it returns a list of corporation objects, but not required.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, no wasted words. Front-loads the key purpose: 'List all corporations accessible to the authenticated user'.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple list tool with zero parameters and no output schema, the description is nearly complete. Could mention that the result is a list or array, but current description is sufficient for an agent to infer.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters5/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

No parameters in schema, so description correctly provides no further detail. Schema coverage is 100%, and description adds no ambiguity.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states verb 'list' and resource 'corporations' with scope 'accessible to the authenticated user'. Distinguishes from sibling 'sigsci_get_corp' which presumably retrieves a single corporation.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Description implies use for retrieving all accessible corporations, and siblings like 'sigsci_get_corp' are for specific ones. However, no explicit when-not or alternative mention.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

sigsci_list_corp_tagsA

List all signal tags in a corporation

ParametersJSON Schema
NameRequiredDescriptionDefault
corpNameYesThe name of the corporation

TDQS

A3.5/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries full burden for behavioral disclosure. It only states the action (list) without mentioning that it's read-only, safe, or any permission/auth requirements.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

One sentence, no wasted words. Perfectly concise for a simple list operation.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The description covers the basic purpose and parameter, but lacks details on pagination, ordering, or result limits that would be helpful for a list endpoint. Given no output schema, additional context would improve completeness.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so the description adds no extra meaning. The parameter 'corpName' is already documented in the schema as 'The name of the corporation', matching the description's usage.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'List' and the resource 'signal tags in a corporation', distinguishing it from sibling tools like sigsci_get_corp_tag (single tag) and sigsci_list_site_tags (site-level tags).

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit when-to-use or when-not-to-use guidance. The description implies listing all tags for a corporation but doesn't contrast with alternatives like sigsci_get_corp_tag for specific tags or sigsci_list_site_tags for site-level tags.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

sigsci_list_corp_usersB

List all users in a corporation

ParametersJSON Schema
NameRequiredDescriptionDefault
corpNameYesThe name of the corporation
expandNoExpand hidden properties for nested objects

TDQS

B3.2/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries the full burden. It only says 'List', which implies a read-only operation, but does not disclose pagination, error handling, rate limits, or authentication needs. For a tool with no annotations, this is insufficient.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single clear sentence with no waste. It is front-loaded and directly states the purpose. However, it is very brief and could include more useful context without becoming verbose.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple list tool, the description is minimal. It does not explain the return format or any constraints. Given the absence of an output schema and the large number of sibling tools, more context would be beneficial, but the current description is minimally adequate.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%. Both parameters have descriptions in the schema. The tool description adds no additional meaning beyond what the schema already provides, so a baseline score of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb (list), resource (users), and scope (in a corporation). It distinguishes from sibling tools like sigsci_get_corp_user which retrieves a single user, and other list tools that target different resources.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides no guidance on when to use this tool versus alternatives such as other list tools or the single-user retrieval tool. It does not specify any prerequisites or exclusions.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

sigsci_list_eventsC

List events for a site

ParametersJSON Schema
NameRequiredDescriptionDefault
corpNameYesThe name of the corporation
siteNameYesThe name of the site
fromNoPOSIX Unix timestamp to start
untilNoPOSIX Unix timestamp to end
sortNoSort order
limitNoNumber of entries per page
pageNoPage number
tagNoFilter by tag
statusNoFilter by status

TDQS

C2.4/5.0
Behavior1/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries the full burden of behavioral disclosure, but it only states 'List events for a site' with no mention of side effects, authentication requirements, rate limits, pagination behavior, or return format. This is completely opaque.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness2/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is extremely concise (4 words), but it is under-specified. It lacks critical details that would make it useful, so the brevity sacrifices informativeness.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness1/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's complexity (9 parameters, no output schema, no annotations), the description is woefully incomplete. It fails to explain what events are, how pagination works, the behavior of timestamps, or any other contextual information needed for proper use.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema has 100% description coverage, with each parameter clearly documented (e.g., corpName, siteName, from, until, sort, etc.). The description adds no additional meaning beyond the schema, so a baseline score of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'list' and the resource 'events for a site', making the basic purpose understandable. However, it does not distinguish this tool from similar siblings like sigsci_list_alerts or sigsci_list_agents, which also list resources for a site.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus alternatives, nor are there any exclusions or prerequisites. The agent receives no help in choosing between this and other list tools.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

sigsci_list_rate_limited_ipsB

List rate-limited IPs for a site

ParametersJSON Schema
NameRequiredDescriptionDefault
corpNameYesThe name of the corporation
siteNameYesThe name of the site
limitNoNumber of entries to return

TDQS

B3.1/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description must carry the burden of behavioral disclosure. The description only states the action (list) without any information on side effects, read-only nature, pagination, rate limits, or authentication requirements. This is inadequate for a tool with no annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence with no unnecessary words. It is front-loaded and concise. However, it may be too brief to convey essential context, but for conciseness alone it scores well.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple list tool with no output schema and no annotations, the description omits important context such as what fields are returned, pagination behavior, or whether it lists all rate-limited IPs globally or for a specific scope. The tool's complexity is low, but the description still lacks completeness for a new user.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% for the three parameters (corpName, siteName, limit). The description adds no meaning beyond the schema, so baseline 3 is appropriate. No additional semantic value provided.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description uses a specific verb-resource pair ('List rate-limited IPs for a site'), clearly identifying the action and resource. It distinguishes from sibling tools like sigsci_list_suspicious_ips (different IP type) and sigsci_list_agents (different resource).

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives (e.g., sigsci_list_suspicious_ips or other list tools). No mention of prerequisites, use cases, or exclusions. The description provides no context for selection among siblings.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

sigsci_list_site_activityB

List activity events for a site

ParametersJSON Schema
NameRequiredDescriptionDefault
corpNameYesThe name of the corporation
siteNameYesThe name of the site
fromNoPOSIX Unix timestamp to start
untilNoPOSIX Unix timestamp to end
sortNoSort order (default: desc)
limitNoNumber of entries per page (default: 100, max: 1000)
pageNoPage number
eventsNoFilter on events
eventTypeNoFilter on event type

TDQS

B3.1/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries full burden for behavioral disclosure. It only states core function with no details on pagination, rate limits, authentication needs, or data scope (e.g., whether it returns all activity or has date bounds).

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, clear sentence with no redundant words. However, it is extremely brief and could be expanded without losing conciseness.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given 9 parameters, no output schema, and no annotations, the description lacks context about the response structure, pagination behavior, and event types. It does not compensate for the missing structured metadata.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

All 9 parameters have descriptions in the input schema (100% coverage). The description adds no additional meaning beyond the schema, so a baseline score of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description 'List activity events for a site' uses a specific verb ('list') and resource ('activity events for a site'), clearly distinguishing it from siblings like 'sigsci_list_corp_activity' which lists corporation-level activity.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus alternatives, such as when to use 'sigsci_list_events' instead. No context about prerequisites or limitations.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

sigsci_list_site_listsC

List all lists in a site

ParametersJSON Schema
NameRequiredDescriptionDefault
corpNameYesThe name of the corporation
siteNameYesThe name of the site

TDQS

C2.9/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are present, so the description carries full burden. It only states 'list' without disclosing any behavior like pagination, result format, or authorization needs. For a read operation, this is minimal, missing explicit assurance that it is non-destructive.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, front-loaded sentence that conveys the core action. It is efficient but could benefit from slightly more detail without being verbose.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple list tool with two parameters and no output schema, the description is adequate. However, it does not mention the scope (site-level vs corp-level) or any filtering capabilities, making it less complete than it could be.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so the schema already documents both parameters. The description adds no extra meaning beyond what is in the schema, earning the baseline score of 3.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description uses a specific verb ('list') and resource ('lists in a site'), clearly indicating the action and scope. However, it does not explicitly differentiate from sibling tools like 'sigsci_list_corp_lists' beyond the name and parameter context.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus alternatives such as 'sigsci_list_corp_lists' or detail-oriented tools like 'sigsci_get_site_list'. The description lacks context for selection.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

sigsci_list_site_membersB

List all members of a site

ParametersJSON Schema
NameRequiredDescriptionDefault
corpNameYesThe name of the corporation
siteNameYesThe name of the site

TDQS

B3.2/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries the full burden for behavioral traits. It only states that it lists members, but does not disclose pagination, permissions, rate limits, response format, or whether it returns all members for the site or across the corporation.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence with no redundancy or unnecessary words. It is concise and front-loaded.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the lack of output schema and annotations, the description is too brief. It does not specify what constitutes a 'member', the return structure, or any limitations, making it incomplete for an agent to fully understand the tool's behavior.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% as both parameters have descriptions. The tool description adds no extra meaning beyond the schema, so a baseline of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description 'List all members of a site' uses a specific verb 'List' and identifies the resource 'site members'. It clearly distinguishes from the sibling tool 'sigsci_get_site_member' which retrieves a single member.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus alternatives like 'sigsci_get_site_member' or other list tools. The description does not mention prerequisites, context, or when not to use it.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

sigsci_list_site_rulesC

List all rules in a site

ParametersJSON Schema
NameRequiredDescriptionDefault
corpNameYesThe name of the corporation
siteNameYesThe name of the site
typeNoThe type of rule to filter by
pageNoPage number
limitNoNumber of entries per page (default: 100, max: 1000)

TDQS

C2.9/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Without annotations, the description carries the full burden of behavioral disclosure, but it only states the basic function. It does not reveal that the tool supports pagination (via page/limit parameters) or filtering by type, nor any side effects or performance characteristics.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, front-loaded sentence with no superfluous words. It is highly concise and easy to parse.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given 5 parameters and no output schema, the description is too sparse. It omits mention of pagination, filtering, and important contextual details like rate limits or authentication requirements that might affect tool invocation.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema has 100% description coverage, so the description adds no extra meaning beyond what the schema already provides. The baseline is 3, and the description does not enhance parameter understanding.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description 'List all rules in a site' clearly states the verb (List) and resource (rules) within a site. It distinguishes from sibling tools like 'sigsci_get_site_rule' (singular) but does not explicitly differentiate from other list tools such as 'sigsci_list_site_lists'.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus alternatives like 'sigsci_list_site_activity' or 'sigsci_list_site_tags'. The description does not mention prerequisites or context for use.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

sigsci_list_sitesC

List all sites in a corporation

ParametersJSON Schema
NameRequiredDescriptionDefault
corpNameYesThe name of the corporation
nameNoFilter on site name or display name
pageNoPage number (default: 1)
limitNoNumber of entries per page (default: 10)
agentLevelNoFilter on agent mode

TDQS

C2.8/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations exist, so the description carries the full burden. It only declares a list action without revealing pagination behavior (page/limit parameters exist) or any side effects. For a read-only tool, more context about iteration scope or rate limits would be helpful.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness3/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is extremely concise (5 words), but this brevity comes at the cost of completeness. It could be improved by adding a sentence about filtering or pagination without losing conciseness.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given 5 parameters (including pagination and filters) and no output schema, the description is too sparse. It should explain that the tool supports filtering by name, agentLevel, and pagination, and that it requires a corporation. Without this, the agent may misuse the tool.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so the description does not need to add param meaning. The description adds no extra detail beyond the schema, and the schema already explains each parameter. Baseline 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description 'List all sites in a corporation' clearly states the action (list) and resource (sites). However, it does not differentiate from sibling list tools (e.g., sigsci_list_corps lists corporations), making it ambiguous whether this tool lists all sites or all sites in a given corporation.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus its siblings. There are many list tools for different resources (e.g., sigsci_list_site_rules, sigsci_list_events), and the description does not specify the context or prerequisites (e.g., requiring a corporation name).

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

sigsci_list_site_tagsB

List all signal tags in a site

ParametersJSON Schema
NameRequiredDescriptionDefault
corpNameYesThe name of the corporation
siteNameYesThe name of the site

TDQS

B3.3/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations provided, so description must cover behavioral traits. Only states 'list all signal tags' but omits details like pagination, sorting, or whether this is a read-only operation. Lacks disclosure of potential performance considerations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, front-loaded with the core action. No wasted words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given no output schema and no annotations, the description is adequate for a simple list operation but lacks details on return format (e.g., array of tag objects), whether results are paginated, or what constitutes a 'signal tag.' Not fully complete.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with both parameters described. Description adds no additional meaning beyond what schema already provides. Baseline score of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states 'List all signal tags in a site' with a specific verb and resource. Distinguished from sibling 'sigsci_get_site_tag' which retrieves a single tag, and from other list tools.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives like 'sigsci_get_site_tag' or other list tools. Agent must infer usage from name alone.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

sigsci_list_suspicious_ipsB

List suspicious IPs for a site

ParametersJSON Schema
NameRequiredDescriptionDefault
corpNameYesThe name of the corporation
siteNameYesThe name of the site
limitNoNumber of entries to return

TDQS

B3/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations provided, the description must disclose behavioral traits. It only says 'list suspicious IPs' without explaining whether it is read-only (likely), what 'suspicious' means, or any side effects. Minimal transparency.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness3/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Very short and to the point, but at the cost of completeness. It is front-loaded but lacks any detail beyond the core action.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Simple tool, but description omits details like pagination (limit parameter), default values, ordering, or return format. Given no output schema, more context would help agents understand what to expect.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so description does not need to restate parameters. It adds no additional meaning beyond what schema provides, which is acceptable for high coverage.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states the tool lists suspicious IPs for a site, with specific verb 'list' and resource 'suspicious IPs'. It distinguishes from sibling list tools (e.g., list_rate_limited_ips) by targeting a specific resource type.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool vs alternatives. It does not mention typical use cases, prerequisites, or exclusions, such as when to prefer list_suspicious_ips over list_events or list_rate_limited_ips.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

sigsci_list_templatesB

List available rule templates for a site

ParametersJSON Schema
NameRequiredDescriptionDefault
corpNameYesThe name of the corporation
siteNameYesThe name of the site

TDQS

B3.2/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Without annotations, the description carries full burden. It only says 'list available rule templates' with no behavioral details such as pagination, rate limits, output format, or what determines 'availability'. Minimal transparency.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, direct, no unnecessary words. Front-loaded with the verb and key object.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The tool is simple (2 required params, no output schema), but the description lacks information about output (e.g., whether it returns template IDs or names), pagination behavior, or error conditions. More context would be helpful for an AI agent.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the schema already documents the two parameters (corpName, siteName). The description adds no additional meaning beyond implying site scope, which is already clear from the siteName parameter. Baseline score of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states 'list available rule templates for a site', specifying the verb (list), resource (rule templates), and scope (for a site). This distinguishes it from siblings like sigsci_get_template or sigsci_list_configured_templates.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus alternatives. There is no mention of prerequisites, when-not to use, or contrast with similar tools like sigsci_get_template or sigsci_list_configured_templates.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

sigsci_list_tool_categoriesA

List available tool categories and their tools

ParametersJSON Schema
NameRequiredDescriptionDefault
categoryNoFilter to a specific category
detailLevelNoLevel of detail to return for tools (name: only names, description: names and descriptions, full: complete definitions)

TDQS

A3.8/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description must disclose behavioral traits. It states the tool lists categories and their tools, which is appropriate for a read-only list operation. However, it does not mention that the output may vary with parameters or that it is a safe, non-destructive operation beyond what is implied.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, concise sentence that front-loads the purpose. No unnecessary words or redundancy.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's low complexity and lack of output schema, the description is mostly complete. It explains what the tool does, and the parameters cover filtering and detail level. However, it does not describe the return structure or relationship between categories and tools, which might be helpful.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so baseline is 3. The description adds no additional meaning beyond the schema. The parameters (category and detailLevel) are fully described in the input schema with enums and descriptions.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description 'List available tool categories and their tools' clearly states the action (list), resource (tool categories and their tools), and scope. It distinguishes this tool from sibling tools like sigsci_get_corp or sigsci_list_sites by focusing specifically on tool categories.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage for listing tool categories, but provides no explicit guidance on when to use this tool versus alternatives, such as sigsci_search_tools or other list tools. No when-not or prerequisite information is given.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

sigsci_list_top_attacksC

List top attacks for a site

ParametersJSON Schema
NameRequiredDescriptionDefault
corpNameYesThe name of the corporation
siteNameYesThe name of the site
fromNoPOSIX Unix timestamp to start
untilNoPOSIX Unix timestamp to end
tagNoFilter by tag
limitNoNumber of entries to return

TDQS

C2.9/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations provided, the description carries the full burden of disclosing behavior. It only states 'list' without indicating read-only nature, side effects, or response structure, which is insufficient.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, short sentence with no wasted words. It is concise but could be more informative without becoming verbose.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a tool with 6 parameters (2 required) and no output schema or annotations, the description is too minimal. It fails to explain output format, 'top' criteria, or behavioral context, leaving significant gaps.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so the baseline is 3. The description adds no extra meaning beyond the schema's defined parameters, only repeating the tool's purpose.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool lists top attacks for a site, using a specific verb and resource. However, it does not define what 'top' means (e.g., by count or severity), which slightly reduces clarity.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus alternative list tools like sigsci_list_events or sigsci_list_site_rules. The description lacks context for decision-making.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

sigsci_search_requestsC

Search requests for a site with optional query filters

ParametersJSON Schema
NameRequiredDescriptionDefault
corpNameYesThe name of the corporation
siteNameYesThe name of the site
qNoSearch query using SigSci search syntax
pageNoPage number (max 10,000 requests total)
limitNoNumber of entries per page (default: 100, max: 1000)

TDQS

C2.9/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations provided, and the description only mentions optional query filters. It does not disclose pagination behavior, result limits, or what happens when no query is given. The schema provides some details (page, limit) but the description adds no behavioral insight.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

A single sentence that is front-loaded and efficient. However, it is very sparse for a 5-parameter tool; slightly more detail could improve utility without losing conciseness.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The description is too minimal given the tool's complexity (5 parameters, no output schema, no annotations). It omits important context like query syntax, pagination, and result format, leaving agents underinformed.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

All 5 parameters have descriptions in the schema (100% coverage), so the description adds minimal value by stating 'optional query filters'. The baseline is 3; the description does not enhance parameter understanding beyond the schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool searches requests for a site with optional query filters, distinguishing it from get/list tools by emphasizing the search capability. However, it does not explicitly differentiate from the sibling sigsci_search_tools, which searches tools.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives like sigsci_get_request or sigsci_list_events. The description lacks context for appropriate usage.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

sigsci_search_toolsA

Search for available tools by keyword

ParametersJSON Schema
NameRequiredDescriptionDefault
keywordYesKeyword to search for in tool names and descriptions
detailLevelNoLevel of detail to return (name: only names, description: names and descriptions, full: complete definitions)

TDQS

A3.5/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries the full burden. It only says 'Search', implying read-only, but does not explicitly state that it is non-destructive or disclose any limits, authorization needs, or side effects.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, front-loaded sentence with zero wasted words. It efficiently conveys the core purpose.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The description adequately covers the basic operation, but it does not mention what the output looks like or that it returns a list of available tools. With no output schema, a bit more context would be helpful.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with clear descriptions for both parameters. The tool description adds no extra meaning beyond what the schema already provides, so baseline score of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'Search' and the resource 'available tools', distinguishing it from sibling tools that get or list specific entities. The purpose is unambiguous.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit guidance on when to use this tool versus alternatives. However, the context of sibling tools (all get/list for specific resources) implies this is for finding tools by keyword. No when-not or alternative names provided.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Tool Schema Changelog

Recent tool additions, removals, and schema changes observed during successful MCP inspections.

  1. 48 tool updatesv1.0.0
    • First observedsigsci_get_agent
    • First observedsigsci_get_alert
    • First observedsigsci_get_blacklist
    • First observedsigsci_get_configured_template
    • First observedsigsci_get_corp
    • First observedsigsci_get_corp_integration
    • First observedsigsci_get_corp_list
    • First observedsigsci_get_corp_report
    • First observedsigsci_get_corp_rule
    • First observedsigsci_get_corp_tag
    • First observedsigsci_get_corp_user
    • First observedsigsci_get_event
    • First observedsigsci_get_request
    • First observedsigsci_get_request_feed
    • First observedsigsci_get_site
    • First observedsigsci_get_site_list
    • First observedsigsci_get_site_member
    • First observedsigsci_get_site_rule
    • First observedsigsci_get_site_tag
    • First observedsigsci_get_template
    • First observedsigsci_get_timeseries
    • First observedsigsci_get_whitelist
    • First observedsigsci_list_agents
    • First observedsigsci_list_alerts
    • First observedsigsci_list_cloudwaf_certs
    • First observedsigsci_list_cloudwaf_instances
    • First observedsigsci_list_configured_templates
    • First observedsigsci_list_corp_activity
    • First observedsigsci_list_corp_integrations
    • First observedsigsci_list_corp_lists
    • First observedsigsci_list_corp_rules
    • First observedsigsci_list_corp_tags
    • First observedsigsci_list_corp_users
    • First observedsigsci_list_corps
    • First observedsigsci_list_events
    • First observedsigsci_list_rate_limited_ips
    • First observedsigsci_list_site_activity
    • First observedsigsci_list_site_lists
    • First observedsigsci_list_site_members
    • First observedsigsci_list_site_rules
    • First observedsigsci_list_site_tags
    • First observedsigsci_list_sites
    • First observedsigsci_list_suspicious_ips
    • First observedsigsci_list_templates
    • First observedsigsci_list_tool_categories
    • First observedsigsci_list_top_attacks
    • First observedsigsci_search_requests
    • First observedsigsci_search_tools

TDQS

B3.1/5.0

Scored across 48 tools

Disambiguation5/5

Each tool name clearly specifies the resource and action (e.g., sigsci_get_agent vs sigsci_list_agents). Even with many tools, the hierarchical naming (corp vs site) ensures no ambiguity between similar resources.

Naming Consistency5/5

All tools follow a consistent pattern: 'sigsci_verb_noun'. Verbs are limited to 'get_', 'list_', and 'search_', which clearly indicate the operation. This makes the set predictable and easy to navigate.

Tool Count2/5

With 48 tools, the server exceeds the recommended range for well-scoped tools (3-15). While the tools cover many resources, the high count likely makes it harder for an agent to select the right one, justifying a low score.

Completeness2/5

The tool set is entirely read-only (get, list, search) with no create, update, or delete operations. For a server named sigsci, likely managing a security platform, the lack of mutation capabilities is a significant gap that restricts agent workflows.

Maintenance

ActivityInactive
ResponsivenessNo issues

Resources

Unclaimed servers have limited discoverability.

Looking for Admin?

If you are the server author, to access and configure the admin panel.

Related MCP Connectors

Related MCP Servers

  • A
    license
    Not graded
    quality
    B
    maintenance
    A Model Context Protocol server for full Qualys portal management — expose VMDR, Policy Compliance, WAS, Cloud Agent, Container Security, TotalCloud, Patch Management, CSAM/GAV, EASM and administration to any MCP‑capable client.
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    MCP server for Tenable.io/One Vulnerability Management that provides read-only tools for querying scans, assets, plugins, and vulnerabilities, plus specialized reporting tools for VPR re-prioritization, CISA KEV/EPSS exposure, and scan delta comparisons.
    11
    3
    MIT