sigsci-mcp-server
Provides tools to interact with Signal Sciences (Fastly NGWAF) API, enabling management and monitoring of web application firewall configurations, events, rules, and more across corporations and sites.
Click on "Install Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@sigsci-mcp-serverlist all sites in my corporation"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
sigsci-mcp-server
MCP server implementation for the Signal Sciences (Fastly NGWAF) API.
日本語版はこちら → README.ja.md
Implements the Code execution with MCP approach to minimize context consumption from tool definitions.
Features
Progressive Disclosure: Dynamically discover and load only the tools you need
40+ API tools: Read-only corp/site APIs supported
Type-safe: Fully typed with TypeScript
MCP compliant: Built on the Model Context Protocol SDK
Related MCP server: Shannon Lite MCP
Usage
Configure for Cursor / Claude Desktop
Add to
~/.cursor/mcp.jsonorclaude_desktop_config.json:
{
"mcpServers": {
"sigsci-mcp-server": {
"command": "npx",
"args": ["-y", "https://github.com/yuki777/sigsci-mcp-server"],
"env": {
"SIGSCI_EMAIL": "your-email@example.com",
"SIGSCI_TOKEN": "your-api-token"
}
}
}
}Available Tools
Corp tools
Tool | Description |
| List corporations |
| Get corporation details |
| Get attack report |
| List corp activity events |
| List corp users |
| Get corp user details |
| List corp rules |
| Get corp rule details |
| List corp signal tags |
| Get corp signal tag details |
| List corp lists |
| Get corp list details |
| List corp integrations |
| Get corp integration details |
| List CloudWAF instances |
| List CloudWAF certificates |
Site tools
Tool | Description |
| List sites |
| Get site details |
| List site activity events |
| List site members |
| Get site member details |
| List site rules |
| Get site rule details |
| List rule templates |
| Get rule template details |
| List configured templates |
| Get configured template details |
| List site signal tags |
| Get site signal tag details |
| List site lists |
| Get site list details |
| List alerts |
| Get alert details |
| Search requests |
| Get request details |
| Get request feed |
| List events |
| Get event details |
| List suspicious IPs |
| List rate-limited IPs |
| Get whitelist |
| Get blacklist |
| List agents |
| Get agent details |
| List top attacks |
| Get timeseries data |
Meta tools (for Progressive Disclosure)
Tool | Description |
| Search tools by keyword |
| List tools by category |
Using Progressive Disclosure
This MCP server implements Anthropic’s recommended Code execution with MCP approach.
Problems with traditional MCP
Tool definitions consume context: Preloading all definitions costs many tokens
Redundant intermediate results: API responses can flood context as-is
How this server addresses them
On-demand tool discovery: Use
sigsci_search_toolsandsigsci_list_tool_categoriesto find only what you needControl detail level:
detailLevellets you choose name-only/with descriptions/full definitionsTool definitions as resources: Access tool definition files as MCP resources
Example
// 1. Check categories first
await sigsci_list_tool_categories({ detailLevel: "name" });
// 2. Search for the needed tools
await sigsci_search_tools({ keyword: "request", detailLevel: "description" });
// 3. Call only the needed tools
await sigsci_search_requests({
corpName: "my-corp",
siteName: "my-site",
q: "tag:XSS",
});Development
# Dev mode (watch)
npm run dev
# Build
npm run build
# Lint
npm run lint
# Test
npm testLicense
MIT
References
Available Tools
48 toolssigsci_get_agentC
Get details of a specific agent
| Name | Required | Description | Default |
|---|---|---|---|
| corpName | Yes | The name of the corporation | |
| siteName | Yes | The name of the site | |
| agentName | Yes | The name of the agent |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations provided, and the description does not disclose behavioral traits such as read-only nature, authentication requirements, or error handling (e.g., what happens if agent not found). Minimal transparency for a read operation.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is concise with a single sentence. However, it could be structured to include more context without adding length.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
No output schema and sparse description. Lacks explanation of returned data, error scenarios, or prerequisites. Incomplete for a tool with no annotations or output schema.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100% with descriptions for all three parameters. The description adds no additional meaning beyond what the schema provides, so baseline 3 applies.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool retrieves details of a specific agent. Although it doesn't explicitly differentiate from sibling tools like 'sigsci_list_agents', the name and context imply a single-resource retrieval. Could be more precise about what 'details' include.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance on when to use this tool versus alternatives like 'sigsci_list_agents' or other get tools. Missing context on prerequisites or when this tool is appropriate.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
sigsci_get_alertC
Get details of a specific alert
| Name | Required | Description | Default |
|---|---|---|---|
| corpName | Yes | The name of the corporation | |
| siteName | Yes | The name of the site | |
| alertId | Yes | The ID of the alert |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Without annotations, the description must disclose behavioral traits. It only says 'Get', implying a read operation, but does not clarify no side effects, required permissions, or rate limits. For a tool with no annotations, this is insufficient.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single, efficient sentence with no unnecessary words. It is front-loaded with the verb and resource, making it easy to parse.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given no output schema, the description should hint at the return value (e.g., 'including attributes such as type, severity, and status'). It only says 'details', which is vague. Additionally, it lacks usage context compared to sibling tools.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, with each parameter having a clear description. The tool description adds no additional meaning beyond the schema, so baseline score of 3 is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description 'Get details of a specific alert' clearly states the verb 'Get' and resource 'alert', indicating a retrieval operation. It is specific to a single alert but does not differentiate from sibling tools like 'sigsci_list_alerts' which lists all alerts.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool versus alternatives. For instance, it could mention that 'sigsci_list_alerts' is used for listing alerts, while this tool retrieves a single alert by ID. The lack of context makes it harder for an agent to decide.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
sigsci_get_blacklistC
Get blacklist for a site
| Name | Required | Description | Default |
|---|---|---|---|
| corpName | Yes | The name of the corporation | |
| siteName | Yes | The name of the site |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description must convey behavioral traits. 'Get' implies read-only, but no confirmation of idempotency, permissions, or side effects is given.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Extremely concise, single sentence with front-loaded verb and object. However, it may be too brief, lacking essential details.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
No output schema and no annotations; the description fails to explain the blacklist content, response format, or any constraints, leaving the agent underinformed.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Both parameters are fully described in the schema (100% coverage). The description adds no additional meaning beyond the schema, meeting the baseline.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description states 'Get blacklist for a site', clearly specifying the verb and resource. It distinguishes from other get tools like sigsci_get_whitelist by resource name, but lacks definition of 'blacklist'.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance on when to use this tool versus alternatives. No context or exclusions provided.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
sigsci_get_configured_templateB
Get details of a specific configured template
| Name | Required | Description | Default |
|---|---|---|---|
| corpName | Yes | The name of the corporation | |
| siteName | Yes | The name of the site | |
| templateId | Yes | The ID of the configured template |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations provided; description does not disclose behavioral traits such as read-only nature, required permissions, or potential side effects for a simple get operation.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Extremely concise (7 words), front-loaded with the key action and resource, no unnecessary text.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Adequate for a simple get tool with a clear purpose, but lacks context on what 'configured template' means and response format, given no output schema.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema covers all 3 parameters with descriptions (100% coverage), so description adds no additional meaning beyond what schema provides.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description uses specific verb 'Get details' and resource 'configured template', clearly distinguishing from sibling tools like sigsci_list_configured_templates and sigsci_get_template.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance on when to use this tool vs alternatives like sigsci_get_template. Does not mention prerequisites or contextual cues.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
sigsci_get_corpB
Get details of a specific corporation by name
| Name | Required | Description | Default |
|---|---|---|---|
| corpName | Yes | The name of the corporation |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations provided, and the description does not disclose behavioral traits (e.g., permissions, error handling, rate limits). For a simple read operation, more context would be helpful.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Single sentence, no redundancy. Directly communicates the tool's purpose without extraneous information.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool's simplicity (one parameter, no output schema), the description is minimally adequate. However, it lacks information on return value structure or uniqueness constraints.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100%, and the description mentions 'by name' which aligns with the sole parameter. However, the description adds no additional meaning beyond the schema's description of 'corpName'.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states 'Get details of a specific corporation by name', specifying the verb and resource. It distinguishes from list tools but does not explicitly differentiate from other get tools like sigsci_get_corp_list.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance on when to use this tool versus alternatives such as sigsci_list_corps or other get tools. Lacks context on prerequisites or use cases.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
sigsci_get_corp_integrationB
Get details of a specific integration in a corporation
| Name | Required | Description | Default |
|---|---|---|---|
| corpName | Yes | The name of the corporation | |
| integrationId | Yes | The ID of the integration |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, and the description does not disclose any behavioral traits such as side effects, permissions, or error handling. It only states the basic action without additional context.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single, concise sentence with no unnecessary words. It is front-loaded and to the point.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the simplicity of the tool (single get operation) and lack of output schema or annotations, the description is minimally adequate. It does not explain return value structure, but for a straightforward retrieval, it is acceptable.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100%, so the description does not add meaning beyond the schema. Both parameters are clearly documented in the schema, meeting the baseline.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states it retrieves details of a specific integration within a corporation, using a precise verb and resource. It distinguishes from the sibling tool 'sigsci_list_corp_integrations' which lists all integrations.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance on when to use this tool versus alternatives like list tools. The description does not specify that it requires an integration ID or that it is for single integration retrieval.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
sigsci_get_corp_listB
Get details of a specific list in a corporation
| Name | Required | Description | Default |
|---|---|---|---|
| corpName | Yes | The name of the corporation | |
| listId | Yes | The ID of the list |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations provided; description only states 'Get details' with no mention of read-only nature, error handling, or permissions. Does not add behavioral context beyond input schema.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Single sentence, no filler. Efficient but minimal.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
No output schema or annotations; description is too sparse for a tool that returns details. Does not hint at return structure or result format.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, so the description adds no additional meaning beyond what the parameter descriptions already provide. Baseline of 3 is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
Description specifies 'Get details of a specific list in a corporation', which is a clear verb+resource combination. It distinguishes itself from siblings like sigsci_get_corp (gets corporation details) and sigsci_list_corp_lists (lists all lists).
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance on when to use this tool versus alternatives (e.g., sigsci_list_corp_lists for listing all lists). Lacks any context about prerequisites or conditions.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
sigsci_get_corp_reportC
Get attack overview report for a corporation
| Name | Required | Description | Default |
|---|---|---|---|
| corpName | Yes | The name of the corporation | |
| from | No | POSIX Unix timestamp to start | |
| until | No | POSIX Unix timestamp to end |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description must disclose all behavioral traits. It only says 'get', implying a read operation, but nothing about permissions, output format, or side effects. The agent cannot infer what the report includes or how to handle the response.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single sentence that efficiently conveys the core purpose. It is front-loaded with the verb 'Get'. While brief, it avoids unnecessary words, though slightly more detail could improve usability without harming conciseness.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a tool with 3 parameters and no output schema, the description is incomplete. It fails to specify the report's content, default time ranges, or response structure, leaving the agent without critical context to use the tool correctly.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
All three parameters have descriptions in the schema (100% coverage), so the baseline is 3. The description adds no additional meaning beyond the schema; it does not explain how from/until affect the report or what corpName represents.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool retrieves an attack overview report for a corporation, which is a specific resource. However, it does not differentiate itself from sibling tools like sigsci_list_top_attacks, which may also relate to attacks.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool versus alternatives. The description lacks context about prerequisites, use cases, or exclusions, leaving the agent to guess its role among many similar get/list tools.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
sigsci_get_corp_ruleB
Get details of a specific rule in a corporation
| Name | Required | Description | Default |
|---|---|---|---|
| corpName | Yes | The name of the corporation | |
| ruleId | Yes | The ID of the rule |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
The description implies a read-only operation ('Get details'), but does not explicitly state side effects, permissions, or idempotency. With no annotations, the description provides minimal behavioral context.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single, concise sentence with no unnecessary words. It is immediately understandable.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a simple get tool with two documented parameters, the description is adequate but lacks mention of return value structure or output format. It meets minimum viability but could add more context.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100%, so the description adds no additional meaning beyond the parameter names and descriptions. The description does not elaborate on how to use the parameters.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states 'Get details of a specific rule in a corporation', specifying the verb (Get) and resource (rule). It differentiates from list_corp_rules by indicating a single rule, but does not explicitly distinguish from sigsci_get_site_rule.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool versus alternatives like sigsci_get_site_rule or sigsci_list_corp_rules. There is no mention of prerequisites or workflow.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
sigsci_get_corp_tagB
Get details of a specific signal tag in a corporation
| Name | Required | Description | Default |
|---|---|---|---|
| corpName | Yes | The name of the corporation | |
| tagName | Yes | The name of the signal tag |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations provided; description only says 'Get details', implying a safe read operation. No disclosure of authorization needs, rate limits, or response format. Minimal behavioral context.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Single sentence, to the point, no extraneous information. Front-loaded with verb and resource, efficiently communicates purpose.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Simple tool with 2 params and no output schema. Description is adequate but could be improved by mentioning typical response fields (e.g., tag details). Complete enough for a read operation.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema has 100% coverage with descriptions for both parameters. Description adds no additional meaning beyond the schema, so baseline score applies.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
Description clearly states verb 'Get details' and resource 'specific signal tag in a corporation'. Name and context differentiate from siblings like sigsci_list_corp_tags (list) and sigsci_get_site_tag (site scope), but no explicit differentiation in description.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
Usage is implied from name and description: use to retrieve a single tag by corpName and tagName. No explicit when-to-use or alternatives given, but minimal guidance is intrinsic.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
sigsci_get_corp_userB
Get details of a specific user in a corporation
| Name | Required | Description | Default |
|---|---|---|---|
| corpName | Yes | The name of the corporation | |
| Yes | The email address of the user |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description must convey behavioral traits. It indicates a read operation ('Get details') but omits critical information: no mention of permissions, side effects, or response structure. This is insufficient for a low-complexity tool.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single, highly efficient sentence with no redundant or irrelevant content. It communicates the core purpose clearly and concisely.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
The description is adequate for the tool's low complexity (2 parameters, no output schema), but it lacks detail on the response format and any behavioral guarantees. Some completeness is missing, especially given the absence of annotations.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The input schema has 100% coverage with clear parameter descriptions. The tool description adds no additional meaning beyond the schema, so it meets the baseline for high coverage without exceeding it.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description 'Get details of a specific user in a corporation' clearly identifies the action (get), resource (specific user), and scope (in a corporation). It effectively distinguishes from sibling tools like sigsci_list_corp_users by focusing on a single user retrieval.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool versus alternatives such as sigsci_list_corp_users for listing all users. The description lacks explicit usage context or exclusions, leaving the agent without direction for selection.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
sigsci_get_eventC
Get details of a specific event
| Name | Required | Description | Default |
|---|---|---|---|
| corpName | Yes | The name of the corporation | |
| siteName | Yes | The name of the site | |
| eventId | Yes | The ID of the event |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, and the description does not disclose any behavioral traits (e.g., read-only, authentication needs, rate limits, or side effects). The agent has no insight beyond the function's basic purpose.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is extremely concise (5 words) and front-loaded. For a simple retrieval tool, this brevity is acceptable, though it could be slightly more informative without being wasteful.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given no output schema and no annotations, the description fails to explain what 'details' are returned or any additional context about the event scope. The tool's behavior is underspecified for a 3-parameter action.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100%, so baseline is 3. The description adds no additional meaning beyond the schema's parameter descriptions, which are self-explanatory identifiers.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description 'Get details of a specific event' indicates the action (get) and resource (event details), but it is vague and does not distinguish from many sibling 'get_*' tools like sigsci_get_request or sigsci_get_alert.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool versus alternatives like sigsci_list_events or other get_* tools. The description lacks context for usage decisions.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
sigsci_get_requestA
Get details of a specific request by ID
| Name | Required | Description | Default |
|---|---|---|---|
| corpName | Yes | The name of the corporation | |
| siteName | Yes | The name of the site | |
| requestId | Yes | The ID of the request |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations provided; description says 'Get' which implies read-only. No additional behavioral traits disclosed (e.g., permissions, idempotency). Adequate for a simple read operation.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Single, clear sentence with no wasted words. Front-loaded with essential information.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a simple getter with 3 parameters, the description is adequate but lacks details about the return value (the request details). Without output schema, more context would be beneficial.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100% (all parameters have descriptions). Description adds no extra meaning beyond what schema already provides.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
Description clearly states 'Get details of a specific request by ID', specifying a single request retrieval. Distinguishes from sibling search_requests (which searches) and other get tools (different resources).
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance on when to use this tool versus alternatives like sigsci_search_requests. Implies use when you have a request ID, but no explicit context.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
sigsci_get_request_feedC
Get request feed for a site within a time range
| Name | Required | Description | Default |
|---|---|---|---|
| corpName | Yes | The name of the corporation | |
| siteName | Yes | The name of the site | |
| from | Yes | POSIX Unix timestamp to start (must be within 168 hours, on minute boundary) | |
| until | Yes | POSIX Unix timestamp to end (must be 5+ minutes ago, on minute boundary) | |
| tags | No | Comma-separated list of tags to filter by |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description carries the full burden for behavioral transparency. It does not mention safety, destructive potential, rate limits, or response characteristics beyond the basic 'get' action.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single sentence front-loaded with the verb and resource. It contains no unnecessary words and is appropriately concise.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the absence of an output schema, the description should provide hints about the return format or what a 'request feed' entails. It does not, leaving the agent unclear about what to expect.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100%, so the schema already documents all parameters. The description adds minimal extra value by vaguely referencing a time range, but does not enhance understanding of individual parameters.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the action 'Get' and resource 'request feed' with a time range constraint. However, it does not differentiate from similar tools like 'sigsci_get_request' or 'sigsci_search_requests', which could cause confusion.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool versus alternatives such as 'sigsci_get_request' or 'sigsci_search_requests'. The description lacks context for appropriate usage.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
sigsci_get_siteA
Get details of a specific site
| Name | Required | Description | Default |
|---|---|---|---|
| corpName | Yes | The name of the corporation | |
| siteName | Yes | The name of the site |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations provided, the description carries the full burden. It states 'get details' without specifying side effects, permissions, or behavior like error handling. For a simple read operation, this is adequate but could be more informative.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single, concise sentence without any extraneous information. Every word is necessary.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a simple get tool with required parameters and no output schema, the description is largely complete. It could mention behavior when the site is not found, but it is sufficient for selecting and invoking the tool.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Both parameters have descriptions in the schema (100% coverage), so the description adds no additional meaning. The baseline is 3, and the description does not exceed that.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description 'Get details of a specific site' uses a clear verb (get) and resource (site), and implies it targets one specific site. This distinguishes it from sibling list tools like sigsci_list_sites and other get tools that retrieve different entities.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description does not explicitly state when to use this tool over alternatives. It implicitly conveys it is for a single site by the parameter requirements, but no direct comparison to list or other get tools is provided.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
sigsci_get_site_listB
Get details of a specific list in a site
| Name | Required | Description | Default |
|---|---|---|---|
| corpName | Yes | The name of the corporation | |
| siteName | Yes | The name of the site | |
| listId | Yes | The ID of the list |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description carries full burden for behavioral disclosure. It does not state whether the operation is read-only, requires specific authentication, or has rate limits. The lack of any behavioral traits reduces transparency.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single concise sentence with no redundancy. It is front-loaded with the verb and resource, though it could be slightly more informative without losing conciseness.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a 3-required-parameter tool with no output schema or annotations, the description is minimal. It does not explain return values or side effects, but the purpose is clear. Adequate but not complete.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100% with parameter descriptions in the schema. The description adds 'specific list' context but does not enhance meaning beyond the schema's parameter descriptions. Baseline score of 3 is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the action ('Get details') and the resource ('a specific list in a site'). It distinguishes from sibling tools like `sigsci_list_site_lists` by implying retrieval of a single list's details rather than listing all lists.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No when-to-use or when-not-to-use guidance is provided. It does not mention alternatives such as `sigsci_list_site_lists` for listing all lists, leaving the agent to infer usage without explicit context.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
sigsci_get_site_memberA
Get details of a specific site member
| Name | Required | Description | Default |
|---|---|---|---|
| corpName | Yes | The name of the corporation | |
| siteName | Yes | The name of the site | |
| Yes | The email address of the member |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description carries the full burden. It does not disclose any behavioral traits such as read-only nature, authentication needs, or error handling. The description only states the purpose.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single sentence of 8 words, efficiently conveying the core purpose without any wasted words or padding.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a simple retrieval tool with no output schema, the description is minimally adequate. However, it could provide more context about what 'details' are returned, but given the rule that if no output schema exists the description needn't explain return values, this is borderline.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, so the baseline is 3. The description adds no additional meaning beyond what the schema already provides for the three required parameters.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the action ('Get details') and the resource ('a specific site member'). It implicitly distinguishes from the sibling tool 'sigsci_list_site_members' which lists all members.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No explicit guidance on when to use this tool versus alternatives. Usage is implied by the purpose but no when-not or exclusion criteria are provided.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
sigsci_get_site_ruleA
Get details of a specific rule in a site
| Name | Required | Description | Default |
|---|---|---|---|
| corpName | Yes | The name of the corporation | |
| siteName | Yes | The name of the site | |
| ruleId | Yes | The ID of the rule |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations provided; description only says 'Get' suggesting read-only, but doesn't disclose any behavioral traits like required permissions, rate limits, or side effects. The description carries the full burden in absence of annotations.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Single sentence, front-loaded with key action and resource. No unnecessary words, concise and efficient.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Tool is simple with 3 required params and no output schema. Description is minimal but adequate for a straightforward get operation. Lacks details on response structure or any special behaviors.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema has 100% description coverage for all three parameters (corpName, siteName, ruleId). The description adds no additional meaning beyond what the schema already provides, so baseline of 3 is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the verb 'Get details' and the resource 'a specific rule in a site'. It distinguishes itself from siblings like sigsci_get_site (site details) and sigsci_list_site_rules (list all rules).
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No explicit guidance on when to use this tool versus alternatives. It implies single-rule retrieval by ruleId, but no mention of when to use list vs get, or any prerequisites.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
sigsci_get_site_tagA
Get details of a specific signal tag in a site
| Name | Required | Description | Default |
|---|---|---|---|
| corpName | Yes | The name of the corporation | |
| siteName | Yes | The name of the site | |
| tagName | Yes | The name of the signal tag |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description must carry the full burden. It only states 'Get details' which implies a read operation, but does not disclose any behavioral traits such as authorization requirements, error handling, or side effects.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single, short sentence (10 words) that front-loads the purpose. Every word is necessary and there is no redundancy or fluff.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the simple nature of a 'get' operation with three string parameters and no output schema, the description is adequate but minimal. It does not mention return value format, possible error conditions, or usage context beyond the basic purpose.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
All three parameters are fully described in the schema with clear names and descriptions. The tool description adds no additional meaning beyond what the schema already provides. With 100% schema coverage, the baseline of 3 is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the action ('Get details'), the resource ('specific signal tag'), and the scope ('in a site'). It distinguishes from sibling tools like sigsci_list_site_tags (which lists all tags) and other 'get' tools for different resources.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description implies usage for fetching a single tag's details, but does not explicitly state when to use it versus alternatives like list tools. No exclusions or context for choosing this tool over siblings are provided.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
sigsci_get_templateC
Get details of a specific rule template
| Name | Required | Description | Default |
|---|---|---|---|
| corpName | Yes | The name of the corporation | |
| siteName | Yes | The name of the site | |
| templateId | Yes | The ID of the template (e.g., CVE-2025-55182) |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description carries full burden. It only states 'Get details of a specific rule template' without mentioning any behavioral traits like idempotency, permissions, error conditions, or side effects. Completely insufficient.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Single sentence, no waste. However, no structure or front-loading of key info beyond the bare minimum. Slightly under-specified but concise.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a simple 'get' tool with 3 required parameters and no output schema, the description is minimal but lacks any return value info or usage hints. Given no annotations, it leaves gaps for an AI agent.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100% (all parameters have descriptions). The description adds no extra meaning beyond what the schema already provides. Baseline 3 is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description 'Get details of a specific rule template' clearly states the verb (Get) and resource (rule template). It distinguishes from siblings like 'sigsci_list_templates' and 'sigsci_get_configured_template' by focusing on 'template' without 'configured', though it doesn't explicitly differentiate.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance on when to use this tool versus siblings like 'sigsci_list_templates' or 'sigsci_get_configured_template'. No context, exclusions, or alternative suggestions provided.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
sigsci_get_timeseriesB
Get timeseries request data for a site
| Name | Required | Description | Default |
|---|---|---|---|
| corpName | Yes | The name of the corporation | |
| siteName | Yes | The name of the site | |
| from | No | POSIX Unix timestamp to start | |
| until | No | POSIX Unix timestamp to end | |
| tag | No | Filter by tag | |
| rollup | No | Rollup interval in seconds |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description carries the full burden of behavioral disclosure. It only states the action and resource, omitting critical details like whether the operation is read-only, permission requirements, data format (aggregated time buckets), or pagination.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single concise sentence with no redundant information. However, for a tool with 6 parameters and no annotations, it may be overly brief; a slightly expanded description could improve completeness without sacrificing conciseness.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the absence of an output schema and annotations, the description leaves significant gaps. It does not explain what the returned timeseries data represents, how to interpret results, or any constraints (e.g., maximum time range). The agent lacks essential context for correct usage.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The input schema provides full coverage (100%) for all 6 parameters, so the description adds minimal extra meaning. The phrase 'timeseries request data' implicitly relates to the time-range and rollup parameters, but does not clarify their usage beyond the schema's descriptions.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description states the specific action (get) and resource (timeseries request data) with a clear scope (for a site). It effectively distinguishes from sibling tools that retrieve other entities like agents, alerts, or individual requests.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool versus alternatives such as sigsci_get_request or sigsci_search_requests. The agent receives no hints about appropriate contexts (e.g., aggregating data over time) or exclusions.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
sigsci_get_whitelistB
Get whitelist for a site
| Name | Required | Description | Default |
|---|---|---|---|
| corpName | Yes | The name of the corporation | |
| siteName | Yes | The name of the site |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
The description implies a read-only operation ('get'), which is non-destructive. However, it does not disclose any potential side effects, authorization requirements, or return format. With no annotations, the description provides minimal behavioral insight.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is extremely concise (5 words) and front-loaded with the core purpose. It wastes no words, though could benefit from a brief elaboration on what a whitelist is.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the simple input schema (2 params) and no output schema, the description should clarify what the tool returns (e.g., list or single whitelist). It does not, leaving the agent uncertain about the response structure.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The input schema covers 100% of parameters (corpName, siteName) with descriptions. The tool description adds no extra meaning beyond the schema, so it meets the baseline but does not enhance understanding.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description 'Get whitelist for a site' clearly states the action (get) and resource (whitelist), with site as the scope. It distinguishes from sibling tools like sigsci_get_blacklist, but does not explicitly differentiate from other similar get tools.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool versus alternatives like sigsci_get_blacklist or sigsci_list_sites. There is no mention of prerequisites or context for invocation.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
sigsci_list_agentsB
List all agents for a site
| Name | Required | Description | Default |
|---|---|---|---|
| corpName | Yes | The name of the corporation | |
| siteName | Yes | The name of the site |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description should disclose behavioral traits but only says 'List all agents for a site', omitting pagination, authentication, or data scope details.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
A single concise sentence that is front-loaded and contains no superfluous words.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a list tool with no output schema, the description is too minimal; it doesn't mention return value structure, filtering, or important behavioral context.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100% with clear parameter descriptions. The tool description adds no additional meaning, achieving baseline score.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the verb 'list' and resource 'agents' with scope 'for a site', distinguishing it from sibling 'sigsci_get_agent' which likely retrieves a single agent.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance on when to use this tool versus alternatives (e.g., sigsci_get_agent for specific agents) or any conditions for usage.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
sigsci_list_alertsC
List all alerts for a site
| Name | Required | Description | Default |
|---|---|---|---|
| corpName | Yes | The name of the corporation | |
| siteName | Yes | The name of the site |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are present, so the description bears full responsibility. It states 'list all alerts,' implying a read-only operation, but provides no details about pagination, rate limits, authentication requirements, or error behavior. The lack of any behavioral disclosure beyond the basic operation leaves the agent uninformed about important constraints.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single, concise sentence that directly states the tool's purpose. It is front-loaded with the key action and resource. However, it could include more useful information without becoming verbose. It earns its place but could be more informative.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the lack of an output schema and the presence of many sibling tools, the description is too minimal. It does not explain what an alert is, the format of the returned data, or mention pagination or limitations. The tool is part of a complex domain, and the description fails to provide enough context for an agent to use it correctly without external knowledge.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The input schema has 100% coverage with descriptions for both parameters (corpName, siteName). The description adds no additional meaning beyond the schema, which already explains what these parameters are. With full schema coverage, a baseline of 3 is appropriate, as the description does not enhance understanding of parameters.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description 'List all alerts for a site' clearly states the verb (list) and resource (alerts) with a scope (for a site). However, it does not distinguish itself from many sibling list tools that also operate on a site, such as sigsci_list_events or sigsci_list_site_rules. The purpose is clear but not uniquely positioned among similar tools.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool versus alternatives. There are many sibling list tools, but the description does not mention when 'list alerts' is appropriate compared to 'get_alert' or other list tools. No when-to-use, when-not-to-use, or alternative suggestions.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
sigsci_list_cloudwaf_certsA
List all CloudWAF certificates in a corporation
| Name | Required | Description | Default |
|---|---|---|---|
| corpName | Yes | The name of the corporation |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description must cover behavioral traits. It correctly indicates a read operation but omits details like response format, pagination, or authentication needs. For a simple list operation, this is adequate but not comprehensive.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single, clear sentence with no unnecessary words. It is highly concise and front-loaded with the core action.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool's simplicity (1 parameter, list operation), the description is nearly complete. It lacks mention of the return type or structure, but the context of sibling tools provides a pattern. It could benefit from noting that it returns a list of certificates.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100%, and the parameter description already states it is the corporation name. The tool description adds no additional meaning beyond the schema, so baseline of 3 is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description states the verb 'List', the resource 'CloudWAF certificates', and the scope 'in a corporation'. It clearly distinguishes from the sibling tool 'sigsci_list_cloudwaf_instances' which lists a different resource.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description implies the tool is for listing certificates, but provides no explicit guidance on when to use it versus other list tools or alternatives. No prerequisites or exclusions are mentioned.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
sigsci_list_cloudwaf_instancesC
List all CloudWAF instances in a corporation
| Name | Required | Description | Default |
|---|---|---|---|
| corpName | Yes | The name of the corporation |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Without annotations, the description carries the full burden of disclosing behavioral traits. It only states 'list all', which implies a read operation, but does not specify if results are paginated, ordered, or what data is returned. No details on rate limits, destructive potential, or idempotency.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single sentence, very concise, but it lacks essential details. While brevity is valued, the tool's purpose and context are under-specified. Better structure could include key behavioral hints upfront.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given no output schema and a single parameter, the description should explain the return format or typical use case. Currently, it does not specify what 'CloudWAF instances' are returned (e.g., names, IDs, status). This undermines completeness for an agent selecting the tool.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100% (corpName described in schema). The description adds no additional meaning beyond the schema's parameter description. Baseline 3 is appropriate as it neither contradicts nor enriches the schema.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the action (list) and resource (CloudWAF instances) with scope (in a corporation). It effectively distinguishes from siblings like 'list_agents' or 'list_sites' by specifying the unique resource type. However, it could be more precise about what constitutes a CloudWAF instance.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No usage guidelines are provided. The description lacks any indication of when to use this tool versus alternatives, prerequisites, or context. For example, it doesn't mention if the user needs specific permissions or how to find the corpName.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
sigsci_list_configured_templatesB
List configured templated rules for a site
| Name | Required | Description | Default |
|---|---|---|---|
| corpName | Yes | The name of the corporation | |
| siteName | Yes | The name of the site |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description carries the full burden of behavioral disclosure. It fails to state whether the tool is read-only, what it returns, or any side effects. For a listing tool, these details are typically expected.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single concise sentence with no unnecessary words. It is efficiently front-loaded with the key action and resource.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the simplicity of the tool (2 required params, no output schema, no nested objects), the description is minimally adequate. However, it lacks context about what 'configured templated rules' are, pagination, or how results are ordered. It does not fully compensate for the lack of annotations.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The input schema has 100% description coverage for both parameters (corpName, siteName). The description adds no additional meaning beyond the schema, which already describes the parameters. Baseline score of 3 is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description 'List configured templated rules for a site' clearly specifies the verb (list) and the resource (configured templated rules). It distinguishes from sibling tools like sigsci_list_templates, which lists available templates, while this lists configured ones for a site.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No usage guidance is provided. The description does not indicate when to use this tool versus alternatives such as sigsci_get_configured_template or sigsci_list_templates, nor does it mention prerequisites or context.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
sigsci_list_corp_activityB
List activity events for a corporation
| Name | Required | Description | Default |
|---|---|---|---|
| corpName | Yes | The name of the corporation | |
| limit | No | Number of entries per page | |
| page | No | Page number |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, and the description does not disclose any behavioral traits such as pagination behavior, sorting order, or authentication requirements beyond what is in the input schema.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single concise sentence with no wasted words. However, it lacks structure or additional context that might help the agent.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the lack of output schema and annotations, the description is too minimal. It does not explain what 'activity events' are, how results are ordered, or how this differs from sigsci_list_site_activity.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100%, so the baseline is 3. The description does not add any additional meaning beyond the schema descriptions for the parameters.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description 'List activity events for a corporation' uses a specific verb and resource, clearly distinguishing this tool from siblings like sigsci_list_corp_rules or sigsci_list_corp_users.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is given on when to use this tool versus alternatives. With many sibling list tools, the absence of when-to-use advice is a notable gap.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
sigsci_list_corp_integrationsB
List all integrations in a corporation
| Name | Required | Description | Default |
|---|---|---|---|
| corpName | Yes | The name of the corporation |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are present, so the description carries the full burden. It implies a read-only operation by listing integrations, but does not disclose any additional behavioral traits such as pagination, required permissions, or response format. For a simple list, this is minimally adequate.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single sentence that is front-loaded and contains no extraneous information. Every word contributes to the purpose, making it highly concise and efficient.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool's simplicity (one required parameter, no output schema, no nested objects) and the absence of annotations, the description provides sufficient information for an agent to understand the basic operation. However, it could be improved by noting that the result is a list of integration objects.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The parameter 'corpName' is fully described in the schema (100% coverage), so the description adds no extra meaning. The description does not elaborate on the parameter beyond what the schema already provides, resulting in a baseline score of 3.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the verb 'List' and the resource 'integrations' scoped to 'a corporation'. It effectively communicates the tool's purpose, though it does not explicitly distinguish it from the sibling 'sigsci_get_corp_integration' which retrieves a single integration.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool versus alternatives like sigsci_get_corp_integration for a specific integration. The agent is left to infer usage without any comparative context.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
sigsci_list_corp_listsB
List all lists in a corporation
| Name | Required | Description | Default |
|---|---|---|---|
| corpName | Yes | The name of the corporation |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are present, and the description is minimal. It does not disclose any behavioral traits such as read-only nature, permissions needed, or what 'lists' entails. The agent cannot infer safety or side effects.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single concise sentence with no extraneous information, earning its place.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a simple list tool with one required parameter and no output schema, the description is minimally adequate. However, it could be improved by clarifying the nature of 'lists' to help distinguish from similar tools.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The schema coverage is 100% and already describes the 'corpName' parameter. The description adds no additional meaning beyond the schema, so it meets the baseline of 3.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the verb 'List' and the resource 'all lists in a corporation'. However, among siblings like sigsci_list_corp_tags and sigsci_list_corp_rules, it does not differentiate what 'lists' specifically refers to (e.g., custom lists, IP lists).
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool versus alternatives. The description does not mention context, exclusions, or comparisons to sibling tools.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
sigsci_list_corp_rulesA
List all rules in a corporation
| Name | Required | Description | Default |
|---|---|---|---|
| corpName | Yes | The name of the corporation | |
| type | No | The type of rule to filter by | |
| page | No | Page number | |
| limit | No | Number of entries per page (default: 100, max: 1000) |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description must fully disclose behavior. It states the tool lists rules (read operation) but does not reveal that pagination parameters (page, limit) are available, nor does it mention the type filter. Lacks details on whether the operation is read-only, destructive, or requires specific permissions.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single sentence that efficiently conveys the core function. No extraneous words or redundant information. Perfectly concise for the task.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
No output schema exists, so the description should hint at return format (e.g., array of rules). It does not. With 4 parameters, a simple list operation, the description is functional but lacks completeness about pagination or filtering behavior. Adequate but not thorough.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100%, and parameter descriptions are present in the schema. The description does not add additional meaning beyond 'list all rules in a corporation'. It does not explain how parameters like type, page, or limit affect the result. Baseline 3 is appropriate since schema handles parameter documentation.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description 'List all rules in a corporation' clearly states the verb (list), resource (rules), and scope (corporation). It distinguishes this tool from siblings like sigsci_list_site_rules (site-level) and sigsci_get_corp_rule (single rule), making purpose unambiguous.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description implies usage for listing corporation-level rules but does not explicitly state when to use this tool versus alternatives like sigsci_list_site_rules or sigsci_get_corp_rule. No when-not-to-use guidance or prerequisite conditions are provided.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
sigsci_list_corpsA
List all corporations accessible to the authenticated user
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations provided; description is basic but adequate. It indicates a read-only list operation with no destructive behavior. Could mention it returns a list of corporation objects, but not required.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Single sentence, no wasted words. Front-loads the key purpose: 'List all corporations accessible to the authenticated user'.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a simple list tool with zero parameters and no output schema, the description is nearly complete. Could mention that the result is a list or array, but current description is sufficient for an agent to infer.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
No parameters in schema, so description correctly provides no further detail. Schema coverage is 100%, and description adds no ambiguity.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
Description clearly states verb 'list' and resource 'corporations' with scope 'accessible to the authenticated user'. Distinguishes from sibling 'sigsci_get_corp' which presumably retrieves a single corporation.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
Description implies use for retrieving all accessible corporations, and siblings like 'sigsci_get_corp' are for specific ones. However, no explicit when-not or alternative mention.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
sigsci_list_corp_tagsA
List all signal tags in a corporation
| Name | Required | Description | Default |
|---|---|---|---|
| corpName | Yes | The name of the corporation |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description carries full burden for behavioral disclosure. It only states the action (list) without mentioning that it's read-only, safe, or any permission/auth requirements.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
One sentence, no wasted words. Perfectly concise for a simple list operation.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
The description covers the basic purpose and parameter, but lacks details on pagination, ordering, or result limits that would be helpful for a list endpoint. Given no output schema, additional context would improve completeness.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100%, so the description adds no extra meaning. The parameter 'corpName' is already documented in the schema as 'The name of the corporation', matching the description's usage.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the verb 'List' and the resource 'signal tags in a corporation', distinguishing it from sibling tools like sigsci_get_corp_tag (single tag) and sigsci_list_site_tags (site-level tags).
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No explicit when-to-use or when-not-to-use guidance. The description implies listing all tags for a corporation but doesn't contrast with alternatives like sigsci_get_corp_tag for specific tags or sigsci_list_site_tags for site-level tags.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
sigsci_list_corp_usersB
List all users in a corporation
| Name | Required | Description | Default |
|---|---|---|---|
| corpName | Yes | The name of the corporation | |
| expand | No | Expand hidden properties for nested objects |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description carries the full burden. It only says 'List', which implies a read-only operation, but does not disclose pagination, error handling, rate limits, or authentication needs. For a tool with no annotations, this is insufficient.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single clear sentence with no waste. It is front-loaded and directly states the purpose. However, it is very brief and could include more useful context without becoming verbose.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a simple list tool, the description is minimal. It does not explain the return format or any constraints. Given the absence of an output schema and the large number of sibling tools, more context would be beneficial, but the current description is minimally adequate.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100%. Both parameters have descriptions in the schema. The tool description adds no additional meaning beyond what the schema already provides, so a baseline score of 3 is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the verb (list), resource (users), and scope (in a corporation). It distinguishes from sibling tools like sigsci_get_corp_user which retrieves a single user, and other list tools that target different resources.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides no guidance on when to use this tool versus alternatives such as other list tools or the single-user retrieval tool. It does not specify any prerequisites or exclusions.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
sigsci_list_eventsC
List events for a site
| Name | Required | Description | Default |
|---|---|---|---|
| corpName | Yes | The name of the corporation | |
| siteName | Yes | The name of the site | |
| from | No | POSIX Unix timestamp to start | |
| until | No | POSIX Unix timestamp to end | |
| sort | No | Sort order | |
| limit | No | Number of entries per page | |
| page | No | Page number | |
| tag | No | Filter by tag | |
| status | No | Filter by status |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description carries the full burden of behavioral disclosure, but it only states 'List events for a site' with no mention of side effects, authentication requirements, rate limits, pagination behavior, or return format. This is completely opaque.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is extremely concise (4 words), but it is under-specified. It lacks critical details that would make it useful, so the brevity sacrifices informativeness.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool's complexity (9 parameters, no output schema, no annotations), the description is woefully incomplete. It fails to explain what events are, how pagination works, the behavior of timestamps, or any other contextual information needed for proper use.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The input schema has 100% description coverage, with each parameter clearly documented (e.g., corpName, siteName, from, until, sort, etc.). The description adds no additional meaning beyond the schema, so a baseline score of 3 is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the verb 'list' and the resource 'events for a site', making the basic purpose understandable. However, it does not distinguish this tool from similar siblings like sigsci_list_alerts or sigsci_list_agents, which also list resources for a site.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool versus alternatives, nor are there any exclusions or prerequisites. The agent receives no help in choosing between this and other list tools.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
sigsci_list_rate_limited_ipsB
List rate-limited IPs for a site
| Name | Required | Description | Default |
|---|---|---|---|
| corpName | Yes | The name of the corporation | |
| siteName | Yes | The name of the site | |
| limit | No | Number of entries to return |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description must carry the burden of behavioral disclosure. The description only states the action (list) without any information on side effects, read-only nature, pagination, rate limits, or authentication requirements. This is inadequate for a tool with no annotations.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single sentence with no unnecessary words. It is front-loaded and concise. However, it may be too brief to convey essential context, but for conciseness alone it scores well.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a simple list tool with no output schema and no annotations, the description omits important context such as what fields are returned, pagination behavior, or whether it lists all rate-limited IPs globally or for a specific scope. The tool's complexity is low, but the description still lacks completeness for a new user.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100% for the three parameters (corpName, siteName, limit). The description adds no meaning beyond the schema, so baseline 3 is appropriate. No additional semantic value provided.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description uses a specific verb-resource pair ('List rate-limited IPs for a site'), clearly identifying the action and resource. It distinguishes from sibling tools like sigsci_list_suspicious_ips (different IP type) and sigsci_list_agents (different resource).
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance on when to use this tool versus alternatives (e.g., sigsci_list_suspicious_ips or other list tools). No mention of prerequisites, use cases, or exclusions. The description provides no context for selection among siblings.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
sigsci_list_site_activityB
List activity events for a site
| Name | Required | Description | Default |
|---|---|---|---|
| corpName | Yes | The name of the corporation | |
| siteName | Yes | The name of the site | |
| from | No | POSIX Unix timestamp to start | |
| until | No | POSIX Unix timestamp to end | |
| sort | No | Sort order (default: desc) | |
| limit | No | Number of entries per page (default: 100, max: 1000) | |
| page | No | Page number | |
| events | No | Filter on events | |
| eventType | No | Filter on event type |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description carries full burden for behavioral disclosure. It only states core function with no details on pagination, rate limits, authentication needs, or data scope (e.g., whether it returns all activity or has date bounds).
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single, clear sentence with no redundant words. However, it is extremely brief and could be expanded without losing conciseness.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given 9 parameters, no output schema, and no annotations, the description lacks context about the response structure, pagination behavior, and event types. It does not compensate for the missing structured metadata.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
All 9 parameters have descriptions in the input schema (100% coverage). The description adds no additional meaning beyond the schema, so a baseline score of 3 is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description 'List activity events for a site' uses a specific verb ('list') and resource ('activity events for a site'), clearly distinguishing it from siblings like 'sigsci_list_corp_activity' which lists corporation-level activity.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool versus alternatives, such as when to use 'sigsci_list_events' instead. No context about prerequisites or limitations.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
sigsci_list_site_listsC
List all lists in a site
| Name | Required | Description | Default |
|---|---|---|---|
| corpName | Yes | The name of the corporation | |
| siteName | Yes | The name of the site |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are present, so the description carries full burden. It only states 'list' without disclosing any behavior like pagination, result format, or authorization needs. For a read operation, this is minimal, missing explicit assurance that it is non-destructive.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single, front-loaded sentence that conveys the core action. It is efficient but could benefit from slightly more detail without being verbose.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a simple list tool with two parameters and no output schema, the description is adequate. However, it does not mention the scope (site-level vs corp-level) or any filtering capabilities, making it less complete than it could be.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100%, so the schema already documents both parameters. The description adds no extra meaning beyond what is in the schema, earning the baseline score of 3.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description uses a specific verb ('list') and resource ('lists in a site'), clearly indicating the action and scope. However, it does not explicitly differentiate from sibling tools like 'sigsci_list_corp_lists' beyond the name and parameter context.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool versus alternatives such as 'sigsci_list_corp_lists' or detail-oriented tools like 'sigsci_get_site_list'. The description lacks context for selection.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
sigsci_list_site_membersB
List all members of a site
| Name | Required | Description | Default |
|---|---|---|---|
| corpName | Yes | The name of the corporation | |
| siteName | Yes | The name of the site |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description carries the full burden for behavioral traits. It only states that it lists members, but does not disclose pagination, permissions, rate limits, response format, or whether it returns all members for the site or across the corporation.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single sentence with no redundancy or unnecessary words. It is concise and front-loaded.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the lack of output schema and annotations, the description is too brief. It does not specify what constitutes a 'member', the return structure, or any limitations, making it incomplete for an agent to fully understand the tool's behavior.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100% as both parameters have descriptions. The tool description adds no extra meaning beyond the schema, so a baseline of 3 is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description 'List all members of a site' uses a specific verb 'List' and identifies the resource 'site members'. It clearly distinguishes from the sibling tool 'sigsci_get_site_member' which retrieves a single member.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool versus alternatives like 'sigsci_get_site_member' or other list tools. The description does not mention prerequisites, context, or when not to use it.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
sigsci_list_site_rulesC
List all rules in a site
| Name | Required | Description | Default |
|---|---|---|---|
| corpName | Yes | The name of the corporation | |
| siteName | Yes | The name of the site | |
| type | No | The type of rule to filter by | |
| page | No | Page number | |
| limit | No | Number of entries per page (default: 100, max: 1000) |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Without annotations, the description carries the full burden of behavioral disclosure, but it only states the basic function. It does not reveal that the tool supports pagination (via page/limit parameters) or filtering by type, nor any side effects or performance characteristics.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single, front-loaded sentence with no superfluous words. It is highly concise and easy to parse.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given 5 parameters and no output schema, the description is too sparse. It omits mention of pagination, filtering, and important contextual details like rate limits or authentication requirements that might affect tool invocation.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The input schema has 100% description coverage, so the description adds no extra meaning beyond what the schema already provides. The baseline is 3, and the description does not enhance parameter understanding.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description 'List all rules in a site' clearly states the verb (List) and resource (rules) within a site. It distinguishes from sibling tools like 'sigsci_get_site_rule' (singular) but does not explicitly differentiate from other list tools such as 'sigsci_list_site_lists'.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool versus alternatives like 'sigsci_list_site_activity' or 'sigsci_list_site_tags'. The description does not mention prerequisites or context for use.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
sigsci_list_sitesC
List all sites in a corporation
| Name | Required | Description | Default |
|---|---|---|---|
| corpName | Yes | The name of the corporation | |
| name | No | Filter on site name or display name | |
| page | No | Page number (default: 1) | |
| limit | No | Number of entries per page (default: 10) | |
| agentLevel | No | Filter on agent mode |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations exist, so the description carries the full burden. It only declares a list action without revealing pagination behavior (page/limit parameters exist) or any side effects. For a read-only tool, more context about iteration scope or rate limits would be helpful.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is extremely concise (5 words), but this brevity comes at the cost of completeness. It could be improved by adding a sentence about filtering or pagination without losing conciseness.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given 5 parameters (including pagination and filters) and no output schema, the description is too sparse. It should explain that the tool supports filtering by name, agentLevel, and pagination, and that it requires a corporation. Without this, the agent may misuse the tool.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100%, so the description does not need to add param meaning. The description adds no extra detail beyond the schema, and the schema already explains each parameter. Baseline 3 is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description 'List all sites in a corporation' clearly states the action (list) and resource (sites). However, it does not differentiate from sibling list tools (e.g., sigsci_list_corps lists corporations), making it ambiguous whether this tool lists all sites or all sites in a given corporation.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool versus its siblings. There are many list tools for different resources (e.g., sigsci_list_site_rules, sigsci_list_events), and the description does not specify the context or prerequisites (e.g., requiring a corporation name).
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
sigsci_list_site_tagsB
List all signal tags in a site
| Name | Required | Description | Default |
|---|---|---|---|
| corpName | Yes | The name of the corporation | |
| siteName | Yes | The name of the site |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations provided, so description must cover behavioral traits. Only states 'list all signal tags' but omits details like pagination, sorting, or whether this is a read-only operation. Lacks disclosure of potential performance considerations.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Single sentence, front-loaded with the core action. No wasted words.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given no output schema and no annotations, the description is adequate for a simple list operation but lacks details on return format (e.g., array of tag objects), whether results are paginated, or what constitutes a 'signal tag.' Not fully complete.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100% with both parameters described. Description adds no additional meaning beyond what schema already provides. Baseline score of 3 is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
Description clearly states 'List all signal tags in a site' with a specific verb and resource. Distinguished from sibling 'sigsci_get_site_tag' which retrieves a single tag, and from other list tools.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance on when to use this tool versus alternatives like 'sigsci_get_site_tag' or other list tools. Agent must infer usage from name alone.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
sigsci_list_suspicious_ipsB
List suspicious IPs for a site
| Name | Required | Description | Default |
|---|---|---|---|
| corpName | Yes | The name of the corporation | |
| siteName | Yes | The name of the site | |
| limit | No | Number of entries to return |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations provided, the description must disclose behavioral traits. It only says 'list suspicious IPs' without explaining whether it is read-only (likely), what 'suspicious' means, or any side effects. Minimal transparency.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Very short and to the point, but at the cost of completeness. It is front-loaded but lacks any detail beyond the core action.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Simple tool, but description omits details like pagination (limit parameter), default values, ordering, or return format. Given no output schema, more context would help agents understand what to expect.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100%, so description does not need to restate parameters. It adds no additional meaning beyond what schema provides, which is acceptable for high coverage.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
Description clearly states the tool lists suspicious IPs for a site, with specific verb 'list' and resource 'suspicious IPs'. It distinguishes from sibling list tools (e.g., list_rate_limited_ips) by targeting a specific resource type.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance on when to use this tool vs alternatives. It does not mention typical use cases, prerequisites, or exclusions, such as when to prefer list_suspicious_ips over list_events or list_rate_limited_ips.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
sigsci_list_templatesB
List available rule templates for a site
| Name | Required | Description | Default |
|---|---|---|---|
| corpName | Yes | The name of the corporation | |
| siteName | Yes | The name of the site |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Without annotations, the description carries full burden. It only says 'list available rule templates' with no behavioral details such as pagination, rate limits, output format, or what determines 'availability'. Minimal transparency.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Single sentence, direct, no unnecessary words. Front-loaded with the verb and key object.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
The tool is simple (2 required params, no output schema), but the description lacks information about output (e.g., whether it returns template IDs or names), pagination behavior, or error conditions. More context would be helpful for an AI agent.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, so the schema already documents the two parameters (corpName, siteName). The description adds no additional meaning beyond implying site scope, which is already clear from the siteName parameter. Baseline score of 3 is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states 'list available rule templates for a site', specifying the verb (list), resource (rule templates), and scope (for a site). This distinguishes it from siblings like sigsci_get_template or sigsci_list_configured_templates.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool versus alternatives. There is no mention of prerequisites, when-not to use, or contrast with similar tools like sigsci_get_template or sigsci_list_configured_templates.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
sigsci_list_tool_categoriesA
List available tool categories and their tools
| Name | Required | Description | Default |
|---|---|---|---|
| category | No | Filter to a specific category | |
| detailLevel | No | Level of detail to return for tools (name: only names, description: names and descriptions, full: complete definitions) |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description must disclose behavioral traits. It states the tool lists categories and their tools, which is appropriate for a read-only list operation. However, it does not mention that the output may vary with parameters or that it is a safe, non-destructive operation beyond what is implied.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single, concise sentence that front-loads the purpose. No unnecessary words or redundancy.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool's low complexity and lack of output schema, the description is mostly complete. It explains what the tool does, and the parameters cover filtering and detail level. However, it does not describe the return structure or relationship between categories and tools, which might be helpful.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100%, so baseline is 3. The description adds no additional meaning beyond the schema. The parameters (category and detailLevel) are fully described in the input schema with enums and descriptions.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description 'List available tool categories and their tools' clearly states the action (list), resource (tool categories and their tools), and scope. It distinguishes this tool from sibling tools like sigsci_get_corp or sigsci_list_sites by focusing specifically on tool categories.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description implies usage for listing tool categories, but provides no explicit guidance on when to use this tool versus alternatives, such as sigsci_search_tools or other list tools. No when-not or prerequisite information is given.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
sigsci_list_top_attacksC
List top attacks for a site
| Name | Required | Description | Default |
|---|---|---|---|
| corpName | Yes | The name of the corporation | |
| siteName | Yes | The name of the site | |
| from | No | POSIX Unix timestamp to start | |
| until | No | POSIX Unix timestamp to end | |
| tag | No | Filter by tag | |
| limit | No | Number of entries to return |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations provided, the description carries the full burden of disclosing behavior. It only states 'list' without indicating read-only nature, side effects, or response structure, which is insufficient.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single, short sentence with no wasted words. It is concise but could be more informative without becoming verbose.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a tool with 6 parameters (2 required) and no output schema or annotations, the description is too minimal. It fails to explain output format, 'top' criteria, or behavioral context, leaving significant gaps.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100%, so the baseline is 3. The description adds no extra meaning beyond the schema's defined parameters, only repeating the tool's purpose.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool lists top attacks for a site, using a specific verb and resource. However, it does not define what 'top' means (e.g., by count or severity), which slightly reduces clarity.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool versus alternative list tools like sigsci_list_events or sigsci_list_site_rules. The description lacks context for decision-making.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
sigsci_search_requestsC
Search requests for a site with optional query filters
| Name | Required | Description | Default |
|---|---|---|---|
| corpName | Yes | The name of the corporation | |
| siteName | Yes | The name of the site | |
| q | No | Search query using SigSci search syntax | |
| page | No | Page number (max 10,000 requests total) | |
| limit | No | Number of entries per page (default: 100, max: 1000) |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations provided, and the description only mentions optional query filters. It does not disclose pagination behavior, result limits, or what happens when no query is given. The schema provides some details (page, limit) but the description adds no behavioral insight.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
A single sentence that is front-loaded and efficient. However, it is very sparse for a 5-parameter tool; slightly more detail could improve utility without losing conciseness.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
The description is too minimal given the tool's complexity (5 parameters, no output schema, no annotations). It omits important context like query syntax, pagination, and result format, leaving agents underinformed.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
All 5 parameters have descriptions in the schema (100% coverage), so the description adds minimal value by stating 'optional query filters'. The baseline is 3; the description does not enhance parameter understanding beyond the schema.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool searches requests for a site with optional query filters, distinguishing it from get/list tools by emphasizing the search capability. However, it does not explicitly differentiate from the sibling sigsci_search_tools, which searches tools.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance on when to use this tool versus alternatives like sigsci_get_request or sigsci_list_events. The description lacks context for appropriate usage.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
sigsci_search_toolsA
Search for available tools by keyword
| Name | Required | Description | Default |
|---|---|---|---|
| keyword | Yes | Keyword to search for in tool names and descriptions | |
| detailLevel | No | Level of detail to return (name: only names, description: names and descriptions, full: complete definitions) |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description carries the full burden. It only says 'Search', implying read-only, but does not explicitly state that it is non-destructive or disclose any limits, authorization needs, or side effects.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single, front-loaded sentence with zero wasted words. It efficiently conveys the core purpose.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
The description adequately covers the basic operation, but it does not mention what the output looks like or that it returns a list of available tools. With no output schema, a bit more context would be helpful.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100% with clear descriptions for both parameters. The tool description adds no extra meaning beyond what the schema already provides, so baseline score of 3 is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the verb 'Search' and the resource 'available tools', distinguishing it from sibling tools that get or list specific entities. The purpose is unambiguous.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No explicit guidance on when to use this tool versus alternatives. However, the context of sibling tools (all get/list for specific resources) implies this is for finding tools by keyword. No when-not or alternative names provided.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
48 tool updates
v1.0.0- First observed
sigsci_get_agent - First observed
sigsci_get_alert - First observed
sigsci_get_blacklist - First observed
sigsci_get_configured_template - First observed
sigsci_get_corp - First observed
sigsci_get_corp_integration - First observed
sigsci_get_corp_list - First observed
sigsci_get_corp_report - First observed
sigsci_get_corp_rule - First observed
sigsci_get_corp_tag - First observed
sigsci_get_corp_user - First observed
sigsci_get_event - First observed
sigsci_get_request - First observed
sigsci_get_request_feed - First observed
sigsci_get_site - First observed
sigsci_get_site_list - First observed
sigsci_get_site_member - First observed
sigsci_get_site_rule - First observed
sigsci_get_site_tag - First observed
sigsci_get_template - First observed
sigsci_get_timeseries - First observed
sigsci_get_whitelist - First observed
sigsci_list_agents - First observed
sigsci_list_alerts - First observed
sigsci_list_cloudwaf_certs - First observed
sigsci_list_cloudwaf_instances - First observed
sigsci_list_configured_templates - First observed
sigsci_list_corp_activity - First observed
sigsci_list_corp_integrations - First observed
sigsci_list_corp_lists - First observed
sigsci_list_corp_rules - First observed
sigsci_list_corp_tags - First observed
sigsci_list_corp_users - First observed
sigsci_list_corps - First observed
sigsci_list_events - First observed
sigsci_list_rate_limited_ips - First observed
sigsci_list_site_activity - First observed
sigsci_list_site_lists - First observed
sigsci_list_site_members - First observed
sigsci_list_site_rules - First observed
sigsci_list_site_tags - First observed
sigsci_list_sites - First observed
sigsci_list_suspicious_ips - First observed
sigsci_list_templates - First observed
sigsci_list_tool_categories - First observed
sigsci_list_top_attacks - First observed
sigsci_search_requests - First observed
sigsci_search_tools
TDQS
Scored across 48 tools
Each tool name clearly specifies the resource and action (e.g., sigsci_get_agent vs sigsci_list_agents). Even with many tools, the hierarchical naming (corp vs site) ensures no ambiguity between similar resources.
All tools follow a consistent pattern: 'sigsci_verb_noun'. Verbs are limited to 'get_', 'list_', and 'search_', which clearly indicate the operation. This makes the set predictable and easy to navigate.
With 48 tools, the server exceeds the recommended range for well-scoped tools (3-15). While the tools cover many resources, the high count likely makes it harder for an agent to select the right one, justifying a low score.
The tool set is entirely read-only (get, list, search) with no create, update, or delete operations. For a server named sigsci, likely managing a security platform, the lack of mutation capabilities is a significant gap that restricts agent workflows.
Maintenance
Resources
Unclaimed servers have limited discoverability.
Looking for Admin?
If you are the server author, to access and configure the admin panel.
Related MCP Connectors
MCP server for mandates, delegation, policy-gated execution, credential grants, and audit.
Authenticated MCP server for ClearPolicy policy and compliance workflows.
Public, read-only MCP server for FarmNeural company facts, packages, and capabilities.
XFA's remote MCP server — query device posture, compliance, policies & CVEs. Read-only.
Related MCP Servers
- AlicenseAqualityDmaintenanceA community MCP server for Cisco Secure Access that exposes the Secure Access REST API to AI clients as a curated catalog of tools for Admin, Deployments, Investigate, Policies, and Reports.421Apache 2.0
- AlicenseAqualityCmaintenanceMCP server for Shannon Lite security workflows, enabling configuration, scan orchestration, workspace management, and report reading.111MIT
- AlicenseNot gradedqualityBmaintenanceA Model Context Protocol server for full Qualys portal management — expose VMDR, Policy Compliance, WAS, Cloud Agent, Container Security, TotalCloud, Patch Management, CSAM/GAV, EASM and administration to any MCP‑capable client.MIT
- AlicenseAqualityCmaintenanceMCP server for Tenable.io/One Vulnerability Management that provides read-only tools for querying scans, assets, plugins, and vulnerabilities, plus specialized reporting tools for VPR re-prioritization, CISA KEV/EPSS exposure, and scan delta comparisons.113MIT