Skip to main content
Glama
navin2031992

iSuite Operations MCP Server

by navin2031992

iSuite Operations MCP Server

A Model Context Protocol (MCP) server that exposes 48 tools covering the full spectrum of iSuite enterprise administration — user management, role verification, job monitoring, scheduler control, batch execution, audit trail lookup, and configuration validation.


Table of Contents


Related MCP server: Looker Admin MCP

Overview

src/
  index.ts             MCP server entry point (stdio transport)
  server-config.ts     Environment-based connection configuration
  tools/
    users.ts           8 tools  — user CRUD, disable/enable, password reset
    roles.ts           7 tools  — role listing, permission checks, assign/revoke
    jobs.ts            7 tools  — job status, running/failed lists, cancel, retry
    scheduler.ts       7 tools  — schedule management, upcoming jobs, history
    batch.ts           6 tools  — batch status, rerun, cancel, history
    audit.ts           6 tools  — log search, user activity, export, login history
    config.ts          7 tools  — config validation, health check, compare envs

Runtime: Node.js 18+
Transport: stdio (works with any MCP-compatible client)
Authentication: API Key, Bearer token, or Basic auth


Prerequisites

Requirement

Version

Node.js

18 or later

npm

9 or later

iSuite instance

With REST API access enabled


Installation

# Clone or download the project
cd c:\NewInitiatives\mcp\mcp-isuite

# Install dependencies (zero vulnerabilities)
npm install

Configuration

Copy the example environment file and fill in your iSuite connection details:

copy .env.example .env

Edit .env:

# Required
ISUITE_BASE_URL=https://isuite.yourcompany.com/api/v1
ISUITE_API_KEY=your-api-key-here

# Auth type: apikey | bearer | basic
ISUITE_AUTH_TYPE=apikey

# For basic auth only
ISUITE_USERNAME=
ISUITE_PASSWORD=

# Optional
ISUITE_ENVIRONMENT=production
ISUITE_TIMEOUT_MS=30000
ISUITE_VERIFY_TLS=true

Note: The server reads environment variables at startup. When integrating with Cline or Roo, set these in the plugin's MCP server env block (see below) rather than relying on a .env file.


Build

npm run build

Compiled output lands in dist/. The entry point is dist/index.js.

To verify the build:

node dist/index.js
# Expected output on stderr: iSuite Operations MCP server running on stdio

Press Ctrl+C to stop.


VS Code Integration — Cline

Cline is a VS Code extension that supports MCP servers natively.

Step 1 — Install Cline

Open VS Code → Extensions (Ctrl+Shift+X) → search Cline → Install.

Step 2 — Open MCP Settings

  1. Click the Cline icon in the Activity Bar.

  2. Click the MCP Servers button (plug icon) in the Cline panel header.

  3. Click Edit MCP Settings — this opens cline_mcp_settings.json.

Step 3 — Add the iSuite Server

{
  "mcpServers": {
    "isuite": {
      "command": "node",
      "args": ["c:/NewInitiatives/mcp/mcp-isuite/dist/index.js"],
      "env": {
        "ISUITE_BASE_URL": "https://isuite.yourcompany.com/api/v1",
        "ISUITE_API_KEY": "your-api-key-here",
        "ISUITE_AUTH_TYPE": "apikey",
        "ISUITE_ENVIRONMENT": "production",
        "ISUITE_TIMEOUT_MS": "30000"
      },
      "disabled": false,
      "alwaysAllow": []
    }
  }
}

Windows path note: Use forward slashes (/) or escaped backslashes (\\) in JSON paths.

Step 4 — Verify Connection

  1. Save cline_mcp_settings.json.

  2. In the Cline panel, the isuite server should appear with a green dot.

  3. Click the server name to see all 48 registered tools listed.

Step 5 — Use in Chat

Open a Cline chat and type any of the example prompts below.


VS Code Integration — Roo

Roo Code (formerly Roo Cline) is a Cline fork with additional features and its own MCP configuration.

Step 1 — Install Roo Code

Open VS Code → Extensions (Ctrl+Shift+X) → search Roo Code → Install.

Step 2 — Open Roo MCP Settings

Option A — Via Command Palette:

Ctrl+Shift+P → Roo Code: Open MCP Settings

Option B — Via UI:

  1. Click the Roo Code icon in the Activity Bar.

  2. Click the gear icon → MCP Servers.

  3. Click Edit Global MCP Settings.

This opens %APPDATA%\Code\User\globalStorage\rooveterinaryinc.roo-cline\settings\mcp_settings.json on Windows.

Step 3 — Add the iSuite Server

{
  "mcpServers": {
    "isuite": {
      "command": "node",
      "args": ["c:/NewInitiatives/mcp/mcp-isuite/dist/index.js"],
      "env": {
        "ISUITE_BASE_URL": "https://isuite.yourcompany.com/api/v1",
        "ISUITE_API_KEY": "your-api-key-here",
        "ISUITE_AUTH_TYPE": "apikey",
        "ISUITE_ENVIRONMENT": "production",
        "ISUITE_TIMEOUT_MS": "30000"
      },
      "disabled": false,
      "alwaysAllow": [
        "list_users",
        "get_user",
        "list_roles",
        "get_user_roles",
        "list_running_jobs",
        "list_failed_jobs",
        "get_job_status",
        "list_schedules",
        "get_scheduler_status",
        "list_running_batches",
        "search_audit_logs",
        "check_system_health",
        "get_config_value",
        "list_config_keys"
      ]
    }
  }
}

alwaysAllow lists read-only tools that Roo will call without prompting for permission. Write/mutating tools (create, delete, cancel, rerun) are intentionally omitted so Roo asks before executing them.

Step 4 — Workspace-Scoped Config (Optional)

To scope the MCP server to a single workspace, create .roo/mcp.json in your project root instead:

{
  "mcpServers": {
    "isuite": {
      "command": "node",
      "args": ["c:/NewInitiatives/mcp/mcp-isuite/dist/index.js"],
      "env": {
        "ISUITE_BASE_URL": "https://isuite.yourcompany.com/api/v1",
        "ISUITE_API_KEY": "your-api-key-here",
        "ISUITE_ENVIRONMENT": "staging"
      }
    }
  }
}

This is useful for pointing different workspaces at different iSuite environments (prod vs. staging).

Step 5 — Verify Connection

  1. Open the Roo Code panel.

  2. Click the MCP tab — the isuite server should show as connected.

  3. Expand it to confirm all 48 tools are listed.


Claude Desktop Integration

For use with the Claude Desktop app, edit claude_desktop_config.json:

Windows: %APPDATA%\Claude\claude_desktop_config.json
macOS: ~/Library/Application Support/Claude/claude_desktop_config.json

{
  "mcpServers": {
    "isuite": {
      "command": "node",
      "args": ["c:/NewInitiatives/mcp/mcp-isuite/dist/index.js"],
      "env": {
        "ISUITE_BASE_URL": "https://isuite.yourcompany.com/api/v1",
        "ISUITE_API_KEY": "your-api-key-here",
        "ISUITE_AUTH_TYPE": "apikey",
        "ISUITE_ENVIRONMENT": "production"
      }
    }
  }
}

Restart Claude Desktop after saving.


Available Tools

User Management

Tool

Description

list_users

List users with status/role filters and pagination

get_user

Full profile for a user by ID or username

create_user

Create a new user account with role assignments

update_user

Update email, name, department, or manager

disable_user

Disable account (preserves data, blocks login)

enable_user

Re-enable a disabled account

delete_user

Permanently delete a user, with ownership transfer

reset_user_password

Send reset email or return temporary password

Role Verification

Tool

Description

list_roles

All roles, optionally with full permission lists

get_role

Full details and permissions for one role

get_user_roles

All roles assigned to a specific user

verify_user_permission

Check if a user has a specific permission

assign_role

Assign a role (supports temporary/expiring assignments)

revoke_role

Remove a role from a user

list_role_members

All users who hold a given role

Job Status Monitoring

Tool

Description

get_job_status

Status, progress, and details for a job execution

list_running_jobs

All currently running jobs

list_failed_jobs

Failed jobs filtered by time range and type

list_completed_jobs

Completed jobs filtered by time range

get_job_history

Full run history for a job definition

cancel_job

Gracefully or forcefully cancel a running job

retry_job

Retry a failed job, optionally from a specific step

Scheduler Monitoring

Tool

Description

list_schedules

All schedules with status filter

get_schedule

Full details including cron expression and next run

get_scheduler_status

Scheduler engine status (running/paused/standby)

enable_schedule

Resume a disabled schedule

disable_schedule

Pause a schedule without deleting it

list_upcoming_jobs

Jobs scheduled to run within N hours

get_schedule_history

Past execution history for a schedule

Batch Execution Status

Tool

Description

get_batch_status

Status, progress, and step details for a batch

list_batch_jobs

Batch jobs filtered by status and time range

list_running_batches

All currently executing batch jobs

get_batch_history

Execution history for a batch definition

rerun_batch

Re-execute from failure point or beginning

cancel_batch

Cancel a running or pending batch job

Audit Trail Lookup

Tool

Description

search_audit_logs

Full-text + field search across audit logs

get_audit_log

Complete details for a single log entry

list_user_activity

All actions performed by a specific user

list_recent_changes

System changes (config, roles, schedules) within N hours

export_audit_trail

Export logs to CSV, JSON, or XLSX

get_login_history

Login, logout, and failed login events

Configuration Validation

Tool

Description

validate_config

Validate all or a specific config section

get_config_value

Get a config value by dot-notation key

list_config_keys

All config keys, filterable by section

compare_configs

Diff configuration between two environments

check_system_health

Health check all subsystems (DB, cache, queue, etc.)

validate_connection

Test a named connection (DB, SMTP, SFTP, S3, etc.)

update_config_value

Update a config value (requires admin permission)


Example Prompts

Copy and paste any of these into Cline, Roo, or Claude to get started.


User Management

List all active iSuite users in the Finance department and show me
which roles each one has assigned.
Create a new iSuite user account for Jane Smith (jsmith@company.com)
in the Operations department. Assign her the OPERATOR and BATCH_RUNNER
roles, and send a welcome email.
User john.doe hasn't logged in for 90 days. Check his account status,
list his current roles, then disable the account with the reason
"Inactive account — 90 day policy".
I need to audit who has the ADMIN role in iSuite. List all members
of that role and verify whether any of them also have the SCHEDULER_ADMIN
role at the same time.

Job Monitoring & Control

Show me all currently running iSuite jobs. For any job that has been
running longer than 2 hours, get its full status and step details.
List all failed jobs from the last 24 hours. Group them by job type
and tell me which type has the highest failure rate.
Job execution JOB-20240612-0042 is stuck. Check its current status,
then cancel it gracefully with the reason "Manual intervention — stuck job".
After cancellation, retry it from the failed step.
Get the full execution history for job definition ETL-DAILY-SALES
for the past 30 runs. Summarize average duration, success rate,
and identify any patterns in failures.

Scheduler

Show me all scheduled jobs that are set to run in the next 6 hours.
Highlight any that overlap in timing and might cause resource contention.
The end-of-month batch window starts tomorrow. Disable all non-critical
schedules (type: report) for the next 24 hours to free up resources.
List which ones you disabled.
Get the scheduler engine status and list all currently disabled schedules.
Tell me which ones have been disabled longest.

Batch Execution

Show me all batch jobs that are currently running. For each one,
show progress percentage and estimated completion time.
Batch job BATCH-RECON-2024-0610 failed overnight. Get its full status
including step details, then rerun it from the failed step with
normal priority.
Get the last 20 executions of the MONTH-END-CLOSE batch. Summarize
average runtime, any failures, and whether performance has degraded
over the last 5 runs compared to the previous 15.

Audit Trail

Search the audit logs for all CONFIG_UPDATE actions performed in the
last 7 days. Show me who made changes, what was changed, and when.
Pull all activity for user admin.user from the past 30 days.
Summarize the types of actions they performed and flag anything
that looks unusual (e.g. bulk deletes, after-hours logins, role changes).
Export the full audit trail for June 2024 to CSV format.
Include only events related to job cancellations and batch reruns.
Show me all failed login attempts in the last 48 hours.
Group by username and highlight any accounts with more than
3 failed attempts — these may need to be locked.

Configuration & Health

Run a full iSuite system health check across all subsystems.
Summarize which are healthy, which have warnings, and which are failing.
Validate the entire iSuite configuration in strict mode.
List all errors and warnings and suggest remediation steps.
Compare the iSuite configuration between production and staging environments.
Highlight every difference and flag any production settings that look
risky if accidentally used in staging.
Check the database connection health and validate the SMTP connection.
If either fails, show the full error details from the config.
What is the current value of scheduler.maxConcurrentJobs?
Also list all configuration keys under the scheduler section
so I can review the full scheduler configuration.

Combined / Multi-Domain

Do a daily operations check:
1. Show all currently running jobs and batches
2. List any failed jobs or batches from the last 12 hours
3. Show upcoming scheduled jobs in the next 4 hours
4. Run a system health check
Give me a summary with any action items.
User sarah.jones is leaving the company today. 
1. Get her current profile and role assignments
2. Revoke all her roles with reason "Employee offboarding"
3. Disable her account
4. Show her audit activity from the last 30 days for compliance records
Before the production deployment tonight:
1. Validate the full iSuite configuration
2. Check system health
3. List any jobs currently running that might be affected
4. Show upcoming scheduled jobs in the next 8 hours that could conflict
Summarize the go/no-go status.

Troubleshooting

Server not appearing in Cline/Roo

  • Verify the path in args is correct and dist/index.js exists after npm run build.

  • Check that Node.js 18+ is on your system PATH: node --version.

  • Use forward slashes in JSON paths on Windows.

Authentication errors (401/403)

  • Confirm ISUITE_API_KEY is correct and not expired.

  • Check ISUITE_AUTH_TYPE matches what your iSuite instance expects.

  • For basic auth, ensure ISUITE_USERNAME and ISUITE_PASSWORD are both set.

Connection timeout

  • Increase ISUITE_TIMEOUT_MS (default 30000 ms).

  • Verify ISUITE_BASE_URL is reachable from your machine.

  • Check firewall/VPN if iSuite is on a private network.

TLS certificate errors

  • If using a self-signed certificate in a dev environment, set ISUITE_VERIFY_TLS=false.

  • Never set this to false in production.

Tool returns HTTP 404

  • The API path may differ from the defaults. Check your iSuite API documentation and update the path in the relevant src/tools/*.ts file, then rebuild.

Rebuild after changes

npm run build

Cline and Roo will pick up changes the next time they start the server process (usually on the next chat session or after clicking Reconnect in the MCP panel).

Available Tools

48 tools
assign_roleC

Assign a role to an iSuite user.

ParametersJSON Schema
NameRequiredDescriptionDefault
userIdYesThe user's unique ID or username.
roleIdYesThe role's unique ID or name to assign.
expiresAtNoOptional ISO-8601 datetime for temporary role assignment expiry.

TDQS

C2.9/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The description does not disclose important behavioral traits, such as whether the assignment is idempotent, what happens if the role is already assigned, or any required permissions. With no annotations, the description carries the full burden and fails to provide sufficient transparency.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, well-structured sentence that quickly conveys the tool's purpose. While very concise, it could be slightly more informative without becoming verbose.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the lack of annotations and output schema, the description is too minimal. It does not explain the result of the assignment or any side effects, leaving the agent without crucial context for correct invocation.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema descriptions cover 100% of parameters, so the baseline is 3. The tool description adds no additional meaning beyond the schema, which already explains the parameters adequately.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action ('assign'), the object ('a role'), and the recipient ('iSuite user'). It is specific and unambiguous, but does not explicitly differentiate from sibling tools like 'revoke_role' or 'get_user_roles'.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus alternatives such as 'revoke_role' or 'get_user_roles'. The description lacks contextual information about prerequisites or conditions.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

cancel_batchB

Cancel a running or pending iSuite batch job.

ParametersJSON Schema
NameRequiredDescriptionDefault
batchIdYesThe batch execution ID to cancel.
reasonNoReason for cancellation (recorded in audit log).
waitForCleanupNoWait for graceful cleanup before returning (default true).

TDQS

B3.2/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Without annotations, the description must disclose effects but only says 'Cancel'. It does not mention irreversibility, cleanup actions, or impact on dependent jobs. The 'waitForCleanup' parameter hints at behavior but is not explained in the description.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, concise sentence that front-loads the action. While effective, it could be slightly more structured by noting required parameters or conditions.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple cancellation tool, the description is minimally adequate but lacks usage guidance and behavioral details that would help an agent decide when to invoke it. It does not explain return values or post-conditions, relying solely on the schema.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema already fully documents all 3 parameters with clear descriptions. The tool description adds no additional context beyond what the schema provides, so a baseline of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'Cancel' and the resource 'iSuite batch job', and distinguishes it from siblings like 'cancel_job' which likely targets individual jobs. The purpose is specific and unambiguous.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus alternatives such as 'cancel_job' or 'rerun_batch'. The description omits context like state requirements (e.g., only running or pending) or scenarios where cancellation is inappropriate.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

cancel_jobA

Cancel a currently running iSuite job. The job will be terminated gracefully.

ParametersJSON Schema
NameRequiredDescriptionDefault
jobIdYesThe unique job execution ID to cancel.
reasonNoReason for cancellation (recorded in audit log).
forceNoForce immediate termination without graceful shutdown (default false).

TDQS

A3.7/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Mentions graceful termination, adding context beyond schema. However, no annotations are provided, so description carries full burden. Lacks details on reversibility, dependencies, or audit trail implications beyond the reason parameter.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, front-loaded, no unnecessary words. Efficient and clear.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Adequate for a simple mutation tool with 3 parameters and no output schema. Lacks details on prerequisites and post-conditions, but sibling context provides some differentiation.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so description adds minimal value beyond parameter names and defaults. The mention of 'graceful' relates to force parameter but schema already covers that. Baseline score applies.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Clearly states verb 'Cancel', resource 'iSuite job', and action 'terminated gracefully'. Distinguishes from siblings like cancel_batch and retry_job.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Describes when to use (for a currently running job) but lacks guidance on when not to use, such as for completed jobs, or how it compares to cancel_batch. No explicit alternatives or exclusions.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

check_system_healthA

Run a full iSuite system health check — validates connectivity to all subsystems (database, message queue, storage, integrations).

ParametersJSON Schema
NameRequiredDescriptionDefault
subsystemsNoSpecific subsystems to check. Omit to check all. Options: 'database', 'cache', 'storage', 'messageQueue', 'integrations', 'scheduler'.
timeoutNoPer-subsystem timeout in milliseconds (default 5000).

TDQS

A3.6/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations provided, so description carries full burden. Discloses that it checks subsystems and uses a timeout, but does not state whether the operation is read-only, what authentication is needed, or any side effects. Add no behavioral traits beyond what is already in the schema.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, front-loaded with purpose, no redundancy. Every word earns its place.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

No output schema is provided. Description does not hint at return format (e.g., per-subsystem status, overall pass/fail). For a health check tool, this is a notable omission. Lacks completeness for an agent to understand what the tool returns.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with parameter descriptions. Description adds context that omitting 'subsystems' checks all, which is helpful but does not significantly extend schema meaning. Baseline score of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states verb 'Run a full iSuite system health check' and specifies it validates connectivity to all subsystems. This uniquely identifies the tool among 40+ sibling tools focused on user management, jobs, and configs, with no other health check tool present.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit when-to-use or when-not-to-use guidance. However, given the tool's unique purpose among siblings, usage context is implicitly clear. Lacks exclusions or alternative tool references.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

compare_configsA

Compare iSuite configuration between two environments and highlight differences.

ParametersJSON Schema
NameRequiredDescriptionDefault
sourceEnvironmentYesSource environment name (e.g. 'production', 'staging', 'dev').
targetEnvironmentYesTarget environment to compare against.
sectionNoLimit comparison to a specific config section.
excludeSecretsNoExclude secret/password keys from comparison (default true).

TDQS

A3.6/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description must carry the burden. It does not disclose whether the operation is read-only, any required permissions, or other behavioral traits, leaving ambiguity about side effects.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single front-loaded sentence with no wasted words, efficiently conveying the tool's purpose.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The description lacks details about the output format (e.g., structured diff or list of differences) and does not explain behavior for missing keys or large configurations, making it incomplete for an agent.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with descriptions for all parameters. The tool description does not add significant meaning beyond what the schema already provides, so it meets the baseline but offers no extra clarity.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'compare' and the resource 'iSuite configuration' between two environments, which distinguishes this tool from siblings like get_config_value or validate_config.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage for comparing configurations between environments but lacks explicit guidance on when not to use this tool or mentions alternatives such as get_config_value or validate_config.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

create_userB

Create a new iSuite user account.

ParametersJSON Schema
NameRequiredDescriptionDefault
usernameYesUnique login username.
emailYesUser's email address.
fullNameYesUser's full display name.
departmentNoDepartment or business unit.
rolesNoList of role names to assign to the new user.
sendWelcomeEmailNoWhether to send a welcome/activation email (default true).

TDQS

B3.1/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description must disclose behavioral traits. It does not mention what happens upon creation (e.g., welcome email activation, duplicate checking, permission requirements).

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single clear sentence with no wasted words. However, it could be slightly more detailed without losing conciseness.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a creation tool with 6 parameters and no output schema, the description is insufficient. It does not explain the return value or side effects of the operation.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with each parameter documented. The description adds no additional meaning beyond the schema, earning a baseline 3.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action ('Create') and the resource ('new iSuite user account'). It is distinct among siblings as the only user creation tool.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives (e.g., update_user, disable_user) or any prerequisites (e.g., required permissions).

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

delete_userA

Permanently delete an iSuite user account. This action is irreversible.

ParametersJSON Schema
NameRequiredDescriptionDefault
userIdYesThe user's unique ID or username.
transferOwnershipToNoUser ID to transfer owned resources to before deletion.

TDQS

A3.7/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The description notes irreversibility, a key behavioral trait, but lacks details about side effects (e.g., impact on resources, permissions) and does not cover what the response looks like.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is two concise sentences, front-loading the primary purpose with no wasted words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

While the tool is straightforward, the description lacks information about the return format or any required permissions, leaving some gaps for a complete understanding.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, with each parameter described adequately, so the description adds no extra meaning beyond the schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action (permanently delete) and the resource (iSuite user account), distinguishing it from sibling tools like disable_user or update_user.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies this tool is for permanent deletion but does not explicitly state when to use it versus alternatives like disable_user, nor does it mention any prerequisites or exclusions.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

disable_scheduleA

Disable an active iSuite schedule to pause automatic execution without deleting it.

ParametersJSON Schema
NameRequiredDescriptionDefault
scheduleIdYesThe unique schedule ID to disable.
reasonNoReason for disabling (recorded in audit log).

TDQS

A3.6/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations provided, so description carries full burden. It states that disabling pauses execution and does not delete, which is key. However, it omits whether the operation is reversible, requires special permissions, or affects currently running jobs. Adequate but not detailed.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence with no waste. Directly states the action, target, and effect without redundant information.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple state-change tool, the description covers the essential purpose. It could mention that the reason is recorded in an audit log (as implied by the parameter), and that the schedule can be re-enabled. No output schema exists, so return values are not expected. Solid overall.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so baseline is 3. Description adds no extra meaning to the parameters beyond what the schema provides. The reason parameter is hinted in the audit log context, but not explicitly described.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'Disable', the resource 'active iSuite schedule', and the outcome 'pause automatic execution without deleting it'. It distinguishes from related tools like enable_schedule.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit guidance on when to use this tool versus alternatives like enable_schedule or delete_schedule. The phrase 'without deleting it' hints at a contrast, but no clear when-to-use or when-not-to instructions.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

disable_userB

Disable an iSuite user account, preventing login without deleting the account.

ParametersJSON Schema
NameRequiredDescriptionDefault
userIdYesThe user's unique ID or username.
reasonNoReason for disabling the account (recorded in audit log).

TDQS

B3.3/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations provided, the description carries full burden for behavioral disclosure. It mentions preventing login but does not detail effects on existing sessions, reversibility, or audit logging.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single, front-loaded sentence that efficiently conveys the core action. No unnecessary words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple two-parameter tool, the description covers the basics but lacks context about consequences, prerequisites, or return values. Could be improved with notes on reversibility or audit trail.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema covers both parameters with 100% description coverage. The description adds no additional meaning beyond the schema, so baseline score of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states the verb (disable), resource (iSuite user account), and effect (prevent login without deleting). It effectively distinguishes from siblings like delete_user and enable_user.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit guidance on when to use this tool versus alternatives like delete_user or suspend. The description only states what it does, not when it is appropriate.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

enable_scheduleA

Enable a disabled iSuite schedule so it resumes automatic execution.

ParametersJSON Schema
NameRequiredDescriptionDefault
scheduleIdYesThe unique schedule ID to enable.

TDQS

A3.7/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries the full burden. It only states the basic effect (enable/resume execution) but does not disclose any side effects, permissions required, or behavior if the schedule is already enabled. This leaves gaps in understanding.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence that is concise and front-loaded. Every word contributes to the core meaning.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The tool is simple with one parameter and no output schema. The description provides the essential purpose, but lacks context on prerequisites, error states, or side effects. It is adequate but not thorough.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% as the one parameter 'scheduleId' has a description. The description adds no additional meaning beyond the schema, so the baseline score of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description uses a specific verb 'Enable' with the resource 'disabled iSuite schedule', clearly stating the action and the target. It distinguishes itself from the sibling tool 'disable_schedule' by specifying the state transition.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description clearly implies use when a schedule is disabled and you want it to resume. While no explicit when-not-to-use or alternative tools are mentioned, the context is intuitive given the naming and sibling tools like 'disable_schedule'.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

enable_userA

Re-enable a previously disabled iSuite user account.

ParametersJSON Schema
NameRequiredDescriptionDefault
userIdYesThe user's unique ID or username.

TDQS

A3.8/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Discloses the action of re-enabling a previously disabled account, but lacks details on permissions, reversibility, or side effects. No annotations to supplement.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, front-loaded with the core action and resource, no unnecessary words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Adequate for a simple tool with one parameter; could mention return type or confirmation message, but not essential given the tool's simplicity.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema already documents the userId parameter with 100% coverage. Description adds no extra meaning beyond what the schema provides.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states verb 're-enable' and resource 'previously disabled iSuite user account', distinguishing it from siblings like disable_user, create_user, and delete_user.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Implied usage for re-enabling disabled users, but no explicit when-to-use, when-not-to-use, or alternative tools (e.g., create_user for new users).

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

export_audit_trailC

Export audit trail logs for a given date range to a downloadable file.

ParametersJSON Schema
NameRequiredDescriptionDefault
dateFromYesISO-8601 start datetime for the export.
dateToNoISO-8601 end datetime for the export.
formatNoExport file format (default 'csv').
userIdNoOptional: restrict export to a specific user's activity.
actionNoOptional: restrict export to a specific action type.

TDQS

C2.9/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations provided. The description does not disclose behavior like synchronicity, download mechanism, data limits, or required permissions. Minimal behavioral info.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, no fluff. However, it could be slightly more informative without sacrificing conciseness.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With 5 parameters and no output schema, the description is too sparse. Missing details about output format, download process, and optional filter behavior.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so parameters are already well-documented. The description adds the context of 'date range' but does not add meaning beyond the schema for format, userId, or action.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action (export), resource (audit trail logs), and scope (date range). It distinguishes from siblings like get_audit_log or search_audit_logs by implying file download, but does not explicitly differentiate.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives (e.g., search_audit_logs, get_audit_log). No context about prerequisites or scenarios.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get_audit_logB

Get the full details of a single audit log entry by its ID.

ParametersJSON Schema
NameRequiredDescriptionDefault
logIdYesThe unique audit log entry ID.

TDQS

B3.4/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries the full burden. It only states the tool retrieves full details, but does not disclose any behavioral traits such as being read-only, required permissions, error handling, or rate limits. For a retrieval tool, this is minimal.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, efficient sentence with no filler. It is front-loaded with the verb and resource. A higher score would require additional useful context without being verbose.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The tool has one parameter, no output schema, and no annotations. The description is brief but adequate for a simple retrieval tool. However, it lacks hints about the return value format or structure (e.g., 'full details' is vague). Given the many sibling tools, more context about when this tool is useful would improve completeness.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The schema description coverage is 100% for the single parameter 'logId', so the schema already documents it. The description adds no additional meaning beyond the schema's description. Baseline score of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action ('Get'), the resource ('full details of a single audit log entry'), and the method ('by its ID'). It distinguishes from sibling tools like search_audit_logs that retrieve multiple entries.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit when-to-use or alternatives are provided. The description implies usage for a specific audit log ID, but does not mention when to use search_audit_logs instead. Context is clear but lacks exclusion guidelines.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get_batch_historyB

Get the complete execution history for a batch job definition.

ParametersJSON Schema
NameRequiredDescriptionDefault
batchDefinitionIdYesThe batch definition ID (not execution ID) to retrieve history for.
limitNoNumber of past executions to return (default 20).
includeMetricsNoInclude throughput/timing metrics for each run (default false).

TDQS

B3.2/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries full burden. It correctly implies a read operation (get) but does not detail what 'complete execution history' means (e.g., fields returned, pagination, or any side effects). Adequate but lacks depth.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single concise sentence, easy to parse. However, it could include slightly more detail without becoming verbose, so not a perfect 5.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool has three well-documented parameters and no output schema, the description is minimally sufficient. It lacks context about the output format, typical use cases, or any limitations, leaving gaps for a complex tool.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so each parameter already has a description. The tool description adds no new semantic meaning beyond restating the resource; baseline 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool retrieves the complete execution history for a batch job definition, which distinguishes it from siblings like get_batch_status (current status) and get_job_history (individual job history). However, it does not elaborate on what the history includes.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus other history or status tools, such as get_batch_status for current state or get_schedule_history for scheduled runs. The agent must infer from context alone.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get_batch_statusA

Get the current execution status and progress details of a specific iSuite batch job.

ParametersJSON Schema
NameRequiredDescriptionDefault
batchIdYesThe unique batch execution ID.
includeStepsNoInclude individual step/chunk status details (default false).

TDQS

A3.8/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description bears full responsibility. It states the operation is reading status and progress, but lacks disclosure of permissions, side effects, or data size implications. Adequate but not thorough.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, clear sentence with no unnecessary words. It is front-loaded and trim, effectively communicating the tool's function.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a tool with two parameters and no output schema, the description is fairly complete. However, it could elaborate on what 'progress details' includes (e.g., steps, percentages) to fully inform agent expectations.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with both parameters described. The description does not add meaning beyond the schema; it only reinforces the tool's purpose. Baseline score of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'Get' and the resource 'execution status and progress details of a specific iSuite batch job'. It differentiates from siblings like get_batch_history by specifying 'current' status and 'progress details'.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies use for current batch status but does not explicitly state when to use this tool versus alternatives like get_batch_history or get_job_status. No exclusions or context provided.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get_config_valueA

Retrieve the current value of a specific iSuite configuration key.

ParametersJSON Schema
NameRequiredDescriptionDefault
keyYesDot-notation config key (e.g. 'database.pool.maxSize', 'scheduler.maxConcurrentJobs').
includeMetadataNoInclude metadata such as last-modified time, modified-by, and description (default false).

TDQS

A3.5/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations provided; description lacks behavioral details such as error handling when key is missing, whether results are cached, or authentication requirements.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, no extraneous information; perfectly concise.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Adequate for a simple read tool, but missing context on response shape (e.g., structure with metadata) and error cases; no output schema to compensate.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema covers both parameters with descriptions (100% coverage), so baseline applies; description adds no extra parameter meaning beyond schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Clear verb ('Retrieve') and specific resource ('current value of a specific iSuite configuration key') clearly distinguish it as a read operation from siblings like update_config_value and validate_config.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Implied usage for reading config values, but no explicit guidance on when to use vs alternatives (e.g., list_config_keys, compare_configs) or prerequisites.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get_job_historyB

Get the execution history for a specific job definition (all past runs).

ParametersJSON Schema
NameRequiredDescriptionDefault
jobDefinitionIdYesThe job definition ID (not execution ID) to retrieve history for.
limitNoNumber of historical runs to return (default 20).
includeStepsNoInclude individual step results for each run (default false).

TDQS

B3.3/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries full burden. It states 'all past runs', but the limit parameter contradicts this. It does not disclose pagination behavior, return format, or whether it is read-only. Significant gaps remain about the tool's behavior beyond the purpose.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, front-loaded sentence that efficiently conveys the core purpose. It is appropriately sized, though it could include a brief note about the limit parameter without being verbose.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given three parameters and no output schema, the description should provide more context about return values, pagination, and how parameters like limit interact with 'all past runs'. It lacks sufficient detail for an agent to fully understand the tool's behavior without additional inference.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with descriptions for all three parameters. The tool description adds no additional meaning beyond what the schema provides, meeting the baseline for high coverage.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool retrieves execution history for a specific job definition, using the verb 'get' and specifying the resource 'execution history'. It distinguishes from sibling tools like get_job_status (current state) and get_batch_history (batch runs) by explicitly mentioning 'all past runs' for a job definition.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage when needing past runs for a job definition, but does not explicitly state when not to use it or mention alternatives like get_job_status. Given the large sibling set, more explicit guidance would help, but the purpose is clear enough.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get_job_statusC

Get the current execution status and details of a specific iSuite job.

ParametersJSON Schema
NameRequiredDescriptionDefault
jobIdYesThe unique job execution ID.

TDQS

C2.9/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries full responsibility for behavioral disclosure. It only states that the tool returns 'current execution status and details', but does not specify what fields are returned, whether it is a snapshot or real-time, or any side effects. The behavioral transparency is insufficient.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is concise, a single sentence with no extraneous words. It is front-loaded and easy to parse. Could be improved with a bit more structure, but current form is acceptable.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a one-parameter tool with no output schema, the description is minimally adequate. However, it omits what 'details' entails, leaving ambiguity about the return format. In the context of many sibling tools, it could be more descriptive.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, and the description does not add any meaning beyond what the input schema already provides for 'jobId'. The baseline is 3; no extra value added.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'Get' and the resource 'current execution status and details of a specific iSuite job'. It is unambiguous. However, it does not differentiate from sibling tools like 'get_job_history' or 'list_running_jobs' which may have overlapping functionality.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is given on when to use this tool versus alternatives. There is no mention of prerequisites, typical use cases, or context where this tool is appropriate. The agent receives no help in decision-making.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get_login_historyB

Retrieve login and logout events for users, including failed login attempts.

ParametersJSON Schema
NameRequiredDescriptionDefault
userIdNoOptional: filter by specific user. Omit to get system-wide login events.
dateFromNoISO-8601 start datetime.
dateToNoISO-8601 end datetime (default: now).
includeFailuresNoInclude failed login attempts (default true).
limitNoMaximum results to return (default 50).

TDQS

B3.2/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries full burden. It only states the core functionality without disclosing behavioral traits like pagination, ordering, rate limits, permission requirements, or whether data is real-time. The limit parameter is mentioned in schema but not in description.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single concise sentence that front-loads the action and resource. Every word contributes to the purpose, with no wasted text.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With 5 parameters and no output schema, the description lacks details on return format, sorting, time range behavior, or how results are structured. Sibling tools like get_audit_log or search_audit_logs are likely more descriptive, making this incomplete for agent use.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so baseline is 3. The description adds no additional meaning beyond the schema; it echoes the includeFailures concept but does not clarify formats, defaults, or relationships between parameters.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states 'Retrieve login and logout events for users, including failed login attempts.' It uses a specific verb (retrieve) and resource (login/logout events) and distinguishes from sibling tools like get_audit_log or search_audit_logs by focusing on login-specific events.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit guidance on when to use this tool versus alternatives such as get_audit_log or search_audit_logs. The description does not mention prerequisites, filters, or when to prefer this over other tools.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get_roleB

Get full details of a specific iSuite role including all its permissions.

ParametersJSON Schema
NameRequiredDescriptionDefault
roleIdYesThe role's unique ID or name.

TDQS

B3.4/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries full burden. It correctly implies a read-only operation ('Get'), but does not disclose any additional behavioral traits like required permissions, data freshness, or rate limits. Adequate but not rich.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, 11 words, front-loaded with verb and resource. No filler. Perfectly concise for the simplicity of the tool.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple get tool with one parameter, the description covers purpose and hint of return value ('including all its permissions'). Without an output schema, this is sufficient. Could mention return format but not necessary.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100% (roleId described). The tool description adds no new parameter info beyond the schema. Baseline 3 applies; no extra value provided.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

Clear verb 'Get' and resource 'full details of a specific iSuite role including all its permissions'. Distinguishes from siblings like list_roles (list) and get_user_roles (for a user). Could be more explicit about what 'full details' entails beyond permissions.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives. Does not mention when not to use it, nor relate it to siblings like assign_role or revoke_role. An agent would need to infer context from the name alone.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get_scheduleA

Get full details of a specific iSuite schedule including cron expression and next run time.

ParametersJSON Schema
NameRequiredDescriptionDefault
scheduleIdYesThe unique schedule ID.

TDQS

A3.7/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description must cover behavioral traits. It only states 'get full details', implying read-only, but does not disclose any side effects, authorization requirements, rate limits, or error conditions. This is minimal transparency.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, concise sentence with no filler. It front-loads the purpose and key details, earning its place.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given no output schema, the description should enumerate what 'full details' includes. It only mentions two fields (cron expression, next run time). There is no mention of error handling, prerequisites, or other returned data. Adequate but incomplete.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100% for the single parameter (scheduleId). The description adds 'including cron expression and next run time', which hints at output semantics but adds little beyond the schema. Baseline 3 applies.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'Get' and the resource 'full details of a specific iSuite schedule', including specific fields like cron expression and next run time. This distinguishes it from sibling tools like list_schedules (list all) and get_schedule_history (history only).

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage for retrieving complete details of a single schedule, which is clear. However, it lacks explicit guidance on when not to use it (e.g., for listing all schedules or history) and no mention of alternatives among many sibling tools.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get_schedule_historyB

Get the execution history for a specific schedule showing past runs and their outcomes.

ParametersJSON Schema
NameRequiredDescriptionDefault
scheduleIdYesThe unique schedule ID.
limitNoNumber of past executions to return (default 20).
dateFromNoISO-8601 start date for history query.

TDQS

B3.2/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description must disclose behavioral traits. It only states that it returns past runs and outcomes. It does not mention pagination, ordering, whether scheduled but unexecuted runs are included, or any authentication requirements.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence of 14 words, front-loaded with the key action and resource. Every word earns its place with no redundancy.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given there are 3 parameters and no output schema, the description is too terse. It does not explain the return format, how parameters like 'limit' and 'dateFrom' affect the output, or provide enough context for an agent to correctly interpret results.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so baseline is 3. The description adds minimal context beyond the schema, simply reiterating that the tool gets history for a schedule. No additional semantic value is provided for the parameters.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action (Get) and the resource (execution history for a specific schedule), and indicates what is shown (past runs and outcomes). This distinguishes it from sibling tools like 'get_schedule' or 'get_job_history'.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus alternatives like 'get_batch_history' or 'get_job_history'. There is no mention of prerequisites, common use cases, or when not to use it.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get_scheduler_statusA

Get the overall iSuite scheduler engine status — whether it is running, paused, or in standby.

ParametersJSON Schema
NameRequiredDescriptionDefault

No parameters

TDQS

A3.8/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The description discloses that the tool returns the scheduler status as one of three states, which is useful. However, since no annotations are present, the description carries full burden and omits details like whether the operation is read-only, requires permissions, or has rate limits. It is adequate but not comprehensive.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence of 12 words, front-loaded with the action and resource. There is no extraneous text.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The description sufficiently explains what the tool returns (status values) for a simple status-check tool with no parameters. It could be slightly more informative about what 'standby' means, but overall it is complete for its simplicity.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

There are no parameters, and schema coverage is trivially 100%. The description does not need to add parameter meaning. It appropriately focuses on the output, which is helpful given the lack of an output schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description uses a specific verb 'get' and resource 'iSuite scheduler engine status', and lists three possible states (running, paused, standby). This clearly distinguishes it from sibling tools like check_system_health or get_batch_status, which target different resources.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides no guidance on when to use this tool versus alternatives like check_system_health or get_batch_status. It simply states what the tool does without any explicit usage context or exclusions.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get_userB

Get detailed information for a specific iSuite user by their ID or username.

ParametersJSON Schema
NameRequiredDescriptionDefault
userIdYesThe user's unique ID or username.

TDQS

B3.4/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries the full burden. It only states the basic operation without disclosing that it is a read-only operation, what specific fields are returned, authentication needs, or any side effects. This is minimal for a tool that likely retrieves sensitive user data.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence of 12 words, front-loaded with the action and resource. Every word is necessary and there is no redundancy.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given no output schema, the description should convey what 'detailed information' means. It fails to specify the structure or typical fields of the response (e.g., name, email, status). This leaves the agent unclear about what to expect.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% and the single parameter 'userId' already has a description stating it can be ID or username. The description adds no new semantic information beyond what the schema provides, so the baseline score of 3 applies.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'Get' and resource 'detailed information for a specific iSuite user', and specifies identification by ID or username. This distinguishes it from sibling tools like list_users which lists all users, or get_user_roles which focuses on roles.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage when needing detailed information for a single user, but provides no explicit guidance on when to use this tool versus alternatives like get_user_roles or verify_user_permission. No exclusions or conditions are stated.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get_user_rolesA

List all roles currently assigned to an iSuite user.

ParametersJSON Schema
NameRequiredDescriptionDefault
userIdYesThe user's unique ID or username.

TDQS

A3.6/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The description does not disclose behavioral traits beyond the simple read operation. With no annotations, it should mention permissions needed, rate limits, or output format. The description is minimal.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

A single, concise sentence that immediately conveys the tool's purpose with no superfluous information.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's simplicity (one parameter, no output schema), the description is nearly complete. It lacks output format details, but for a list operation, the purpose is clear enough.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100% for the userId parameter. The description adds no new meaning beyond the schema; it just restates the parameter's purpose. Baseline 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action (list), resource (roles), and scope (currently assigned to an iSuite user). It distinguishes from sibling tools like assign_role, revoke_role, and list_roles which have different purposes.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies when to use (when needing roles for a specific user) but does not explicitly state when not to use or provide alternatives such as get_role for a single role detail or list_roles for all roles.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list_batch_jobsA

List iSuite batch jobs filtered by status and time range.

ParametersJSON Schema
NameRequiredDescriptionDefault
statusNoFilter by batch status (default 'all').
batchTypeNoFilter by batch type (e.g. 'reconciliation', 'data-load', 'export', 'purge').
dateFromNoISO-8601 start datetime for query window.
dateToNoISO-8601 end datetime (default: now).
limitNoMaximum results to return (default 50).

TDQS

A3.7/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations provided, so description must cover behavior. It discloses filtering options but lacks details on default sorting, pagination, or authorization needs. Adequate but not thorough.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

One concise sentence that front-loads the key purpose. No redundant information.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Adequately describes the tool for a list operation with 5 parameters covered by schema. Lacks details on return structure or ordering, but sufficient for basic use.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema has 100% description coverage, so baseline is 3. Description does not add additional semantic meaning beyond what the schema already provides.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states verb 'List' and resource 'iSuite batch jobs', with filtering by status and time range. Distinguishes from sibling tools like list_running_batches and list_completed_jobs.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit when-to-use or alternatives are mentioned. The description implies it is for filtered queries, but does not guide when to use more specific siblings.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list_completed_jobsB

List successfully completed iSuite jobs within a time range.

ParametersJSON Schema
NameRequiredDescriptionDefault
dateFromNoISO-8601 start datetime.
dateToNoISO-8601 end datetime (default: now).
jobTypeNoFilter by job type.
limitNoMaximum results to return (default 50).

TDQS

B3.2/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations provided, so the description carries full burden. It states it lists 'successfully completed' jobs but does not disclose behavior traits like pagination, ordering, default limit (50), or whether the operation is read-only (implied but not explicit). Lacks transparency for a list operation.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, no redundant information. Front-loaded with the key action and resource. Could be improved by structuring into context and behavior, but remains efficient.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With 4 parameters and no output schema, the description should provide more context about return format, pagination, or default behavior (e.g., limit default 50). The tool is moderately complex but the description is minimal, leaving gaps for an AI agent.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with descriptive parameter names (dateFrom, dateTo, jobType, limit) and descriptions, so the added value from the description is minimal. The description mentions 'time range' but does not elaborate on parameter formats or constraints beyond the schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states the tool lists 'successfully completed iSuite jobs within a time range', specifying verb (list), resource (completed jobs), and scope (time range). The word 'successfully' distinguishes it from siblings like list_failed_jobs.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit when-to-use or when-not-to-use guidance, but the presence of sibling tools (list_failed_jobs, list_running_jobs) implies it's for completed jobs only. The description does not mention prerequisites or alternatives.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list_config_keysB

List all available iSuite configuration keys, optionally filtered by section.

ParametersJSON Schema
NameRequiredDescriptionDefault
sectionNoConfig section prefix to filter by (e.g. 'database', 'scheduler', 'security').
includeDefaultsNoInclude keys that are set to their default values (default true).
includeSecretsNoInclude secret/password keys (values will be masked, default false).

TDQS

B3.4/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries full burden. It does not disclose that the tool is read-only, safe to call, or any potential impacts like rate limits. Minimal behavioral context provided.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence with no wasted words. Clear and direct.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given three parameters and no output schema or annotations, the description is too minimal. It omits details like return format, pagination, ordering, or examples, which are important for an agent to invoke correctly.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so baseline is 3. The description only echoes the filtering by section; it adds no extra meaning for includeDefaults or includeSecrets beyond their schema descriptions.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states the tool lists config keys with optional filtering by section. The verb 'list' and resource 'configuration keys' are specific, distinguishing it from sibling tools like get_config_value or compare_configs.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit guidance on when to use this tool versus alternatives like get_config_value or compare_configs. Filtering by section is mentioned, but no context on when filtering is needed or when to avoid this tool.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list_failed_jobsB

List iSuite jobs that have failed within a given time range.

ParametersJSON Schema
NameRequiredDescriptionDefault
dateFromNoISO-8601 start datetime for the query window.
dateToNoISO-8601 end datetime for the query window (default: now).
jobTypeNoFilter by job type.
limitNoMaximum results to return (default 50).

TDQS

B3.4/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries the full burden. It does not disclose behavioral traits such as side effects, default limit, pagination, authentication requirements, or return format. It merely restates the purpose without adding behavioral context.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single 11-word sentence that is front-loaded with the verb and resource, making it highly efficient and easy to scan.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool has 4 parameters, no output schema, and no annotations, the description is insufficient. It lacks information about default limits, ordering, error handling, or permissions, leaving the agent underinformed.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the schema already documents all parameters. The description adds the context of 'within a given time range' which maps to dateFrom and dateTo, but does not add significant meaning beyond the schema. Baseline score of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'List', the resource 'iSuite jobs that have failed', and the scope 'within a given time range'. It distinctively describes the tool's function, differentiating it from siblings like list_completed_jobs or list_running_jobs.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit guidance on when to use this tool versus alternatives. The description implies usage for failed jobs, but does not provide context for when not to use it or suggest sibling tools.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list_recent_changesB

List recent system-level changes (config updates, role changes, schedule modifications) within a time window.

ParametersJSON Schema
NameRequiredDescriptionDefault
hoursNoLook-back window in hours (default 24).
changeTypesNoFilter by change types: 'config', 'role', 'schedule', 'user', 'batch'.
limitNoMaximum results to return (default 50).

TDQS

B3.2/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations provided, the description carries the full burden of behavioral disclosure. It only states the action and resource, but does not mention permissions, rate limits, data freshness, or side effects. This is insufficient for an agent to understand the tool's behavior.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence that efficiently conveys the core function. It is concise and front-loaded with the key action, though it could be restructured to highlight important details like filtering capabilities earlier.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's simplicity (3 parameters, no output schema), the description provides sufficient context for what it lists but lacks details about return format, ordering, or pagination. It is adequate but not fully complete.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the baseline is 3. The description adds no extra meaning beyond the schema's parameter descriptions; it only reiterates the time window concept. Thus, it meets but does not exceed the baseline.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'list' and the resource 'recent system-level changes', with specific examples (config updates, role changes, schedule modifications). It distinguishes from sibling tools by focusing on system-level changes over a time window, which is unique among the listed siblings.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description does not provide any guidance on when to use this tool versus alternatives. It mentions a time window but lacks explicit when-to-use, when-not-to-use, or comparison to siblings like get_audit_log or list_user_activity.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list_role_membersB

List all users who currently hold a specific role.

ParametersJSON Schema
NameRequiredDescriptionDefault
roleIdYesThe role's unique ID or name.
limitNoMaximum number of users to return (default 100).

TDQS

B3.1/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The description does not disclose any behavioral traits beyond the basic action. It does not mention read-only nature, pagination, or potential errors. With no annotations, the description carries full burden but provides only minimal info.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single clear sentence that is front-loaded and contains no unnecessary words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple read tool with two parameters and no output schema, the description is adequate but lacks details on output format, pagination behavior, and error handling.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% and the description adds no extra meaning. For 'roleId' and 'limit', the schema definitions are sufficient. Baseline of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool lists users for a specific role. It distinguishes from siblings like 'assign_role' or 'revoke_role', though it does not explicitly call out alternatives.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives like 'get_user_roles' or 'list_roles'. The context is implied but not stated.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list_rolesA

List all available roles defined in iSuite.

ParametersJSON Schema
NameRequiredDescriptionDefault
includePermissionsNoInclude the full permission list for each role (default false).

TDQS

A3.8/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The description implies a read-only, non-destructive operation by using 'List'. With no annotations provided, the description covers the basic behavioral trait. However, it does not disclose potential pagination, performance characteristics, or any limits on the number of roles returned.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, clear sentence with no extraneous information. It is appropriately front-loaded and earns its place.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's simplicity (one optional boolean param, no output schema), the description is mostly complete. It lacks details on the return structure or role representation, but for a list tool this is acceptable.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema has 100% coverage with its single param described. The tool description adds no additional semantics beyond the schema's own description of 'includePermissions'. Baseline 3 applies as schema does the work.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'List' and the resource 'all available roles defined in iSuite'. It effectively distinguishes from sibling tools like 'get_role' (single role) and 'list_role_members' (membership list), making the tool's purpose unambiguous.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus alternatives. For example, it does not mention that this lists all roles without filtering, unlike 'get_user_roles' which lists roles for a specific user. Users must infer context from the name alone.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list_running_batchesB

List all currently running iSuite batch jobs with live progress metrics.

ParametersJSON Schema
NameRequiredDescriptionDefault
batchTypeNoFilter by batch type.

TDQS

B3.3/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description must convey behavioral traits. It only states the function and mentions 'live progress metrics' but does not disclose non-destructiveness, permissions, or how metrics are returned. This is insufficient.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence that is efficient and directly states the purpose. No redundant or irrelevant information.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The tool has one optional parameter and no output schema. The description mentions 'live progress metrics' but does not describe the return format or fields. Enough for a simple list endpoint but could be more complete.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the baseline is 3. The description does not add any extra meaning beyond the schema's 'Filter by batch type.' No additional context about valid values or defaults is provided.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'list', the resource 'iSuite batch jobs', and a distinguishing feature 'live progress metrics'. It differentiates from siblings like 'list_running_jobs' by specifying batch-level jobs.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No usage guidelines provided. The tool description does not indicate when to use this vs alternatives such as 'list_batch_jobs' or 'get_batch_status', leaving the agent without context for selection.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list_running_jobsC

List all currently running iSuite jobs.

ParametersJSON Schema
NameRequiredDescriptionDefault
jobTypeNoFilter by job type (e.g. 'etl', 'report', 'sync', 'reconciliation').
submittedByNoFilter by username who submitted the job.
limitNoMaximum results to return (default 50).

TDQS

C2.9/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations provided, so description bears full burden. It discloses nothing beyond the obvious: it lists running jobs. No mention of pagination, ordering, authentication needs, or side effects.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Extremely concise (single sentence), but lacks structure and additional context that would help without adding verbosity. Could include brief usage hints.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

No output schema; description doesn't mention return format (e.g., list of job objects with IDs, statuses). For a tool with 3 optional parameters and no annotations, more details on filtering behavior (e.g., defaults) would be helpful.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the schema already documents all parameters well. Description adds no extra meaning or context beyond what's in the schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description uses a specific verb-resource pair ('List' + 'running jobs') and clearly states it's for iSuite jobs. It distinguishes from siblings like list_completed_jobs and list_failed_jobs by specifying 'running'.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool over other list tools (e.g., list_completed_jobs, list_upcoming_jobs). No hints about prerequisites or alternative approaches.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list_schedulesC

List all defined iSuite job schedules.

ParametersJSON Schema
NameRequiredDescriptionDefault
statusNoFilter by schedule status (default 'all').
jobTypeNoFilter by associated job type.
limitNoMaximum results to return (default 100).

TDQS

C2.8/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description must fully disclose behavior. It states 'list all defined' but the schema includes filters (status, jobType, limit), which is not mentioned. There is no information about read-only nature, pagination, or potential performance implications.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness3/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence with no fluff, which earns its place. However, it is too terse and could benefit from additional context without becoming verbose.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool has 3 optional filter parameters and no output schema, the description lacks details on filtering behavior, default status, and output format. It does not differentiate well from sibling list tools that might also return schedule-like objects.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema has 100% description coverage for its 3 parameters, so the schema already documents them. The description adds no additional meaning beyond the schema since it only says 'list all defined schedules' without explaining how parameters modify the result.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description uses a specific verb ('List') and resource ('iSuite job schedules'), clearly indicating the tool's purpose. It distinguishes from the sibling tool 'get_schedule' which retrieves a single schedule, though it does not explicitly differentiate from other list tools.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides no guidance on when to use this tool versus alternatives such as 'list_batch_jobs' or 'list_running_jobs'. There are no usage conditions, prerequisites, or exclusions mentioned.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list_upcoming_jobsA

List jobs scheduled to run within a future time window.

ParametersJSON Schema
NameRequiredDescriptionDefault
hoursAheadNoLook-ahead window in hours (default 24, max 168).
jobTypeNoFilter by job type.
limitNoMaximum results to return (default 50).

TDQS

A3.5/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries the full burden. It states the tool lists scheduled jobs, implying a read-only operation, but does not disclose any additional behavioral traits such as authentication requirements, rate limits, or whether the list includes only active schedules. The description is sufficient but not thorough for a tool with no annotation support.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

A single sentence of 12 words that efficiently conveys the tool's purpose. Every word is necessary; no redundancy or filler. It is front-loaded with the key action and resource.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given no output schema and simple optional parameters, the description is minimally adequate. It does not explain return format, whether the results are ordered, or any error conditions. However, for a straightforward list tool with clear schema, it is not severely lacking but could be improved.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the input schema already documents all three parameters. The description adds no new semantic detail beyond restating the time window concept. Per guidelines, baseline score is 3 when schema coverage is high, and no extra value is provided.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description uses the specific verb 'List' and the resource 'jobs scheduled to run within a future time window', which clearly distinguishes it from sibling list tools like list_running_jobs, list_completed_jobs, etc. It specifies the temporal scope, making the tool's purpose unambiguous.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit guidance on when to use this tool versus alternatives. While the name and description imply it's for upcoming scheduled jobs, there is no mention of when not to use it or which sibling tools cover other scenarios (e.g., running, completed, failed jobs). This forces the agent to infer usage from context alone.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list_user_activityB

List all audit log entries for a specific user within a time range.

ParametersJSON Schema
NameRequiredDescriptionDefault
userIdYesThe user ID or username to retrieve activity for.
dateFromNoISO-8601 start datetime.
dateToNoISO-8601 end datetime (default: now).
limitNoMaximum results to return (default 100).

TDQS

B3.2/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations provided, and the description does not disclose behavioral traits (e.g., permissions required, return format, pagination behavior beyond the limit parameter, ordering). The description is too minimal.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, no unnecessary words, front-loaded with key information.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a tool with 4 parameters and no output schema, the description is too brief. It does not explain what properties the returned entries contain, nor does it clarify how the limit and date range interact, especially given many sibling tools with similar purpose.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the schema already documents parameters. The description does not add extra meaning beyond reinforcing the scope, but it is adequate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'list', resource 'audit log entries', and scope 'for a specific user within a time range', making it distinct from siblings like search_audit_logs or get_audit_log.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives such as search_audit_logs or export_audit_trail. No context for exclusions or prerequisites.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list_usersA

List all iSuite users with optional filtering by status or role.

ParametersJSON Schema
NameRequiredDescriptionDefault
statusNoFilter users by account status. Defaults to 'all'.
roleNoFilter users by assigned role name.
limitNoMaximum number of users to return (default 50, max 200).
offsetNoPagination offset (default 0).

TDQS

A3.5/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations provided, and description only restates the purpose. Does not disclose pagination behavior, authentication requirements, or any side effects.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, efficient and front-loaded with main action. No wasted words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Adequate for a simple list tool with self-explanatory parameters, but lacks explanation of return format or pagination behavior.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema already describes all 4 parameters in detail (100% coverage). Description adds no new semantics beyond restating status and role filtering.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Clearly states the action (list), the resource (iSuite users), and the scope (all with optional filtering by status/role). Distinguishes from siblings like get_user.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Implied usage for listing users with filters, but no explicit guidance on when to use vs alternatives like search_audit_logs or other list tools.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

rerun_batchA

Re-execute a failed or cancelled batch job, optionally with parameter overrides.

ParametersJSON Schema
NameRequiredDescriptionDefault
batchIdYesThe batch execution ID to rerun.
fromFailedStepNoResume from the failed step rather than restarting entirely (default true).
overrideParamsNoOptional parameter overrides for the re-run.
priorityNoExecution priority for the re-run (default 'normal').

TDQS

A4/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations provided, so description carries full burden. It discloses re-execution with overrides but does not specify side effects, authorization needs, or what happens to the original batch. Minimal but adequate.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence with no wasted words, front-loaded essential information. Perfectly concise.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Simple tool with 4 params and no output schema, description covers core purpose but lacks details on return values or post-rerun behavior. Still adequate for straightforward use.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, and description adds little beyond saying 'with parameter overrides'. Schema already documents each param well; description provides no further detail on behavior of fromFailedStep or priority.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states the verb 'Re-execute' and resource 'failed or cancelled batch job', with optional parameter overrides. It effectively distinguishes this tool from siblings like retry_job and cancel_batch.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Explicitly states when to use (for failed/cancelled batch jobs) and mentions optional overrides, but lacks comparison to alternatives like retry_job or conditions where it should not be used.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

reset_user_passwordA

Trigger a password reset for an iSuite user (sends reset email or returns temp password).

ParametersJSON Schema
NameRequiredDescriptionDefault
userIdYesThe user's unique ID or username.
sendEmailNoSend reset link via email (default true). If false, returns a temporary password.

TDQS

A3.7/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries the full burden. It explains the two behaviors based on sendEmail but does not disclose side effects like immediate invalidation of current password, security considerations, or prerequisites (e.g., user must exist). Adequate but incomplete.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence conveying the essential action and two outcomes—no wasted words. Perfectly concise.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

No output schema is provided, and the description does not specify the return format or error conditions. The description covers the basic behavior but is incomplete for a mutation tool that may have side effects.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with detailed parameter descriptions. The tool description adds no new information beyond what the schema already provides (e.g., sendEmail behavior is already in schema). Baseline 3 applies.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool triggers a password reset for an iSuite user, specifying two outcomes (sends email or returns temp password). It distinguishes from siblings like update_user or create_user by focusing on password reset.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies the tool is for password resets but does not explicitly state when to use it versus alternatives (e.g., update_user for direct password change). No exclusions or context provided.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

retry_jobC

Retry a failed iSuite job, optionally from a specific step.

ParametersJSON Schema
NameRequiredDescriptionDefault
jobIdYesThe failed job execution ID to retry.
fromStepNoOptional step name/ID to resume from (default: restart from beginning).
overrideParamsNoOptional parameter overrides for the retry execution.

TDQS

C2.9/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations provided, so description must disclose behavior. It mentions only the core action without detailing state requirements, side effects, or error handling (e.g., what if job is not failed).

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence, concise and front-loaded. However, it could be slightly more detailed without becoming verbose.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

No output schema, and the description lacks details about return values, error states, or behavior with nested parameters. Given the complexity of the tool (overrideParams object), more context is needed.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with clear parameter descriptions. The tool description adds minimal extra meaning beyond the schema, meeting the baseline for high coverage.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action (retry) and resource (failed iSuite job) with an optional step. It distinguishes from sibling tools like cancel_job but does not explicitly differentiate from rerun_batch, which is for batches.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives like cancel_job or rerun_batch. The description fails to mention prerequisites or conditions under which retry is appropriate.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

revoke_roleB

Remove a role from an iSuite user.

ParametersJSON Schema
NameRequiredDescriptionDefault
userIdYesThe user's unique ID or username.
roleIdYesThe role's unique ID or name to revoke.
reasonNoReason for revocation (recorded in audit log).

TDQS

B3.3/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations provided, so description carries full burden. It mentions audit log recording for the reason, adding some transparency, but lacks details on permissions, reversibility, or side effects.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

One efficient sentence with no waste, though it could include more detail without losing conciseness.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

No output schema, so description should hint at return values or confirmation; it doesn't. Also missing error handling or prerequisite context, making it incomplete for an admin tool.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so baseline 3. Description does not add extra meaning beyond the schema's parameter descriptions (e.g., ID formats).

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'remove' and the resource 'role from an iSuite user', distinguishing it from siblings like 'assign_role' (add) and 'get_user_roles' (list).

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives, such as when to revoke vs. assign roles. No prerequisites or context provided.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

search_audit_logsB

Search iSuite audit trail logs with flexible filtering across users, actions, and time ranges.

ParametersJSON Schema
NameRequiredDescriptionDefault
queryNoFree-text search query against log message and metadata fields.
userIdNoFilter logs by the user who performed the action.
actionNoFilter by action type (e.g. 'LOGIN', 'USER_CREATE', 'JOB_CANCEL', 'CONFIG_UPDATE').
resourceTypeNoFilter by resource type (e.g. 'user', 'job', 'batch', 'schedule', 'config').
resourceIdNoFilter by specific resource ID.
dateFromNoISO-8601 start datetime for the search window.
dateToNoISO-8601 end datetime (default: now).
outcomeNoFilter by outcome of the action (default 'all').
limitNoMaximum results to return (default 100, max 1000).
offsetNoPagination offset (default 0).

TDQS

B3.1/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations present; description does not disclose behavior such as read-only nature, pagination defaults, or permission requirements. 'Flexible filtering' is vague.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

One concise sentence front-loading the purpose. Efficient but slightly vague on 'flexible filtering' details.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With 10 parameters and no output schema or annotations, the description is too brief. Missing details on return format, pagination behavior, and usage examples.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with clear parameter descriptions. The tool description adds only generic context ('flexible filtering'), not meaningfully beyond schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool searches audit trail logs with flexible filtering, distinguishing it from sibling tools like get_audit_log (single log) and export_audit_trail (export).

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives (e.g., export_audit_trail, get_audit_log). No exclusion criteria or context provided.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

update_config_valueC

Update a specific iSuite configuration value. Requires appropriate admin permissions.

ParametersJSON Schema
NameRequiredDescriptionDefault
keyYesDot-notation config key to update.
valueYesNew value to set. Type must match the key's expected type.
reasonNoReason for the change (recorded in audit log).
restartRequiredNoWhether this change requires a service restart to take effect.

TDQS

C2.9/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries the full burden. It discloses mutation and admin permission requirement, but omits critical behaviors: whether changes are audited (despite 'reason' parameter), what happens if the key doesn't exist, type validation details, or if restartRequired is enforced. The description is insufficient for safe invocation.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence with no redundancy, achieving high conciseness. However, it sacrifices completeness by omitting key behavioral details. It earns a 4 for efficiency but loses a point for being overly terse.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's complexity (mutation, audit, restart implications) and no output schema, the description is too brief. It fails to explain return values, error states, or when restart is needed. More context is necessary for an agent to use this tool correctly.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so the baseline is 3. The description adds no extra meaning beyond what the parameter descriptions already provide (e.g., dot-notation format, expected type matching, audit reason). It does not improve understanding of parameter usage.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action ('Update') and the resource ('specific iSuite configuration value'), which distinguishes it from read-only or listing tools like get_config_value and list_config_keys. However, it does not explicitly clarify whether the key must already exist or if it can create new entries.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description only mentions a prerequisite ('Requires appropriate admin permissions') but provides no guidance on when to use this tool versus alternatives like compare_configs or validate_config. It lacks context for preferred scenarios or exclusions.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

update_userC

Update an existing iSuite user's profile or settings.

ParametersJSON Schema
NameRequiredDescriptionDefault
userIdYesThe user's unique ID or username.
emailNoNew email address.
fullNameNoNew full display name.
departmentNoNew department or business unit.
managerNoManager's user ID or username.

TDQS

C2.8/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations provided. The description does not disclose whether updates are partial or full replacement, what permissions are required, or if changes are reversible. For a mutation tool, this is insufficient.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness3/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is very concise (one sentence) but lacks structure. It conveys the core purpose without extra details. It could be considered a minimum viable description but not well-structured.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given no annotations, no output schema, and 5 parameters, the description is too sparse. It should explain behavior like whether unspecified fields remain unchanged, timeout implications, or validation rules. The schema covers parameter descriptions but the tool's overall behavior is under-described.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so the parameters are already documented. The description adds no additional meaning beyond grouping them under 'profile or settings', which provides minimal extra context. Baseline 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly identifies the verb 'Update' and the resource 'an existing iSuite user's profile or settings'. It distinguishes from sibling tools like create_user, delete_user, enable_user, etc., by focusing on modification. However, 'profile or settings' is somewhat vague but acceptable.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool vs alternatives. With many sibling tools (e.g., enable_user, reset_user_password), it would be helpful to specify that this is for updating general profile fields, not for actions like password reset or role assignment.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

validate_configA

Validate iSuite configuration settings — checks for missing required values, type mismatches, and invalid references.

ParametersJSON Schema
NameRequiredDescriptionDefault
sectionNoSpecific config section to validate (e.g. 'database', 'scheduler', 'security', 'integrations'). Omit to validate all sections.
strictNoFail on warnings in addition to errors (default false).

TDQS

A3.7/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description must carry the full burden. It discloses the types of checks but does not mention whether the tool is read-only, what the output format is (e.g., list of errors vs. pass/fail), or any side effects. This is adequate but incomplete.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence that is front-loaded with the core purpose and efficiently lists the validation checks. Every word adds value; no unnecessary content.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a tool with two optional parameters and no output schema or annotations, the description is adequate but not complete. It does not indicate whether the tool modifies state (it likely does not), nor does it describe the return value. A more complete description would clarify these aspects.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the schema already documents both parameters. The description adds no additional detail about parameter meaning or usage beyond what the schema provides. Baseline score of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description uses a specific verb-resource pair: 'Validate iSuite configuration settings' and enumerates the types of checks performed (missing required values, type mismatches, invalid references). This clearly distinguishes it from sibling tools like get_config_value or update_config_value.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage for validating configuration settings but does not explicitly state when to use this tool over alternatives, nor does it provide any exclusions or prerequisites. Given the tool's name and context, usage is implied but not guided.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

validate_connectionA

Test and validate a specific iSuite connection configuration (database, API endpoint, SMTP, etc.).

ParametersJSON Schema
NameRequiredDescriptionDefault
connectionIdYesThe named connection ID defined in iSuite configuration.
connectionTypeNoThe type of connection to validate.
timeoutNoConnection timeout in milliseconds (default 10000).

TDQS

A3.5/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations provided, the description partially covers behavior by indicating it's a test/validation operation (non-destructive). However, it does not disclose return values, error handling, authentication needs, or side effects.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, well-structured sentence that front-loads the verb and resource. Every word is necessary; there is no redundancy or filler.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple validation tool with 3 parameters and no output schema, the description is adequate but lacks explanation of return format (success/failure) and whether the tool modifies state. It covers the basics but misses contextual details.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so the description adds minimal value beyond existing parameter descriptions and enum values. It only provides high-level examples of connection types, no additional syntax or constraints.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'Test and validate' and the resource 'iSuite connection configuration', with example types (database, API endpoint, SMTP) that distinguish it from sibling tools like 'validate_config' which deals with config values.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides no guidance on when to use this tool versus alternatives (e.g., validate_config, check_system_health). It does not mention prerequisites, when not to use, or typical scenarios.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

verify_user_permissionA

Check whether a specific user has a given permission. Returns true/false with context.

ParametersJSON Schema
NameRequiredDescriptionDefault
userIdYesThe user's unique ID or username.
permissionYesThe permission identifier to check (e.g. 'jobs.cancel', 'batch.rerun', 'audit.export').
resourceNoOptional specific resource ID to check scoped permission against.

TDQS

A4/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries the full burden. It discloses the return format (true/false with context) and implies no side effects. However, it doesn't mention auth requirements or rate limits, which are acceptable for a simple read operation.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single concise sentence that clearly conveys the tool's purpose and return value. No unnecessary words or fluff.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given no output schema, the description adequately explains the return type but the phrase 'with context' is vague. For a simple boolean check tool, this is sufficient, but could be more precise for clarity.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema has 100% coverage, so baselining at 3. The description does not add extra meaning beyond the schema's parameter descriptions. It succinctly summarizes the function but provides no additional parameter semantics.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action: checking if a user has a specific permission. It specifies the resource (user permission) and the return type (true/false with context), distinguishing it from sibling tools that modify permissions like assign_role or revoke_role.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage for permission verification but lacks explicit guidance on when to use this tool versus alternatives. No mention of prerequisites or when not to use, which would be helpful given the many sibling tools.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Tool Schema Changelog

Recent tool additions, removals, and schema changes observed during successful MCP inspections.

  1. 48 tool updatesv1.0.0
    • First observedassign_role
    • First observedcancel_batch
    • First observedcancel_job
    • First observedcheck_system_health
    • First observedcompare_configs
    • First observedcreate_user
    • First observeddelete_user
    • First observeddisable_schedule
    • First observeddisable_user
    • First observedenable_schedule
    • First observedenable_user
    • First observedexport_audit_trail
    • First observedget_audit_log
    • First observedget_batch_history
    • First observedget_batch_status
    • First observedget_config_value
    • First observedget_job_history
    • First observedget_job_status
    • First observedget_login_history
    • First observedget_role
    • First observedget_schedule
    • First observedget_schedule_history
    • First observedget_scheduler_status
    • First observedget_user
    • First observedget_user_roles
    • First observedlist_batch_jobs
    • First observedlist_completed_jobs
    • First observedlist_config_keys
    • First observedlist_failed_jobs
    • First observedlist_recent_changes
    • First observedlist_role_members
    • First observedlist_roles
    • First observedlist_running_batches
    • First observedlist_running_jobs
    • First observedlist_schedules
    • First observedlist_upcoming_jobs
    • First observedlist_user_activity
    • First observedlist_users
    • First observedrerun_batch
    • First observedreset_user_password
    • First observedretry_job
    • First observedrevoke_role
    • First observedsearch_audit_logs
    • First observedupdate_config_value
    • First observedupdate_user
    • First observedvalidate_config
    • First observedvalidate_connection
    • First observedverify_user_permission

TDQS

B3.3/5.0

Scored across 48 tools

Disambiguation4/5

Tools are generally distinct, with clear descriptions differentiating similar operations like cancel_job vs cancel_batch and list_completed_jobs vs list_failed_jobs. A few pairs could cause confusion if descriptions are skimmed, but overall separation is good.

Naming Consistency5/5

All tools follow a consistent verb_noun (or verb_noun_noun) pattern in snake_case, e.g., create_user, disable_schedule, export_audit_trail. No mixing of conventions, making names predictable and easy to parse.

Tool Count2/5

With 48 tools, the count is excessive per the calibration (25+ being too many). While the server covers multiple subdomains, the sheer number risks overwhelming agents and suggests unnecessary granularity.

Completeness3/5

The server covers user management, jobs, batches, schedules, audit, and configuration, but notable CRUD gaps exist: no create_job, create_batch, or create_schedule. Lifecycle operations are missing for key resources, limiting full workflow coverage.

Maintenance

ActivityInactive
ResponsivenessNo issues

Related MCP Connectors

Related MCP Servers

  • A
    license
    B
    quality
    D
    maintenance
    A Model Context Protocol server that provides comprehensive control over QuickBase operations, allowing users to manage applications, tables, fields, records, and relationships through MCP tools.
    26
    5
    MIT
  • F
    license
    Not graded
    quality
    D
    maintenance
    Provides over 60 administrative tools for managing users, groups, roles, schedules, alerts, and content access within Looker through the Model Context Protocol. It enables full administration of Looker environments, including permission management and system configuration.
    1
    -
  • A
    license
    Not graded
    quality
    D
    maintenance
    Centralized authentication, authorization, and audit for MCP tools. One server governs every downstream MCP your organization uses.
    3
    Apache 2.0
  • F
    license
    Not graded
    quality
    D
    maintenance
    Provides 50+ tools for audit, repair, notifications, GL posting, reporting, and complete Fineract administration — all accessible from any MCP-compatible AI client.
    -