Skip to main content
Glama
mychaelconnolly

phishfort-mcp

██████╗ ██╗  ██╗██╗███████╗██╗  ██╗███████╗ ██████╗ ██████╗ ████████╗
██╔══██╗██║  ██║██║██╔════╝██║  ██║██╔════╝██╔═══██╗██╔══██╗╚══██╔══╝
██████╔╝███████║██║███████╗███████║█████╗  ██║   ██║██████╔╝   ██║
██╔═══╝ ██╔══██║██║╚════██║██╔══██║██╔══╝  ██║   ██║██╔══██╗   ██║
██║     ██║  ██║██║███████║██║  ██║██║     ╚██████╔╝██║  ██║   ██║
╚═╝     ╚═╝  ╚═╝╚═╝╚══════╝╚═╝  ╚═╝╚═╝      ╚═════╝ ╚═╝  ╚═╝   ╚═╝

                         ███╗   ███╗ ██████╗██████╗
                         ████╗ ████║██╔════╝██╔══██╗
                         ██╔████╔██║██║     ██████╔╝
                         ██║╚██╔╝██║██║     ██╔═══╝
                         ██║ ╚═╝ ██║╚██████╗██║
                         ╚═╝     ╚═╝ ╚═════╝╚═╝

        MCP server + paired agent skill for PhishFort workflows
        approval-gated writes | secret-safe defaults | no URL fetching

phishfort-mcp

security: reviewed & hardened tests: 130 passing python: 3.11+ license: MIT

A security-first MCP server and paired agent skill for the PhishFort Unified Client API.

Security-reviewed and hardened — 2026-07-29. Approval-gated writes · secret-safe by default · no incident-URL fetching · every security claim verified against the code.

Bring PhishFort incident review, reporting, attachments, comments, and webhook management into your MCP client, then give your agent the workflow playbook for using those tools safely.

Paired skill | Official PhishFort API docs | Security review | Local reference

Unofficial project. Not affiliated with, endorsed by, or maintained by PhishFort.

Security, reviewed in the open

This is a security tool, so the security work is the headline — not a disclaimer at the bottom. Every control is implemented in code, covered by tests, and was put through a review-and-harden pass whose results are public.

  • 2026-06-02 — v0.1.0. Local stdio MCP server and paired agent skill, security-first by default: approval-gated writes, API host pinning, redirects disabled, and no fetching of incident URLs.

  • 2026-06-05 — Posture mapped to evidence. Every security feature documented against MCP, OpenAI, and Anthropic guidance, each row tied to the exact code and test behind it.

  • 2026-06-10 — Review and hardening pass. A security review conducted by Claude Fable 5 Ultracode (initial pass), Opus 4.8 xhigh, rubber-ducked with Codex 5.5 xhigh via plugin drove a hardening pass:

    • destructive confirmation is now enforced on incident-action requests — the annotation and the approval gate agree,

    • secret-named fields are scrubbed recursively, and one-time webhook secrets are written through O_NOFOLLOW 0600 files,

    • reads retry bounded transport failures; writes retry only proven pre-send connection/pool failures; secret-named fields are redacted from errors,

    • the approval salt is random and process-stable, and the retry count is bounded,

    • the webhook URL preflight rejects legacy numeric-IP encodings,

    • the final attachment descriptor is held through upload, narrowing the validate→upload replacement window.

    The same pass reworded every security claim to match what the code enforces — the approval gate is described as in-process integrity and confirmation, not independent authorization, and the webhook URL check as a pre-submit sanity check. Tests went from 26 to 36.

  • 2026-07-30 — v0.1.1. Packages reference resources into wheels, adds current Users, Clients, Documents, and total-count reads, distinguishes safe read retries from mutation outcomes needing manual review, binds immutable attachment snapshots to approval, validates webhook timestamp freshness, requires file-backed verifier secrets, hardens one-time secret persistence beneath an owned 0700 root, and uses documented attachment MIME types. Distribution uses a versioned Git tag and GitHub Release assets; this project is not published to PyPI.

The table below is the evidence: each control maps to the code and the test that backs it.

Related MCP server: wrg-mcp-server

Standards-Backed Security Posture

This server was designed against the Official Model Context Protocol security guidance, Anthropic connector guidance, OpenAI MCP guidance, OpenAI agent safety guidance, and PhishFort's official API docs. The table below lists only security features that are implemented in code, with local evidence.

Local evidence:

Security feature

What it prevents

Confirmed implementation

Local stdio transport only

Avoids exposing a public HTTP MCP surface in v1

server.main() rejects non-stdio transport

Two-step approval gate for writes

Forces an explicit plan→confirm step with a tamper-evident digest before any mutation. This is in-process integrity/confirmation, not independent human authorization — the host UI provides the human prompt via the destructive hints below

Write tools require approval_id, approval_phrase, expires_at, request_digest; _validate_approval() recomputes the digest from the actual params

Tamper-resistant approval digest

Blocks changing params after approval planning

approval.py canonicalizes params and verifies request_digest; covered by test_approval_rejects_tampered_params

Destructive confirmation

Adds explicit friction for delete/rotate operations

Destructive specs require destructive_confirmed=true; covered by test_destructive_operation_requires_confirmed

Read/write MCP annotations

Gives MCP hosts correct safety hints

_read_annotations() and _write_annotations() set read-only/destructive/idempotent hints

API keys never passed as tool args

Reduces credential leakage through prompts/tool logs

Settings reads PHISHFORT_API_KEY or PHISHFORT_API_KEY_FILE; tool signatures do not accept API keys

Default API host pinning

Avoids accidental credential use against arbitrary hosts

Settings.validate_base_url() requires https://capi.phishfort.com/v1 unless explicit override is enabled

Redirects disabled

Avoids following API responses to unexpected locations

httpx.AsyncClient(..., follow_redirects=False)

Error redaction

Prevents API keys, secret-named fields, and echoed secret values from leaking through raised API errors

PhishFortClient._error() applies two-pass redact() masking; covered by API-key, sensitive-key, and echoed-value tests

Untrusted data warnings

Reminds agents not to treat remote content as instructions

response_envelope() adds untrusted_data_warning to PhishFort API outputs

No generic URL fetching

Avoids browsing hostile or sensitive URLs returned by the API

Server exposes PhishFort API tools only; no tool fetches incident or document URLs

Attachment file restrictions

Reduces local file exfiltration and approval-time file swaps

snapshot_attachments() reads bytes during planning and execution; attachment_manifest() binds planned path, size, SHA-256, and MIME; execution must match that manifest, then uploads the exact execution snapshot using the documented MIME map, including application/vnd.ms-outlook for .msg

Webhook URL preflight (defense-in-depth)

Rejects localhost/private/reserved targets — including legacy decimal/octal/hex IP forms — before a webhook is registered. The server never fetches the URL itself (PhishFort delivers webhooks), so backend egress controls remain the real boundary

validate_webhook_url() and is_private_host(); covered by webhook URL tests

Webhook secret containment

Keeps one-time secrets out of tool output and avoids post-mutation sink setup

_handle_secret_response() strips sensitive fields and echoes; prepare_secret_write() opens a bound sink beneath an owned 0700 root before mutation and PreparedSecretWrite.persist() installs the 0600 secret or reports a verified recovery path

Webhook signature verification

Enables receiver-side HMAC verification and rejects stale timestamps

verify_signature() signs the exact raw body, requires a numeric timestamp within ±300 seconds, and uses hmac.compare_digest(); receivers reject duplicate attempt delivery IDs and make logical-event processing idempotent

Limit-aware behavior

Avoids known API limit failures where possible

phishfort_get_limits, reference_limits, incident limit clamp, webhook 5-subscription preflight; covered by tests/test_limits.py

Bounded retry behavior

Avoids unsafe retry storms and duplicate writes

Reads may retry 429/5xx with capped backoff and Retry-After; mutations retry only proven pre-send connection/pool failures and never status responses or ambiguous read/protocol failures; covered by read/write retry tests

About

phishfort-mcp is a public, unofficial MCP integration for teams and operators who want PhishFort incident workflows available inside agentic tools without giving up basic operational control. The MCP server provides live API access; the paired skill gives compatible agents the workflow memory needed to use that access consistently.

It is built for local-first use, explicit approvals, and careful handling of phishing data. The goal is not to make incident response fully autonomous. The goal is to make the repetitive parts faster while keeping sensitive actions, secrets, and untrusted content under control.

Why This Exists

PhishFort has a focused REST API for phishing incident workflows. MCP makes that API usable from agentic tools, and the paired skill teaches those agents the operating procedure: what to read first, how to plan writes, what data is untrusted, and when to stop for explicit approval.

That pairing matters because security workflows are not just API calls. Incident data can contain hostile text, URLs should not be fetched casually, and takedown or webhook operations should not happen from a loose prompt.

phishfort-mcp ships two pieces that work together:

  • a local stdio MCP server for live PhishFort API access

  • an agent-agnostic skill that turns raw tool access into repeatable, safer workflows

  • approval-gated writes for reporting, actions, evidence, comments, and webhooks

  • secret-safe handling for API keys and one-time webhook secrets

  • untrusted-data guardrails for incident text, URLs, and webhook payloads

What You Can Do

Workflow

Tools

Give agents the PhishFort operating playbook

skills/phishfort-mcp/SKILL.md

Check documented API limits

phishfort_get_limits

Check identity and client scope

phishfort_whoami

List users and clients in authorized scope

phishfort_list_users, phishfort_list_clients

Search and inspect incidents

phishfort_list_incidents, phishfort_get_incident, phishfort_find_incident_by_subject

List document metadata and obtain short-lived signed URLs

phishfort_list_documents, phishfort_get_document, phishfort_get_document_signed_url

Report URLs, domains, emails, phones, and IPv4 subjects

phishfort_report_incident

Request takedown, monitoring, or safe review

phishfort_request_incident_action

Add evidence and analyst context

phishfort_add_attachments, phishfort_add_comment

Manage webhook subscriptions

phishfort_list_webhooks, phishfort_create_webhook, phishfort_update_webhook, phishfort_delete_webhook, phishfort_test_webhook, phishfort_rotate_webhook_secret

Verify incoming webhook deliveries

phishfort_verify_webhook_signature

The server also exposes MCP resources for the distilled API reference, source manifest, and security review:

  • phishfort://reference/summary

  • phishfort://reference/limits

  • phishfort://reference/source-manifest

  • phishfort://reference/security-review

Paired Skill

This repo ships an agent-agnostic skill in skills/phishfort-mcp/SKILL.md. Use it with any skill-capable MCP host to teach the agent the safe operating pattern for this server: read before write, treat all remote API data as untrusted, never fetch returned URLs by default, and use phishfort_plan_change before mutating calls.

The skill keeps detailed workflows in references/workflows.md, exact tool parameters in references/tool-map.md, and points agents to phishfort_get_limits before workflows where limits change the right next step.

The GitHub Release wheel installs the MCP server and its embedded reference resources. The paired skill is a repository asset; download it from the matching Git tag when your host supports skills. This project is not published to PyPI.

Safety Built In

The standards-backed table above is the detailed proof. Operationally, the server stays local-first, keeps credentials out of tool arguments, treats PhishFort data as untrusted, gates writes through phishfort_plan_change, stores webhook secrets outside tool output, and constrains attachments, webhook URLs, limits, and retries.

See MCP security review for the reasoning behind these choices.

Quick Start

uvx --from git+https://github.com/mychaelconnolly/phishfort-mcp.git@v0.1.1 phishfort-mcp --help

For source development or the paired skill:

git clone --branch v0.1.1 --depth 1 https://github.com/mychaelconnolly/phishfort-mcp.git
cd phishfort-mcp
uv sync --frozen --extra dev
uv run phishfort-mcp --help

Create a local key file:

mkdir -p ~/.config/phishfort-mcp
chmod 700 ~/.config/phishfort-mcp
$EDITOR ~/.config/phishfort-mcp/phishfort-api-key.txt
chmod 600 ~/.config/phishfort-mcp/phishfort-api-key.txt

Codex MCP Registration

codex mcp add phishfort \
  --env PHISHFORT_API_KEY_FILE=$HOME/.config/phishfort-mcp/phishfort-api-key.txt \
  -- uvx --from git+https://github.com/mychaelconnolly/phishfort-mcp.git@v0.1.1 phishfort-mcp

Then verify:

codex mcp list

A fresh Codex session may be required before new MCP tools are discoverable.

Configuration

Variable

Default

Notes

PHISHFORT_API_BASE_URL

https://capi.phishfort.com/v1

Pinned to official API host unless override is enabled.

PHISHFORT_API_KEY

unset

Useful for short-lived local shells.

PHISHFORT_API_KEY_FILE

unset

Preferred for MCP registration.

PHISHFORT_SECRET_DIR

~/.config/phishfort-mcp/secrets

Effective-user-owned 0700 root; webhook secrets are written with 0600 permissions.

PHISHFORT_ATTACHMENT_ROOTS

.

Comma-separated roots allowed for attachment uploads.

PHISHFORT_TIMEOUT_SECONDS

30

HTTP request timeout.

PHISHFORT_MAX_RETRIES

3

Caps read-side 429/5xx retries and mutation retries for proven pre-send connection/pool failures at 5. Mutation status responses and ambiguous read/protocol failures are not retried; read-side Retry-After is capped locally.

PHISHFORT_ALLOW_CUSTOM_BASE_URL

false

Test-only escape hatch for non-production API hosts.

PHISHFORT_ALLOW_UNSAFE_WEBHOOK_URL

false

Test-only escape hatch for localhost/private webhook targets.

phishfort_verify_webhook_signature accepts secret_file only. The file must remain beneath PHISHFORT_SECRET_DIR; the root and any subdirectories must be owned by the effective user with mode 0700. Symlinked components, root rebinding, and platforms without required descriptor-relative no-follow primitives fail closed.

Approval-Gated Writes

Read tools can be called directly. Writes are two-step on purpose:

  1. Call phishfort_plan_change with operation and exact params.

  2. Review warnings, risk, request_digest, and approval_phrase.

  3. Call the intended mutating tool with the same params plus approval_id, approval_phrase, expires_at, and request_digest.

If anything changes, rerun phishfort_plan_change.

This gate is in-process integrity and confirmation: it proves the executed params match the planned params (tamper-evident digest), enforces expiry, and requires destructive_confirmed=true for destructive operations. It is not an independent authorization boundary — the same agent can plan and confirm. The human-in-the-loop checkpoint is the MCP host's own tool-confirmation UI, driven by the destructive annotations the server sets.

Mutating API calls are not automatically replayed after HTTP status responses or ambiguous read/protocol failures. PhishFort documents no idempotency key for incident reports. A report 409 means duplicate. Any 2xx with a nonempty incident id confirms creation, even when dashboard url is null or absent; a 2xx without a nonempty id stops for manual review with no automatic retry.

Verification

uv run ruff check .
uv run pytest

Optional live smoke when a valid key exists:

  • phishfort_whoami

  • phishfort_list_incidents(limit=1)

Do not run live mutating smoke unless you intend to change PhishFort state.

Document signed URLs are short-lived download grants. Treat them as sensitive, untrusted API output: do not persist or share them, and do not fetch them automatically.

API Reference

Official PhishFort docs:

PhishFort's docs MCP serves documentation, not account API operations. This project remains the local account-workflow MCP server.

This repo includes a distilled reference in docs/reference/phishfort-unified-client-api.md and a source URL manifest in docs/reference/source-manifest.json. Fetched raw PhishFort docs are intentionally not tracked.

License

MIT. See LICENSE.

Available Tools

23 tools
phishfort_add_attachmentsAdd PhishFort AttachmentsC

Add attachment files to an existing incident after approval.

ParametersJSON Schema
NameRequiredDescriptionDefault
expires_atYes
approval_idYes
incident_idYes
request_digestYes
approval_phraseYes
attachment_pathsYes
destructive_confirmedNo

Output Schema

ParametersJSON Schema
NameRequiredDescription
dataYes
outcomeNo
operationNo
http_statusNo
remote_stateNo
safe_to_retryNo
manual_action_requiredNo
untrusted_data_warningYes

TDQS

C2.4/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations indicate readOnlyHint=false and destructiveHint=false, but the description adds minimal behavioral context beyond 'after approval'. It does not disclose constraints like file size limits, overwrite behavior, or failure scenarios.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness3/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence, making it concise but insufficiently informative. It lacks structured details and fails to earn its place with necessary information.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness1/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given 7 parameters, 6 required, and 0% schema coverage, the description is severely incomplete. It omits the approval workflow and required input semantics, leaving an agent unable to use the tool effectively.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, and the description does not explain any of the 7 parameters (e.g., approval_id, request_digest). The tool cannot be correctly invoked without parameter understanding.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool adds attachment files to an incident after approval, specifying a distinct verb and resource. However, it does not fully clarify what 'after approval' entails, which could be ambiguous.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies approval is a prerequisite but offers no explicit guidance on when to use this tool versus alternatives like add_comment or request_incident_action. No when-not-to-use or context is provided.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

phishfort_add_commentAdd PhishFort CommentB

Add a comment to an existing incident after approval.

ParametersJSON Schema
NameRequiredDescriptionDefault
commentYes
expires_atYes
approval_idYes
incident_idYes
request_digestYes
approval_phraseYes
destructive_confirmedNo

Output Schema

ParametersJSON Schema
NameRequiredDescription
dataYes
outcomeNo
operationNo
http_statusNo
remote_stateNo
safe_to_retryNo
manual_action_requiredNo
untrusted_data_warningYes

TDQS

B3.1/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations indicate readOnlyHint=false and destructiveHint=false. The description adds the requirement of approval, which provides some behavioral context. However, it does not disclose other potential behaviors, such as whether the comment triggers notifications or modifies the incident state.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness3/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is extremely concise (one short sentence). While this brevity is positive, it omits necessary details about parameters and behavior, making it less informative than needed for a tool with many parameters.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the complexity (7 parameters, 6 required, presence of output schema), the description is too sparse. It fails to explain the approval workflow, comment content expectations, or how the tool integrates with other sibling tools like phishfort_request_incident_action.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema has 7 parameters (6 required) with 0% schema description coverage. The description does not explain any parameter's purpose or constraints, leaving the agent to rely solely on parameter names and types, which are insufficient.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action (add a comment), the resource (comment), and the context (to an existing incident after approval). It effectively distinguishes from sibling tools like phishfort_report_incident or phishfort_request_incident_action.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description specifies that the tool should be used 'after approval,' providing a clear context. However, it does not explicitly state when not to use it or mention alternatives, leaving some ambiguity about its place in the workflow.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

phishfort_create_webhookCreate PhishFort WebhookC

Create webhook subscription. One-time secret is saved locally, not returned.

ParametersJSON Schema
NameRequiredDescriptionDefault
urlYes
eventsYes
expires_atYes
approval_idYes
descriptionNo
request_digestYes
approval_phraseYes
secret_output_nameNo
destructive_confirmedNo

Output Schema

ParametersJSON Schema
NameRequiredDescription
dataYes
webhook_idNo
http_statusNo
remote_stateYes
saved_secretNo
secret_stateYes
recovery_fileNo
safe_to_retryNo
secret_returnedYes
recovery_requiredYes
untrusted_data_warningYes

TDQS

C2.7/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations (readOnlyHint=false, destructiveHint=false) indicate it's a non-read, non-destructive mutation. The description adds behavioral context about the one-time secret being saved locally and not returned, which is valuable but does not fully explain side effects, authorization, or idempotency nuances.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is very short and front-loaded with the core purpose. Every sentence is useful, but it could be improved by adding more detail about parameters without becoming wordy.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the complexity (9 params, 6 required, output schema exists but not detailed), the description is insufficient. It lacks information on return values, error states, and how to use the secret, making it hard for an agent to invoke correctly without additional knowledge.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

With 0% schema description coverage, the description must compensate but only mentions the secret behavior, not explaining any of the 9 parameters (url, events, approval_id, etc.). This leaves parameter meaning entirely to the agent's inference.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states it creates a webhook subscription and mentions the one-time secret behavior. It distinguishes from sibling webhook operations (list, update, delete, etc.) but could be more explicit about the context of PhishFort webhooks.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides no guidance on when to use this tool versus alternatives, such as prerequisites for using approval_id/approval_phrase, or when to prefer this over other webhook operations.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

phishfort_delete_webhookDelete PhishFort WebhookC
Destructive

Delete webhook subscription after approval.

ParametersJSON Schema
NameRequiredDescriptionDefault
expires_atYes
webhook_idYes
approval_idYes
request_digestYes
approval_phraseYes
destructive_confirmedNo

Output Schema

ParametersJSON Schema
NameRequiredDescription
dataYes
outcomeNo
operationNo
http_statusNo
remote_stateNo
safe_to_retryNo
manual_action_requiredNo
untrusted_data_warningYes

TDQS

C2.4/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The description adds the behavioral note 'after approval', which is not in the annotations. However, with destructiveHint=true already declared, the description could further detail the destruction's reversibility, side effects, or the confirmation mechanism (destructive_confirmed parameter).

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness2/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is only eight words, which is under-specified rather than concise. It lacks essential information about parameters, usage, and output, making it ineffective despite its brevity.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness1/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The tool has six parameters, an output schema, and a multi-step flow implied by 'after approval'. The description fails to explain any of these, leaving the agent without guidance on how to call the tool correctly.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

With 0% schema description coverage, the description must explain the six parameters. It does not mention any parameter, including critical ones like webhook_id, approval_id, approval_phrase, expires_at, request_digest, or destructive_confirmed. This is a severe gap.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action 'delete' and the resource 'webhook subscription', with the qualifier 'after approval'. This is specific enough to distinguish from read operations, but it could be more explicit about what type of webhook or the approval context.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus alternatives like phishfort_update_webhook or phishfort_test_webhook. The phrase 'after approval' hints at a precondition but does not specify scenarios, prerequisites, or when not to use it.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

phishfort_find_incident_by_subjectFind PhishFort Incident By SubjectB
Read-onlyIdempotent

Find one incident by URL, domain, or subject value. Subject is URL-encoded.

ParametersJSON Schema
NameRequiredDescriptionDefault
subjectYes

Output Schema

ParametersJSON Schema
NameRequiredDescription

No output parameters

TDQS

B3.3/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare the tool as read-only, idempotent, and non-destructive. The description adds the behavioral note that the subject parameter is URL-encoded, which is useful. However, it does not disclose other behaviors such as what happens if no incident is found (e.g., returns null vs. error), but the annotations already cover the safety profile well.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description consists of two succinct sentences with no filler. It directly states the purpose and a key encoding detail, making it efficient and easy to parse.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The tool has low complexity (1 param, required) and an output schema exists, so return format is covered. However, the description lacks guidance on usage context and does not mention error conditions or edge cases, making it minimally complete for effective agent invocation.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The schema has 0% description coverage, so the description carries the burden. It adds meaning by stating that the subject parameter can accept a URL, domain, or subject value and that it should be URL-encoded. This provides some clarity beyond the schema, but the description is still vague about the exact format expected.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'Find' and the resource 'incident', and specifies the search criteria (URL, domain, or subject value). However, it mentions multiple criteria while the schema only defines a single 'subject' parameter, which could cause confusion about how to provide URL or domain values.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is given on when to use this tool versus sibling tools like 'phishfort_list_incidents' or 'phishfort_get_incident'. There is no explicit when-to-use or when-not-to-use context, leaving the agent to infer usage from the name alone.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

phishfort_get_documentGet PhishFort DocumentA
Read-onlyIdempotent

Get document metadata and its time-limited signed URL without fetching it.

ParametersJSON Schema
NameRequiredDescriptionDefault
document_idYes

Output Schema

ParametersJSON Schema
NameRequiredDescription

No output parameters

TDQS

A3.9/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate read-only, idempotent, non-destructive behavior. Description adds that it does not fetch the document, which is consistent and provides additional context beyond annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, front-loaded, no extraneous words. Efficiently conveys the tool's action and boundaries.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With an output schema present, returning metadata and signed URL is sufficient. No critical gaps remain given the tool's simplicity and annotations.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 0%, meaning the parameter 'document_id' lacks description. The tool description does not explain the parameter's purpose, format, or required values. Agent must infer from name only.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states it retrieves document metadata and a time-limited signed URL without fetching the document content. This distinguishes it from sibling tools like phishfort_get_document_signed_url which presumably only gets the URL.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Description implies usage for metadata and URL retrieval but does not explicitly state when to use this tool over alternatives (e.g., phishfort_get_document_signed_url for just the URL). No negative guidance or context provided.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

phishfort_get_document_signed_urlGet PhishFort Document Signed URLA
Read-onlyIdempotent

Get a time-limited document URL without fetching it.

ParametersJSON Schema
NameRequiredDescriptionDefault
document_idYes

Output Schema

ParametersJSON Schema
NameRequiredDescription

No output parameters

TDQS

A3.5/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Description adds behavioral context beyond annotations: 'time-limited' and 'without fetching it' clarify the URL's lifespan and that the document content is not returned. No contradiction with annotations (readOnlyHint, idempotentHint, destructiveHint).

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence conveys the core functionality with zero waste. Front-loaded and efficient.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Despite having an output schema, the description is too minimal. It does not mention any prerequisites, the meaning of 'time-limited', or how the URL is used. Combined with no parameter details, it leaves gaps for an AI agent.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0% and the description fails to explain the document_id parameter beyond its name. With only one parameter, minimal effort to describe its format or purpose would significantly improve clarity.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states the tool generates a time-limited document URL without fetching the content. It distinguishes from phishfort_get_document (fetches content) and phishfort_list_documents (lists documents).

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit guidance on when to use this tool versus alternatives. Does not mention that it's for sharing/accessing documents without downloading, nor when not to use it.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

phishfort_get_incidentGet PhishFort IncidentB
Read-onlyIdempotent

Get one PhishFort incident by id.

ParametersJSON Schema
NameRequiredDescriptionDefault
incident_idYes

Output Schema

ParametersJSON Schema
NameRequiredDescription

No output parameters

TDQS

B3/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true, idempotentHint=true, etc. Description adds no behavioral info beyond what annotations provide.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, 6 words, front-loaded with verb and resource. No wasted words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Tool is simple with output schema, so return value is covered. However, no context on parameter usage or common use cases. Adequate but minimal.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema has 0% description coverage, and the description does not explain the incident_id parameter or its format/meaning.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states the action (Get), resource (PhishFort incident), and identifier method (by id). Distinct from sibling tools like phishfort_list_incidents and phishfort_find_incident_by_subject.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit guidance on when to use this tool versus alternatives. No mention of prerequisites or when not to use.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

phishfort_get_limitsGet PhishFort API LimitsA
Read-onlyIdempotent

Return documented API limits and MCP-enforced limit choices.

ParametersJSON Schema
NameRequiredDescriptionDefault

No parameters

Output Schema

ParametersJSON Schema
NameRequiredDescription

No output parameters

TDQS

A4/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint, idempotentHint, and destructiveHint, fully covering safety behavior. The description adds no additional behavioral context (e.g., response format stability, pagination). It does not contradict annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

A single, efficient sentence that conveys the exact purpose without any filler. Every word earns its place.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple, parameterless info tool with an output schema, the description is sufficient. It could mention common use cases (e.g., checking limits before other calls) but is adequate as-is.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema has zero parameters, and schema coverage is 100%. Per guidelines, 0 parameters yields a baseline of 4. No further parameter explanation is needed.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool returns 'documented API limits and MCP-enforced limit choices', specifying a precise verb and resource. This distinguishes it from all sibling tools which focus on incidents, documents, users, etc.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit guidance on when to use this tool vs alternatives is provided. However, the purpose is simple and distinct, so usage is implied. The description could benefit from a brief note like 'Use this before making API calls to avoid rate limiting.'

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

phishfort_list_capabilitiesList PhishFort CapabilitiesA
Read-onlyIdempotent

List supported PhishFort MCP operations and mutation approval requirements.

ParametersJSON Schema
NameRequiredDescriptionDefault

No parameters

Output Schema

ParametersJSON Schema
NameRequiredDescription

No output parameters

TDQS

A4.3/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true, idempotentHint=true, destructiveHint=false. The description adds that it returns supported operations and mutation approval requirements, providing useful behavioral context beyond what annotations convey. No contradictions.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence that clearly and directly states the tool's purpose with no extraneous information. It is appropriately sized and front-loaded.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given zero parameters and the presence of an output schema (not shown but declared), the description adequately covers the tool's function. It names the two key outputs (operations and mutation approval requirements), which is sufficient for a listing tool.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

With zero parameters, schema coverage is 100%, so the baseline is 4. The description adds no parameter info, but none is needed. It correctly states what the tool does without parameter details.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool lists supported PhishFort MCP operations and mutation approval requirements. It uses a specific verb ('list') and resource ('capabilities'), distinguishing it from sibling tools that perform CRUD operations.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage for discovering available operations, but lacks explicit guidance on when to use vs alternatives or any exclusions. No sibling tool duplicates this function, so no conflict, but the description could be more explicit about its role.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

phishfort_list_clientsList PhishFort ClientsA
Read-onlyIdempotent

List visible clients with id, search, active, limit, and offset filters.

ParametersJSON Schema
NameRequiredDescriptionDefault
limitNo
activeNo
offsetNo
searchNo
client_idNo

Output Schema

ParametersJSON Schema
NameRequiredDescription

No output parameters

TDQS

A3.7/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint, idempotentHint, and destructiveHint. The description adds no additional behavioral context beyond what annotations provide. The description does not contradict annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, efficient sentence. It is front-loaded with the purpose, but lacks depth. It earns its place without waste.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The tool has 5 parameters and an output schema. The description is minimal and does not cover parameter details, but the presence of an output schema reduces the burden for return value explanation. Some gaps remain.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the description must compensate. It merely lists parameter names without explaining their meaning, types, or allowed values. This is insufficient for effective tool use.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'List' and the resource 'visible clients', and enumerates available filters. There is no sibling tool with similar purpose, so no differentiation needed.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

While the description does not explicitly state when to use this tool versus alternatives, the name and purpose make it obvious. No exclusion criteria or alternative references are provided, but the context is clear enough.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

phishfort_list_documentsList PhishFort DocumentsC
Read-onlyIdempotent

List document metadata. doc_type accepts comma-separated documented types.

ParametersJSON Schema
NameRequiredDescriptionDefault
qNo
pageNo
limitNo
sort_byNo
doc_typeNo
sort_dirNo
client_idNo
latest_onlyNo
executive_idNo
exclude_deletedNo

Output Schema

ParametersJSON Schema
NameRequiredDescription

No output parameters

TDQS

C2.6/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true, idempotentHint=true, and destructiveHint=false, so the agent knows it's a safe, idempotent read operation. The description adds minimal behavioral info (only about doc_type). Without annotations, this would be a 2, but with annotations, the bar is lower. No contradiction with annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness3/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is extremely short at one sentence, which is concise but at the cost of completeness. It could be expanded to include essential details without becoming verbose. The structure is minimal, so it scores a middle mark.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With 10 parameters, 0% schema coverage, and a complex tool, the description is far too minimal. It omits pagination, filtering, sorting, and output details. Although an output schema exists externally, the description should still provide enough context to select and invoke the tool correctly. It fails to do so.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the description must compensate. It only explains that 'doc_type accepts comma-separated documented types,' which adds meaning for one parameter. The other nine parameters (q, page, limit, sort_by, etc.) are left unexplained, failing to provide necessary semantics for correct invocation.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose3/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states it lists document metadata, which is a clear action on a resource. However, it is vague—doesn't specify what types of documents or the tool's scope. It doesn't differentiate from sibling listing tools like phishfort_list_incidents. A more specific verb and resource description is needed.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives, or any prerequisites. With many sibling tools for listing (incidents, capabilities, etc.), the description should indicate that this is for listing documents specifically and suggest when to use other tools like phishfort_get_document for a single document.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

phishfort_list_incidentsList PhishFort IncidentsC
Read-onlyIdempotent

List incidents. Set include_total to request paging.total.

ParametersJSON Schema
NameRequiredDescriptionDefault
limitNo
cursorNo
statusNo
to_dateNo
client_idNo
from_dateNo
include_totalNo

Output Schema

ParametersJSON Schema
NameRequiredDescription

No output parameters

TDQS

C2.4/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate read-only, idempotent, non-destructive behavior. The description adds minimal behavioral info beyond paging. It does not disclose default ordering, response format, or any side effects.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness3/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two sentences, but the first sentence is a tautology (repeats title). The second adds one useful detail. Could be more succinct.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness1/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given 7 parameters and no param descriptions, the description is grossly incomplete. An agent cannot determine how to filter incidents, what the output contains, or how pagination works beyond the include_total flag.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

With 0% schema description coverage and 7 parameters, the description only explains 'include_total'. All other parameters (limit, cursor, status, dates, client_id) lack any semantic context, making it hard for an agent to use them correctly.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description 'List incidents' clearly states the action and resource. It distinguishes from sibling tools like 'phishfort_find_incident_by_subject' or 'phishfort_get_incident' by indicating a listing operation.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool vs. alternatives. The only hint is to set include_total for paging, but no context on filtering or ordering.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

phishfort_list_usersList PhishFort UsersC
Read-onlyIdempotent

List users with role, client, search, limit, and offset filters.

ParametersJSON Schema
NameRequiredDescriptionDefault
roleNo
limitNo
offsetNo
searchNo
client_idNo

Output Schema

ParametersJSON Schema
NameRequiredDescription

No output parameters

TDQS

C2.9/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate readOnlyHint=true, idempotentHint=true, and destructiveHint=false. The description adds no behavioral context beyond the filters, but does not contradict annotations. Given annotation coverage, a score of 3 is appropriate.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, concise, and front-loaded with the verb and resource. No redundant information, but could be expanded slightly for clarity without losing conciseness.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With 5 optional parameters and no schema descriptions, the description lacks details on output, pagination behavior (limit/offset), search mechanism, and the meaning of filters. An output schema exists but is not referenced. The description is too sparse for a tool with this complexity.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the description must compensate. It only lists parameter names (role, client, search, limit, offset) without explaining values, formats, or semantics (e.g., what 'client' refers to, allowed roles). This is insufficient for agent understanding.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool lists users with specific filters, distinguishing it from other list tools. However, it could be more precise about the user scope (PhishFort users) already implied in the title.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus sibling tools like phishfort_list_clients or phishfort_list_incidents. The description only lists filters without contextualizing use cases.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

phishfort_list_webhooksList PhishFort WebhooksA
Read-onlyIdempotent

List configured webhook subscriptions.

ParametersJSON Schema
NameRequiredDescriptionDefault

No parameters

Output Schema

ParametersJSON Schema
NameRequiredDescription

No output parameters

TDQS

A4/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint, idempotentHint, and destructiveHint. The description adds no extra behavioral context beyond stating it lists subscriptions, which is consistent with annotations. No contradiction.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, no unnecessary words, directly conveys the tool's action.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the simple operation (0 parameters), presence of output schema, and comprehensive annotations, the description is mostly complete. It could note that it returns a list of subscriptions, but this is implied.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

No parameters exist, and schema coverage is 100%. The description correctly omits parameter details as none are needed. Baseline score of 4 for parameter-free tools.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description 'List configured webhook subscriptions' uses a specific verb (list) and resource (webhook subscriptions), clearly distinguishing it from sibling tools like create_webhook, delete_webhook, etc.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit guidance on when to use this tool versus alternatives. The sibling names imply a listing role, but there is no mention of when to use list vs other webhook tools or when not to use it.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

phishfort_plan_changePlan PhishFort ChangeB

Plan a PhishFort write. Does not mutate. Use returned approval fields on write tools.

ParametersJSON Schema
NameRequiredDescriptionDefault
paramsNo
operationYes
expires_in_secondsNo

Output Schema

ParametersJSON Schema
NameRequiredDescription

No output parameters

TDQS

B3.2/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The description says 'Does not mutate', but annotations have readOnlyHint=false, implying possible side effects (e.g., creating a plan object). This contradiction undermines transparency. No other behavioral details like authentication or rate limits are provided.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is very short (two sentences) and front-loaded with the core purpose. Every sentence adds value, though it could be slightly expanded without losing conciseness.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Despite having an output schema, the description lacks sufficient context for a planning tool with three parameters. It does not explain what 'planning' entails, how parameters affect the plan, or how to use the approval fields. More detail is needed for effective use.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The description provides no information about the three parameters (params, operation, expires_in_seconds). With schema description coverage at 0%, the description fails to add any meaning beyond the raw schema, leaving the agent with minimal guidance.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool's purpose: 'Plan a PhishFort write.' and adds 'Does not mutate.' which distinguishes it from actual mutation tools. This is a specific verb-resource combination that differentiates it from siblings like phishfort_report_incident.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description gives clear usage context: it plans a write, does not mutate, and the output ('approval fields') should be used on write tools. However, it does not explicitly state when not to use it or contrast with other non-mutating tools among siblings.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

phishfort_report_incidentReport PhishFort IncidentC

Report incident for takedown or monitoring after approval.

ParametersJSON Schema
NameRequiredDescriptionDefault
urlNo
actionYes
commentNo
subjectNo
client_idNo
expires_atYes
approval_idYes
reported_byNo
incident_typeNo
request_digestYes
approval_phraseYes
attachment_pathsNo
destructive_confirmedNo

Output Schema

ParametersJSON Schema
NameRequiredDescription
dataYes
http_statusYes
incident_idYes
remote_stateNo
dashboard_urlYes
safe_to_retryYes
report_outcomeYes
manual_review_requiredYes
untrusted_data_warningYes

TDQS

C2.4/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate readOnlyHint=false and destructiveHint=false. The description adds the context of 'after approval' and the dual purpose (takedown or monitoring), which is useful but does not significantly expand behavioral disclosure beyond what annotations provide.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness3/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The single-sentence description is concise and front-loaded, but at the cost of clarity. It earns its place yet is insufficient for a tool with 13 parameters, making it adequately sized but not effectively informative.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The tool is complex with many required parameters and an approval workflow, but the description lacks details about prerequisites, output, or parameter dependencies. With an output schema exists, but the description ignores it, leaving significant gaps.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

With 13 parameters and 0% schema description coverage, the description must compensate but does not. It provides no explanation for any parameter (e.g., 'action', 'approval_id', 'destructive_confirmed'), leaving agents to guess their meaning and usage.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose3/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states the tool reports an incident for takedown or monitoring after approval, which provides a verb and resource. However, it does not clearly differentiate from sibling tools like phishfort_request_incident_action or phishfort_add_comment, leaving ambiguity about its exact role.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus alternatives. The description only mentions 'after approval' as a precondition, but does not specify when or why this tool should be chosen over similar sibling tools.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

phishfort_request_incident_actionRequest PhishFort Incident ActionB
Destructive

Request takedown, monitoring, or safe review for an existing incident.

ParametersJSON Schema
NameRequiredDescriptionDefault
actionYes
expires_atYes
approval_idYes
incident_idYes
request_digestYes
approval_phraseYes
destructive_confirmedNo

Output Schema

ParametersJSON Schema
NameRequiredDescription
dataYes
outcomeNo
operationNo
http_statusNo
remote_stateNo
safe_to_retryNo
manual_action_requiredNo
untrusted_data_warningYes

TDQS

B3.1/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations indicate destructiveHint=true, and the description lists three actions including 'takedown' (destructive) and others. However, it fails to mention the required approval process and the 'destructive_confirmed' parameter, which are important behavioral traits beyond what annotations provide.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness3/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is very short (9 words), but it under-specifies the tool's behavior and parameters. It is not efficiently informative; the brevity sacrifices clarity and completeness.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's complexity (7 params, destructive hint, approval flow), the description is severely incomplete. It does not explain the purpose of each parameter, the approval mechanism, or the output. Although an output schema exists, the input side is barely addressed.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema has 0% description coverage, so the description must compensate. It does not describe any parameter meanings, value options for 'action', or the purpose of approval-related fields. The tool has 7 parameters, and the description adds no semantic value.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool requests takedown, monitoring, or safe review for an existing incident. It uses a specific verb ('request') and specifies the resource (existing incident) and action types, distinguishing it from siblings like 'report_incident' which creates new incidents.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage context (requesting an action on an existing incident) but does not explicitly state when to use this tool versus alternatives, nor does it provide exclusions or prerequisites. It relies on the agent to infer that this is for modifying an incident's state.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

phishfort_rotate_webhook_secretRotate PhishFort Webhook SecretC
Destructive

Rotate webhook secret. One-time secret is saved locally, not returned.

ParametersJSON Schema
NameRequiredDescriptionDefault
expires_atYes
webhook_idYes
approval_idYes
request_digestYes
approval_phraseYes
secret_output_nameNo
destructive_confirmedNo

Output Schema

ParametersJSON Schema
NameRequiredDescription
dataYes
webhook_idNo
http_statusNo
remote_stateYes
saved_secretNo
secret_stateYes
recovery_fileNo
safe_to_retryNo
secret_returnedYes
recovery_requiredYes
untrusted_data_warningYes

TDQS

C2.7/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate destructiveHint=true. The description adds that the secret is saved locally and not returned, which informs the agent about side effects (loss of secret in response). However, it does not disclose other behavioral traits like the need for approval or that the action is irreversible.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness3/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is very short (one sentence) and front-loaded. However, given the complexity of the operation (7 params, destructive, requires approval), it is underspecified. The sentence is efficient but insufficiently structured for a tool with many parameters.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The description lacks critical context: it does not explain the approval flow, the meaning of parameters, or what success looks like. The existence of an output schema is implied but not described. For a destructive tool with many required parameters, this is incomplete.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

With 0% schema description coverage and 7 parameters (5 required), the description adds no meaning to the parameters. It does not explain what 'webhook_id', 'approval_id', 'approval_phrase', 'expires_at', 'request_digest', 'secret_output_name', or 'destructive_confirmed' represent. The agent must guess or consult external docs.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description explicitly states 'Rotate webhook secret', clearly identifying the action (rotate) and resource (webhook secret). It distinguishes from create/update/delete webhook siblings by focusing on secret rotation. The addition 'One-time secret is saved locally, not returned' adds clarity, though it could elaborate on the rotation process.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides no guidance on when to use this tool versus alternatives like update_webhook. There is no mention of prerequisites, context, or scenarios where rotation is appropriate. The agent must infer usage from the name alone.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

phishfort_test_webhookTest PhishFort WebhookC

Send test webhook delivery after approval.

ParametersJSON Schema
NameRequiredDescriptionDefault
expires_atYes
webhook_idYes
approval_idYes
request_digestYes
approval_phraseYes
destructive_confirmedNo

Output Schema

ParametersJSON Schema
NameRequiredDescription
dataYes
outcomeNo
operationNo
http_statusNo
remote_stateNo
safe_to_retryNo
manual_action_requiredNo
untrusted_data_warningYes

TDQS

C2.3/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations indicate destructiveHint=false, readOnlyHint=false, but the description only says 'send test webhook delivery', which is vague. It does not disclose potential effects like whether the test modifies state or triggers real callbacks, nor does it add context beyond the annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness2/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is extremely short (one sentence), which is under-specified rather than concise. It lacks essential information and does not justify its brevity with adequate coverage of the tool's purpose or usage.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness1/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With 5 required parameters and no parameter descriptions, the tool is highly complex but the description provides virtually no context. Despite having an output schema (not shown), the description fails to explain what the test does, what errors might occur, or how to interpret results.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0% with 6 parameters, and the description provides no explanation of any parameter. It fails to add meaning beyond the schema's basic type/title fields, leaving the agent with no understanding of what each parameter represents.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The name 'phishfort_test_webhook' and description 'Send test webhook delivery after approval' clearly indicate the tool's function: testing a webhook. It is specific about the action and resource, but does not differentiate from siblings like phishfort_create_webhook or phishfort_list_webhooks.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description says 'after approval', implying a prerequisite, but provides no explicit guidance on when to use this tool vs alternatives, such as when to test vs. verify or other webhook operations. No exclusions or context are given.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

phishfort_update_webhookUpdate PhishFort WebhookC

Update webhook subscription after approval.

ParametersJSON Schema
NameRequiredDescriptionDefault
urlNo
activeNo
eventsNo
expires_atYes
webhook_idYes
approval_idYes
descriptionNo
request_digestYes
approval_phraseYes
destructive_confirmedNo

Output Schema

ParametersJSON Schema
NameRequiredDescription
dataYes
outcomeNo
operationNo
http_statusNo
remote_stateNo
safe_to_retryNo
manual_action_requiredNo
untrusted_data_warningYes

TDQS

C2.4/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate this is a non-read-only, non-destructive write operation. The description adds only the unhelpful detail 'after approval' without explaining the approval process, idempotency, side effects, or authentication requirements. For a tool with a complex approval workflow, this is insufficient behavioral context.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness3/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single concise sentence, but it sacrifices informative content for brevity. It front-loads the update action but omits essential details, making it less efficient than a longer but more complete description.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's complexity (10 parameters, 5 required, approval workflow, and an output schema), the description is grossly incomplete. It fails to mention what the tool outputs, what fields can be updated, or the approval process. The agent would need to inspect the schema extensively to invoke the tool correctly.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, meaning the description provides no information about any of the 10 parameters (5 required). The unique approval-related parameters (approval_id, approval_phrase, request_digest) are not explained, leaving the agent to guess their purpose. This is a critical failure for correct tool invocation.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states 'Update webhook subscription after approval,' which clearly identifies the verb (update) and resource (webhook subscription), and hints at a prerequisite (approval). However, it does not distinguish this tool from sibling tools like phishfort_create_webhook or phishfort_delete_webhook, nor does it specify which webhook fields can be updated.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The phrase 'after approval' implies a precondition but provides no explicit guidance on when to use this tool versus alternatives (e.g., create or delete). There are no statements about when not to use it, prerequisites (e.g., existing webhook), or exclusions. With many sibling tools, this lack of guidance is a significant gap.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

phishfort_verify_webhook_signatureVerify PhishFort Webhook SignatureB
Read-onlyIdempotent

Verify a fresh X-PhishFort-Signature using a contained local secret file.

ParametersJSON Schema
NameRequiredDescriptionDefault
raw_bodyYes
signatureYes
timestampYes
secret_fileYes

Output Schema

ParametersJSON Schema
NameRequiredDescription

No output parameters

TDQS

B3.3/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint, idempotentHint, and non-destructive behavior. The description adds minimal context about using a local secret file but does not disclose verification logic, error handling, or implications of invalid signatures.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, well-structured sentence that immediately conveys the action and key constraint. No redundant or extraneous words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Despite having 4 required parameters and an output schema, the description is too brief. It omits important context such as return value interpretation, error cases, and how to prepare the secret file, making it incomplete for reliable usage.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

With 0% schema description coverage, the description should compensate but only hints at 'fresh' (timestamp relevance) and 'local secret file' (secret_file). It does not explain raw_body, signature format, or secret_file content, leaving significant ambiguity.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool verifies a fresh X-PhishFort-Signature using a local secret file. The verb 'verify' and resource 'signature' are specific, and the tool is distinct from all sibling tools which focus on CRUD operations on incidents, documents, users, and webhooks.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description does not specify when to use this tool versus alternatives, nor does it mention any prerequisites or exclusions. It lacks guidance on context, such as after receiving a webhook event.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

phishfort_whoamiPhishFort WhoamiA
Read-onlyIdempotent

Return authenticated PhishFort client identity.

ParametersJSON Schema
NameRequiredDescriptionDefault

No parameters

Output Schema

ParametersJSON Schema
NameRequiredDescription

No output parameters

TDQS

A4.1/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already provide readOnlyHint, idempotentHint, etc. Description adds that it returns identity, but doesn't disclose additional behavioral traits beyond what annotations convey. No contradictions.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, no unnecessary words. Front-loaded purpose. Perfectly concise for a zero-parameter tool.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With zero parameters and an output schema (implied), the description is complete. It tells the agent exactly what the tool does without needing added explanation.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

No parameters, so baseline is 4. Description doesn't need to add parameter info; schema coverage is trivially 100%.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states the tool returns the authenticated PhishFort client identity. It uses a specific verb ('Return') and resource ('authenticated PhishFort client identity'), distinguishing it from sibling tools that handle incidents, documents, webhooks, etc.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit guidance on when to use this tool or alternatives. For a simple identity retrieval, the description is adequate but could mention it's for verifying client identity or checking authentication status, especially given many sibling tools.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Tool Schema Changelog

Recent tool additions, removals, and schema changes observed during successful MCP inspections.

  1. 23 tool updatesv0.1.1
    • First observedphishfort_add_attachments
    • First observedphishfort_add_comment
    • First observedphishfort_create_webhook
    • First observedphishfort_delete_webhook
    • First observedphishfort_find_incident_by_subject
    • First observedphishfort_get_document
    • First observedphishfort_get_document_signed_url
    • First observedphishfort_get_incident
    • First observedphishfort_get_limits
    • First observedphishfort_list_capabilities
    • First observedphishfort_list_clients
    • First observedphishfort_list_documents
    • First observedphishfort_list_incidents
    • First observedphishfort_list_users
    • First observedphishfort_list_webhooks
    • First observedphishfort_plan_change
    • First observedphishfort_report_incident
    • First observedphishfort_request_incident_action
    • First observedphishfort_rotate_webhook_secret
    • First observedphishfort_test_webhook
    • First observedphishfort_update_webhook
    • First observedphishfort_verify_webhook_signature
    • First observedphishfort_whoami

TDQS

B3.2/5.0

Scored across 23 tools

Disambiguation5/5

Each tool targets a distinct operation: incident listing vs. finding by subject, document metadata vs. signed URL, etc. No two tools have overlapping purposes; descriptions clearly differentiate them.

Naming Consistency5/5

All tools follow a consistent 'phishfort_verb_noun' pattern in snake_case, e.g., 'list_incidents', 'create_webhook', 'verify_webhook_signature'. No mixing of conventions.

Tool Count4/5

23 tools is on the higher side but still reasonable for a platform covering incidents, documents, users, clients, webhooks, and system info. Each tool has a clear purpose, so the count feels justified rather than excessive.

Completeness3/5

Core incident lifecycle is covered (list, get, report, request action, add attachments/comments), but missing direct update or delete incident operations. Webhook CRUD is complete. Overall, notable gaps exist but the main workflows are functional.

Maintenance

ActivitySlowing
ResponsivenessNo issues

Related MCP Connectors

Related MCP Servers

  • A
    license
    Not graded
    quality
    D
    maintenance
    A Python-based MCP server that enables integration with Microsoft Security Copilot and Microsoft Sentinel, allowing users to run KQL queries, manage skillsets/plugins, and execute prompts in Security Copilot.
    23
    MIT
  • A
    license
    Not graded
    quality
    A
    maintenance
    An MCP server that exposes a 60+ tool security and threat-intel stack to AI agents, enabling secret scanning, Sigma rule generation, ransomware lookup, OSINT, and deep research.
    1
    MIT
  • A
    license
    A
    quality
    A
    maintenance
    Exposes 79 cybersecurity skills and 12 orchestrator agents over MCP, with a typed 11-field output contract, an enforced resolvable-evidence gate (no verdict without a resolvable source), and human-approval gating for every mutating action. Apache-2.0, stdlib-only.
    8
    4
    Apache 2.0
  • A
    license
    Not graded
    quality
    B
    maintenance
    Provides MCP tools to query the phishunt.io phishing feed, enabling domain checks, brand-specific phishing lists, delta syncs, and phishing-signal analysis.
    1
    MIT