Skip to main content
Glama
SmartBear MCP server

SmartBear MCP server

Official
by SmartBear

Contract Testing: Test Execute Webhooks

contract-testing_test_execute_webhooks

Triggers test executions for all matching webhooks without a real event, enabling on-demand verification of webhook behavior.

Instructions

Trigger a test execution of all matching webhooks without a real event.

Toolset: Webhooks

Parameters: None

Input Schema

NameRequiredDescriptionDefault

No arguments

Output Schema

NameRequiredDescriptionDefault
logsNo
_linksNo
messageNo
requestNo
successNo
responseNo

Schema Changelog

Changes observed during successful MCP inspections.

  1. Changed1 schema field changedv0.43.0
    • changedOutput schema / (root)
      Previous value: -nullNew value: +{
      +  "$defs": {
      +    "EmbeddedLink": {
      +      "additionalProperties": {},
      +      "properties": {
      +        "href": {
      +          "type": "string"
      +        },
      +        "name": {
      +          "type": "string"
      +        },
      +        "templated": {
      +          "type": "boolean"
      +        },
      +        "title": {
      +          "type": "string"
      +        }
      +      },
      +      "type": "object"
      +    }
      +  },
      +  "$schema": "https://json-schema.org/draft/2020-12/schema",
      +  "additionalProperties": {},
      +  "properties": {
      +    "_links": {
      +      "additionalProperties": {},
      +      "properties": {
      +        "try-again": {
      +          "$ref": "#/$defs/EmbeddedLink"
      +        }
      +      },
      +      "type": "object"
      +    },
      +    "logs": {
      +      "type": "string"
      +    },
      +    "message": {
      +      "type": "string"
      +    },
      +    "request": {
      +      "additionalProperties": {},
      +      "properties": {
      +        "body": {},
      +        "headers": {
      +          "additionalProperties": {},
      +          "properties": {},
      +          "type": "object"
      +        },
      +        "url": {
      +          "type": "string"
      +        }
      +      },
      +      "type": "object"
      +    },
      +    "response": {
      +      "additionalProperties": {},
      +      "properties": {
      +        "body": {},
      +        "headers": {
      +          "additionalProperties": {},
      +          "properties": {},
      +          "type": "object"
      +        },
      +        "status": {
      +          "type": "number"
      +        }
      +      },
      +      "type": "object"
      +    },
      +    "success": {
      +      "type": "boolean"
      +    }
      +  },
      +  "type": "object"
      +}
  2. Addedv0.40.0
  3. Removedv0.34.0
  4. First observedv0.27.1

TDQS

B3.3/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare destructiveHint=false, idempotentHint=false, and openWorldHint=true, so safety is partly covered. The description adds genuinely useful behavior—an outbound webhook fire happens even though no real event occurred—but says nothing about whether failures are surfaced, how many endpoints are hit, or whether repeated calls re-fire.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The core sentence is front-loaded and wastes no words. The trailing '**Toolset:** Webhooks' and '**Parameters:** None' lines restate metadata already carried by the schema and title, a minor redundancy.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

An output schema exists, so return values need not be described, and there are no params to explain. The remaining gap is scope: "all matching webhooks" with no filters leaves the agent unsure which webhooks will actually fire, which matters for a non-idempotent, open-world trigger.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

There are zero parameters, so the baseline is 4; the input schema is empty and the description's "Parameters: None" is consistent with it. Nothing further is required.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description gives a concrete verb and resource ("Trigger a test execution of all matching webhooks") and adds the key qualifier "without a real event," which tells an agent this fires webhooks with synthetic payloads. It stops short of distinguishing itself explicitly from the sibling contract-testing_execute_webhook (singular), and "matching" is never defined.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

It implies a testing use case via "without a real event," but never states when to choose this over contract-testing_execute_webhook, nor any preconditions such as webhooks needing to exist or be configured. No exclusions or alternatives are named.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Deploy Server

Other Tools