Skip to main content
Glama
SmartBear MCP server

SmartBear MCP server

Official
by SmartBear

Contract Testing: Get Metrics

contract-testing_get_metrics
Read-onlyIdempotent

Fetch metrics across your entire workspace to monitor testing performance and identify issues. Retrieve comprehensive data for analysis and decision-making.

Instructions

Fetch metrics across the entire workspace

Toolset: Metrics

Parameters: None

Input Schema

NameRequiredDescriptionDefault

No arguments

Output Schema

NameRequiredDescriptionDefault
tagsNo
teamsNo
usersNo
matrixNo
secretsNo
webhooksNo
environmentsNo
integrationsNo
interactionsNo
pactVersionsNo
pacticipantsNo
deployedVersionsNo
pactPublicationsNo
releasedVersionsNo
triggeredWebhooksNo
webhookExecutionsNo
pacticipantVersionsNo
verificationResultsNo
crossContractComparisonsNo
providerContractVersionsNo
providerContractPublicationsNo
pactRevisionsPerConsumerVersionNo
providerContractSelfVerificationsNo
verificationResultsPerPactVersionNo

Schema Changelog

Changes observed during successful MCP inspections.

  1. Changed1 schema field changedv0.43.0
    • changedOutput schema / (root)
      Previous value: -nullNew value: +{
      +  "$schema": "https://json-schema.org/draft/2020-12/schema",
      +  "additionalProperties": {},
      +  "properties": {
      +    "crossContractComparisons": {
      +      "additionalProperties": {},
      +      "properties": {
      +        "count": {
      +          "type": "number"
      +        }
      +      },
      +      "type": "object"
      +    },
      +    "deployedVersions": {
      +      "additionalProperties": {},
      +      "properties": {
      +        "count": {
      +          "type": "number"
      +        },
      +        "currentlyDeployedCount": {
      +          "type": "number"
      +        },
      +        "userCreatedCount": {
      +          "type": "number"
      +        }
      +      },
      +      "type": "object"
      +    },
      +    "environments": {
      +      "additionalProperties": {},
      +      "properties": {
      +        "count": {
      +          "type": "number"
      +        }
      +      },
      +      "type": "object"
      +    },
      +    "integrations": {
      +      "additionalProperties": {},
      +      "properties": {
      +        "count": {
      +          "type": "number"
      +        }
      +      },
      +      "type": "object"
      +    },
      +    "interactions": {
      +      "additionalProperties": {},
      +      "properties": {
      +        "latestInteractionsAndMessagesCount": {
      +          "type": "number"
      +        },
      +        "latestInteractionsCount": {
      +          "type": "number"
      +        },
      +        "latestMessagesCount": {
      +          "type": "number"
      +        }
      +      },
      +      "type": "object"
      +    },
      +    "matrix": {
      +      "additionalProperties": {},
      +      "properties": {
      +        "count": {
      +          "description": "Hardcoded to -1 by current brokers (calculating it was too slow); older brokers return the real count.",
      +          "type": "number"
      +        }
      +      },
      +      "type": "object"
      +    },
      +    "pactPublications": {
      +      "additionalProperties": {},
      +      "properties": {
      +        "count": {
      +          "type": "number"
      +        },
      +        "first": {
      +          "type": [
      +            "string",
      +            "null"
      +          ]
      +        },
      +        "last": {
      +          "type": [
      +            "string",
      +            "null"
      +          ]
      +        }
      +      },
      +      "type": "object"
      +    },
      +    "pactRevisionsPerConsumerVersion": {
      +      "additionalProperties": {},
      +      "properties": {
      +        "distribution": {
      +          "additionalProperties": {},
      +          "properties": {},
      +          "type": "object"
      +        }
      +      },
      +      "type": "object"
      +    },
      +    "pactVersions": {
      +      "additionalProperties": {},
      +      "properties": {
      +        "count": {
      +          "type": "number"
      +        }
      +      },
      +      "type": "object"
      +    },
      +    "pacticipantVersions": {
      +      "additionalProperties": {},
      +      "properties": {
      +        "count": {
      +          "type": "number"
      +        },
      +        "withBranchCount": {
      +          "type": "number"
      +        },
      +        "withBranchSetCount": {
      +          "type": "number"
      +        },
      +        "withUserCreatedBranchCount": {
      +          "type": "number"
      +        }
      +      },
      +      "type": "object"
      +    },
      +    "pacticipants": {
      +      "additionalProperties": {},
      +      "properties": {
      +        "count": {
      +          "type": "number"
      +        },
      +        "withMainBranchSetCount": {
      +          "type": "number"
      +        }
      +      },
      +      "type": "object"
      +    },
      +    "providerContractPublications": {
      +      "additionalProperties": {},
      +      "properties": {
      +        "count": {
      +          "type": "number"
      +        }
      +      },
      +      "type": "object"
      +    },
      +    "providerContractSelfVerifications": {
      +      "additionalProperties": {},
      +      "properties": {
      +        "count": {
      +          "type": "number"
      +        }
      +      },
      +      "type": "object"
      +    },
      +    "providerContractVersions": {
      +      "additionalProperties": {},
      +      "properties": {
      +        "count": {
      +          "type": "number"
      +        }
      +      },
      +      "type": "object"
      +    },
      +    "releasedVersions": {
      +      "additionalProperties": {},
      +      "properties": {
      +        "count": {
      +          "type": "number"
      +        },
      +        "currentlySupportedCount": {
      +          "type": "number"
      +        }
      +      },
      +      "type": "object"
      +    },
      +    "secrets": {
      +      "additionalProperties": {},
      +      "properties": {
      +        "count": {
      +          "type": "number"
      +        },
      +        "countsByTeam": {
      +          "items": {
      +            "type": "number"
      +          },
      +          "type": "array"
      +        }
      +      },
      +      "type": "object"
      +    },
      +    "tags": {
      +      "additionalProperties": {},
      +      "properties": {
      +        "count": {
      +          "type": "number"
      +        },
      +        "distinctCount": {
      +          "type": "number"
      +        },
      +        "distinctWithPacticipantCount": {
      +          "type": "number"
      +        }
      +      },
      +      "type": "object"
      +    },
      +    "teams": {
      +      "additionalProperties": {},
      +      "properties": {
      +        "count": {
      +          "type": "number"
      +        }
      +      },
      +      "type": "object"
      +    },
      +    "triggeredWebhooks": {
      +      "additionalProperties": {},
      +      "properties": {
      +        "count": {
      +          "type": "number"
      +        }
      +      },
      +      "type": "object"
      +    },
      +    "users": {
      +      "additionalProperties": {},
      +      "properties": {
      +        "activeRegularCount": {
      +          "type": "number"
      +        },
      +        "activeSystemCount": {
      +          "type": "number"
      +        }
      +      },
      +      "type": "object"
      +    },
      +    "verificationResults": {
      +      "additionalProperties": {},
      +      "properties": {
      +        "count": {
      +          "type": "number"
      +        },
      +        "distinctCount": {
      +          "type": "number"
      +        },
      +        "failureCount": {
      +          "type": "number"
      +        },
      +        "first": {
      +          "type": [
      +            "string",
      +            "null"
      +          ]
      +        },
      +        "last": {
      +          "type": [
      +            "string",
      +            "null"
      +          ]
      +        },
      +        "successCount": {
      +          "type": "number"
      +        }
      +      },
      +      "type": "object"
      +    },
      +    "verificationResultsPerPactVersion": {
      +      "additionalProperties": {},
      +      "properties": {
      +        "distribution": {
      +          "additionalProperties": {},
      +          "properties": {},
      +          "type": "object"
      +        }
      +      },
      +      "type": "object"
      +    },
      +    "webhookExecutions": {
      +      "additionalProperties": {},
      +      "properties": {
      +        "count": {
      +          "type": "number"
      +        }
      +      },
      +      "type": "object"
      +    },
      +    "webhooks": {
      +      "additionalProperties": {},
      +      "properties": {
      +        "count": {
      +          "type": "number"
      +        }
      +      },
      +      "type": "object"
      +    }
      +  },
      +  "type": "object"
      +}
  2. Addedv0.40.0
  3. Removedv0.34.0
  4. First observedv0.27.1

TDQS

A3.5/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint, idempotentHint, openWorldHint=false and destructiveHint=false, so the safety profile needs no restating. The description adds only the workspace-wide scope; it says nothing about aggregation period, freshness, or cost of the call.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

One sentence, front-loaded, no wasted prose. The 'Toolset' and 'Parameters: None' blocks are boilerplate that adds little, but they are not harmful.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With an output schema present and no inputs, the description needn't explain return values. The remaining gap is the undefined notion of 'metrics' — an agent cannot predict whether this covers pact verification counts, deployments, or team activity without invoking it.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The tool takes zero parameters, which is the baseline-4 case; there is no parameter meaning to add. The explicit '**Parameters:** None' line merely restates an empty schema and earns no extra credit.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

States a specific verb and resource ('Fetch metrics') plus a scope qualifier ('across the entire workspace') that implicitly separates it from the sibling contract-testing_get_team_metrics. What 'metrics' actually contains is undefined, so the agent knows the shape of the call but not the data it returns.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Usage is only implied through the 'entire workspace' scope, which hints that team-scoped numbers belong to get_team_metrics. No explicit when-to-use, when-not-to-use, or named alternative is given.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Deploy Server

Other Tools