Skip to main content
Glama

IA-QA — 152 QA & Dev Tools for AI Agents

latency_benchmark

Read-only

Measure response time of one or more HTTP endpoints (GET/POST). Runs N iterations and returns min/max/avg/p95 latency. Useful for API and MCP server benchmarking.

Input Schema

NameRequiredDescriptionDefault
endpointsYesEndpoints to benchmark. Accepts a single URL string, an array of URL strings, or an array of {url, method?, body?, headers?, label?} objects.
iterationsNoNumber of iterations per endpoint (default: 3, max: 10)

Output Schema

NameRequiredDescriptionDefault
resultsNo
iterationsNo

Schema Changelog

Changes observed during successful MCP inspections.

  1. Changed1 schema field changed
    • addedInput schema / examples
      Added value: +[
      +  {
      +    "endpoints": "https://www.ia-qa.com/mcp/ping",
      +    "iterations": 3
      +  }
      +]
  2. Changed1 schema field changed
    • changedInput schema / properties / endpoints / type
      Previous value: -"array"New value: +[
      +  "string",
      +  "array"
      +]
  3. Changed1 schema field changed
    • changedInput schema / properties / endpoints / description
      Previous value: -"Endpoints to benchmark"New value: +"Endpoints to benchmark. Accepts a single URL string, an array of URL strings, or an array of {url, method?, body?, headers?, label?} objects."
  4. Changed1 schema field changed
    • addedOutput schema / properties
      Added value: +{
      +  "iterations": {
      +    "type": "number"
      +  },
      +  "results": {
      +    "items": {
      +      "type": "object"
      +    },
      +    "type": "array"
      +  }
      +}
  5. Changed2 schema fields changed
    • addedInput schema / properties / endpoints / items / properties / body / additionalProperties
      Added value: +true
    • addedInput schema / properties / endpoints / items / properties / headers / additionalProperties
      Added value: +true
  6. Changed1 schema field changed
    • changedOutput schema / (root)
      Previous value: -nullNew value: +{
      +  "additionalProperties": true,
      +  "type": "object"
      +}
  7. First observed

TDQS

A3.8/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnly/openWorld/non-idempotent, so the safety bar is lower; the description still adds real value by stating that N requests are fired per endpoint and which statistics are computed. It omits timeouts, error handling on failed endpoints, and the auth/header requirements for targets. Note a mild tension worth surfacing: readOnlyHint=true but POST bodies are supported and repeated, so external endpoints may see state changes.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Three short sentences, front-loaded with the action and the returned metrics, with no redundancy or filler. The benchmarking-purpose sentence is the only soft one and still conveys applicability.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With an output schema present, return values need no explanation, and the annotations carry the safety profile. Remaining gaps are operational details an agent would want — per-endpoint timeout, behavior when an endpoint errors, and whether requests are sequential — but nothing essential to invoking it correctly is missing.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so both parameters (endpoints and iterations, including the accepted string/array/object shapes) are already fully documented in the schema. The description adds only the parenthetical GET/POST mention and no syntax, limits, or defaults beyond what the schema states; baseline 3 applies.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

States a specific verb and resource ("Measure response time of one or more HTTP endpoints") plus the metrics returned (min/max/avg/p95), which clearly separates it from siblings like http_status_lookup or rate_tool. It does not explicitly name or exclude any sibling, so it stops short of full differentiation.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The trailing "Useful for API and MCP server benchmarking" implies the use case but gives no when-not conditions, prerequisites (auth headers, permissions), or alternative tools for related checks. The agent must infer that this is for timing rather than correctness or security testing.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.