Skip to main content
Glama
smallest-inc

Smallest MCP Server

Official
by smallest-inc

compare_version_metrics

Compare call performance metrics between two versions: total calls, answered, average duration, completion rate, cost, and percentage deltas. Filter by date range to determine which version to keep active.

Instructions

A/B compare call performance metrics between two published versions. Shows total calls, answered calls, average duration, completion rate, total cost, and percentage deltas. Optionally filter by date range. Use this to evaluate which version performs better before deciding which to keep active.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
agent_idYesThe agent ID
version_aYesFirst version ID to compare
version_bYesSecond version ID to compare
date_fromNoStart date for metrics (ISO 8601 format, e.g. '2025-01-01')
date_toNoEnd date for metrics (ISO 8601 format, e.g. '2025-01-31')
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations provided, so description is sole source. It mentions metrics and optional date filtering but lacks statements about safety (read-only), rate limits, or required permissions. Adequate but could be more transparent.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two sentences: first states what tool does and output; second states when to use. Front-loaded and every sentence is valuable.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given 5 well-described parameters, no output schema, and siblings like diff_versions and get_version, the description provides enough context to understand and use the tool correctly.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so baseline is 3. Description adds value by explaining the tool's purpose and listing metrics, going beyond raw schema definitions.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states it does A/B comparison of call performance metrics between two versions, listing specific metrics (total calls, answered calls, duration, etc.). This differentiates it from siblings like diff_versions (code diff) and get_version (single version info).

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Explicitly says 'Use this to evaluate which version performs better before deciding which to keep active.' No exclusion or alternative guidance, but context is clear and sufficient for typical usage.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Install Server

Other Tools

Latest Blog Posts

MCP directory API

We provide all the information about MCP servers via our MCP API.

curl -X GET 'https://glama.ai/api/mcp/v1/servers/smallest-inc/mcp-server'

If you have feedback or need assistance with the MCP directory API, please join our Discord server