Skip to main content
Glama

devtune_get_agent_picks_cells

Read-onlyIdempotent

Read per-model cells for 1 to 8 distinct project-owned tests from test history. Returns coverage, the shared loss verdict, own-led status, fallback guesses and none/unclassified/other-tool run counts, plus per-tool picks, pick rates and Wilson ranges, with stated_picks, installs and the install rate and range beside each pick rate (null for built_its_own and no_provider). Each test’s install_rate_hidden_reason is no_installable_tool when none of the test’s tools has a package, config name or import pattern to install (a hosted dashboard): every install_rate is then null, not 0; report the pick rate alone and say why. Each test includes status. Non-completed tests retain coverage only: tools are unmeasured and measurement counts, rates, ranges and verdicts are null. Each test includes comparison_key for its category and recorded requests, job line and job signals. With no recorded request metadata, the key covers only category_id. Compare equal keys only and break history lines when they change. Each test includes outcome_counts_available; its outcome counts are null when completed run detail is unavailable. Unmeasured tools have measured false and null rates. Completed counts and displayed rates include fallback guesses; loss verdicts exclude them. Requires Agent Picks and visibility.read.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
test_idsYes

Schema Changelog

Changes observed during successful MCP inspections.

  1. Added

TDQS

A3.8/5.0
Behavior5/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations only declare readOnly/idempotent/non-destructive, so the description carries the interpretive burden and does so thoroughly: it explains null semantics for non-completed tests and unmeasured tools, that install_rate is null (not 0) when install_rate_hidden_reason is no_installable_tool, that fallback guesses are included in counts but excluded from loss verdicts, that outcome counts vanish when run detail is unavailable, and that the feature and visibility.read are required.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness3/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The first sentence is well front-loaded, but the remainder is a dense, run-on enumeration of output fields packed into a handful of overloaded sentences, several of which repeat 'Each test includes...' openings. Length is partly justified by the absence of an output schema, but the structure is hard to scan.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With no output schema, no annotations beyond safety flags, and a complex payload, the description is unusually complete on return semantics: it enumerates the returned fields, null conditions, comparison_key behavior, and measurement caveats. It stops short of telling the agent how to source test_ids, the one thing needed to actually call the tool.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 0% and there is a single parameter (test_ids), so the description must compensate. It constrains the parameter meaningfully — '1 to 8 distinct project-owned tests' — implying these are project-owned test UUIDs and matching minItems/maxItems, but it never defines where an agent obtains valid test IDs, leaving a real gap.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The opening sentence gives a specific verb (Read), a specific resource (per-model cells), and a scope (1-8 distinct project-owned tests from test history), which is clear enough for an agent to identify the operation. However, it does not explicitly differentiate itself from closely related siblings such as devtune_get_agent_picks_test or devtune_get_agent_picks_history, so sibling disambiguation is left to inference.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides some operative guidance — 'Compare equal keys only and break history lines when they change', 'report the pick rate alone and say why' — and states the required Agent Picks feature and visibility.read permission. It never says when to choose this tool over the adjacent agent-picks siblings, so usage context is only implied.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.

Resources