Skip to main content
Glama
ModelBound
by ModelBound

skill.createTestCase

Create a saved automated check test case for a skill. Requires skill_id, name, and prompt. Optional notes for grading.

Instructions

Create a saved automated check test case for a skill. Requires skill_id, name, and prompt. Optional notes for grading.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
nameYes
notesNo
promptYes
skill_idYes
cross_repoNo

Schema Changelog

Changes observed during successful MCP inspections.

  1. Addedv0.9.0

TDQS

C2.9/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations exist, so the description carries the full behavioral burden. 'Saved' hints at persistence, but the description says nothing about permissions required, whether duplicate names are rejected, validation rules, or side effects on the skill's evaluation set.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two short sentences with the required-parameter summary front-loaded and set off by periods. No filler or repetition; it just stops short of adding higher-value information.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a mutation tool with no annotations, no output schema, and 0% schema coverage across five parameters, the definition is too thin. It omits return behavior, the meaning of cross_repo, and any prerequisite context needed to invoke it confidently.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 0%, so the description must compensate. It names four of five parameters (skill_id, name, prompt as required; notes 'for grading'), which is useful, but cross_repo is completely undocumented anywhere and the format/meaning of skill_id and prompt is not clarified.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

States a specific verb+resource: 'Create a saved automated check test case for a skill.' An agent can tell the general action. However, it does not differentiate from the sibling eval.createCase, which appears to create a similarly-named artifact, so the boundary is left ambiguous.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No when-to-use guidance is provided. With siblings like eval.createCase, skill.test, and skill.testCases present, the description never says under what circumstances this tool should be chosen over those alternatives, leaving routing entirely to inference.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.