Skip to main content
Glama

agentcheck_add_check

Add a check to one of your targets. A check runs an input (http path/prompt, mcp tool call, a2a message) on a schedule and judges the answer with a golden: exact, contains, regex and json_schema cost nothing; rubric and baseline use the LLM judge (baseline = same outcome as the last known-good answer). Returns the check id. Requires an API key.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
kindYeswhat to run: http (GET path or POST prompt), mcp_tools_list, mcp_tool_call (tool + args), a2a_task (message)
nameYesshort name shown on the status page
inputNohttp: { path?, method?, body?, prompt? } · mcp_tool_call: { tool, args } · a2a_task: { message }
goldenYeshow the answer is judged. exact / contains / regex / json_schema are free and deterministic; rubric and baseline call the LLM judge, and baseline compares against the last known-good answer.
targetIdYesid from agentcheck_create_target or GET /api/v1/targets
intervalSecNoseconds between runs; the tier's interval is the floor (Free hourly, Starter+ 5 min)

Schema Changelog

Changes observed during successful MCP inspections.

  1. Changed1 schema field changed
    • addedInput schema / properties / golden / description
      Added value: +"how the answer is judged. exact / contains / regex / json_schema are free and deterministic; rubric and baseline call the LLM judge, and baseline compares against the last known-good answer."
  2. First observed

TDQS

A3.9/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations only declare the write/idempotency profile; the description adds genuinely useful context beyond them: it returns the check id, requires an API key, and discloses the cost model (exact/contains/regex/json_schema are free, rubric/baseline invoke the LLM judge). It does not discuss scheduling floors or error behavior, which the schema partly covers.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Three dense sentences, front-loaded with purpose and outcome before the cost/auth notes. No wasted phrasing, though the cost clause is somewhat redundant with the schema.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a nested-object mutation tool with no output schema, the description covers the essential missing pieces: the return value (check id) and the auth prerequisite. Scheduling cadence and tier floors are left to the schema, but nothing critical for correct invocation is absent.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the schema already documents all six parameters, including the golden kinds and cost. The description restates the golden cost distinction and the meaning of baseline, adding marginal value beyond the schema's own nested descriptions.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Specific verb+resource ('Add a check to one of your targets') plus a compact definition of what a check is ('runs an input... on a schedule and judges the answer with a golden'). This clearly distinguishes it from siblings like create_target, run_now, and record.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies the workflow (you need a target first, per the targetId reference) and notes the API key requirement, but it never states when to prefer this over run_now or record, nor any exclusions or prerequisites beyond the auth note.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.