Skip to main content
Glama

run_agent_auto_test

Start Convocore automated agent test suite (POST /auto-test/run). Modes include tools-only, with-tools, kb-only, full. Returns testId/status/score. Prefer this for broader regression; use test_agent_tool for a single tool.

Tool call template

Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.

{
  "id": 1,
  "jsonrpc": "2.0",
  "method": "tools/call",
  "params": {
    "arguments": {
      "agentId": "<agentId>"
    },
    "name": "run_agent_auto_test"
  }
}

Input Schema

NameRequiredDescriptionDefault
configNo
agentIdYes

Schema Changelog

Changes observed during successful MCP inspections.

  1. First observed

TDQS

A3.8/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare this is a non-readonly, non-destructive, non-idempotent operation, all local. The description adds the returned fields (testId/status/score) and the mode set, which is useful. It does not say whether the run is synchronous or whether testId must be polled elsewhere, nor anything about runtime/cost for long suites — the most important ambiguity for a "start" operation.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Three short sentences: what it does, what it returns, and the routing hint, all front-loaded with no filler. The endpoint reference is compact and useful rather than wasted.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a nested-config, no-output-schema tool, the description covers purpose and return fields well enough to attempt a call with only agentId. But it leaves the async/sync question open and does not explain the config knobs an agent would need to run a meaningful regression mode.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0% and the config object has six nested properties, yet the description only touches testMode — and even then lists four modes while the enum has six (prompt-only and with-kb are omitted). agentId, enableKB, maxTurns, naturalEnd, testScenario and enabledToolIds get no explanation at all.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

States a specific verb and resource ("Start Convocore automated agent test suite") and even pins the underlying endpoint (POST /auto-test/run). It distinguishes itself from the sibling test_agent_tool by scope, so the agent can pick it without opening the schema.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

"Prefer this for broader regression; use test_agent_tool for a single tool" names the alternative and the condition that selects it. There are no exclusions or prerequisites (e.g. agent must exist/be published) beyond that, but the core routing decision is explicit.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.

Resources