Skip to main content
Glama

Sandbox-truth probe for agent frameworks

sandbox_gate

Dispatch-gate evaluation: pin, DEAD-FLAG, stale-hash, freshness and framework refusal (fail-closed allowlist).

Tool call template

Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.

{
  "id": 1,
  "jsonrpc": "2.0",
  "method": "tools/call",
  "params": {
    "arguments": {
      "receipt": "<receipt>"
    },
    "name": "sandbox_gate"
  }
}

Input Schema

NameRequiredDescriptionDefault
receiptYes
max_age_secondsNo
expected_frameworkNo
expected_source_hashNo

Schema Changelog

Changes observed during successful MCP inspections.

  1. Changed2 schema fields changed
    • addedInput schema / properties / expected_framework
      Added value: +{
      +  "type": "string"
      +}
    • addedInput schema / properties / max_age_seconds
      Added value: +{
      +  "type": "integer"
      +}
  2. First observed

TDQS

C2.4/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description must carry the full behavioral burden. It mentions fail-closed allowlist behavior and framework refusal, which is useful, but it does not state whether the tool is read-only, what side effects occur, what a successful or refused result looks like, or any auth/rate-limit requirements.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness3/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single short sentence, so it is not bloated. However, it front-loads an opaque label ('Dispatch-gate evaluation') and then lists domain jargon without making the actionable purpose clear.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given a complex gate-evaluation tool with four parameters, a required nested receipt object, no output schema, no annotations, and 0% schema description coverage, the description is far too thin. It omits critical details about receipt structure, evaluation outcomes, and when the tool should be selected.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the description must compensate. It hints at concepts like freshness, stale-hash, and framework refusal that loosely map to max_age_seconds, expected_source_hash, and expected_framework, but it does not explain these mappings or the required nested receipt object, leaving parameter semantics largely opaque.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose3/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description indicates a 'Dispatch-gate evaluation' and lists checks such as pin, stale-hash, freshness, and framework refusal, so an agent can infer it evaluates gate criteria. However, the phrasing is noun-heavy and jargon-laden, and it does not clearly distinguish this tool from siblings like sandbox_verify_receipt or sandbox_cached_verdict.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

There is no explicit guidance on when to use this tool versus alternatives. The sibling tools are not mentioned, and there are no prerequisites, exclusions, or contextual triggers provided.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.

Resources