Skip to main content
Glama
Hardik-Singh

Invariance MCP

Official
by Hardik-Singh

invariance_monitor_evaluate

Execute a monitor on demand with an optional input scope, returning the resulting run and any signals, findings, or reviews produced.

Instructions

Manually evaluate a monitor right now against an explicit input scope (returns the resulting execution plus any signals/findings/reviews produced).

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
idYes
inputNoEvaluateMonitorRequest as a JSON object string. All fields optional. Fields: run_id (string — restrict eval to one run), since (ISO-8601 timestamp — only nodes after this), limit (int — max nodes to consider). Example: {"run_id":"run_abc123","limit":50} or {} to evaluate against the monitor's default scope.

Schema Changelog

Changes observed during successful MCP inspections.

  1. First observedv0.3.0

TDQS

A4.2/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate non-read-only and non-destructive behavior, and the description reinforces the side-effect profile by saying the evaluation returns 'the resulting execution plus any signals/findings/reviews produced.' This tells an agent that the call can create evaluation artifacts, not just read data. It does not mention cost/time or permissions, but the core mutation behavior is clear.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

A single sentence puts the action and scope first, with the return payload in a parenthetical. There is no filler and no redundant repetition of schema details.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With no output schema, the description usefully summarizes the return payload (execution plus signals/findings/reviews), and input semantics are mostly delegated to the schema. It is sufficient for a simple two-parameter tool, though the implicit `id` and lack of explicit alternative routing leave small completeness gaps.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The `input` parameter is well-specified in the schema with field meanings, types, and an example, so the description only needs to echo the concept of scope. However, the required `id` parameter has no description in the schema and is only implicitly a monitor identifier from the tool description. This is the main semantic gap.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description names a specific action ('Manually evaluate'), a resource ('a monitor'), a timing/trigger ('right now'), and a scope qualifier ('explicit input scope'). It also states what is returned, making it easy to distinguish from monitor_executions or preview-oriented sibling tools.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The phrase 'Manually evaluate a monitor right now' provides clear context for on-demand use, and 'against an explicit input scope' signals when a scoped, one-off evaluation is appropriate. It does not explicitly name sibling alternatives or state when not to use them, so it stops short of a full routing guide.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Deploy Server

Other Tools