Skip to main content
Glama
hermegeddon

Hermes Toolkit MCP

by hermegeddon

Start Hermes skill eval job

hermes_skill_eval_start

Validate a skill ID and read boundary, then start a bounded dry or live-gated evaluation job without modifying the skill file. Run safe eval runs against configured suites and backends.

Instructions

Validate a skill id/read boundary, then start a bounded dry/live-gated eval job without writing the skill file.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
homeNo
modelNo
suiteYes
sourceNo
backendNolibrary
profileNo
workersNo
base_urlNo
skill_idYes
live_evalNo
hermes_binNo
judge_modelNo
toolkit_rootNo
timeout_secondsNo

Output Schema

TableJSON Schema
NameRequiredDescriptionDefault
okYes
dataNo
scopeNo
run_idNo
statusYes
messageNo
verdictNounknown
evidenceNo
mutationNo
warningsNo
live_callNo
retryableNo
error_codeNo
duration_msNo
http_statusNo
policy_tierNoread_only
artifact_dirNo
likely_causeNo
next_actionsNo
safe_next_actionNo
redactions_appliedNo
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With annotations present (readOnlyHint=false, destructiveHint=false, idempotentHint=false), the description adds useful behavioral context about what it does NOT do ('without writing the skill file') and the 'dry/live-gated' and 'bounded' nature. However, it doesn't disclose detail about output/return behavior, error conditions, or side effects of starting an eval job.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single dense sentence that packs several key semantic points (validation step, read boundary, dry/live gating, no file write). It's efficient and front-loaded with the purpose. No wasted words, though the density does trade off some clarity.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The tool has 14 parameters, an output schema, and only 2 required fields, with no annotation support (no idempotent/destructive/read-only hints that would help the agent). The description covers the core intent but leaves critical questions unanswered: what does the output contain, how does 'bounded' map to timeout_seconds, what happens with live_eval=true, and how it relates to the other eval-related sibling tools.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the description must compensate for 14 parameters, but it explains none of them. Terms like 'bounded' and 'dry/live-gated' hint at live_eval and timeout_seconds, but no parameter is explicitly mapped or documented beyond the schema defaults. With 14 params and 0% coverage, this is a substantial gap.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states a clear verb sequence: 'Validate a skill id/read boundary, then start a bounded dry/live-gated eval job without writing the skill file.' This clearly identifies the resource (skill eval job) and action (validate + start). However, it doesn't explicitly distinguish from sibling tools like hermes_eval_start, hermes_eval_run, or hermes_api_jobs_create which appear related.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description says it validates a skill id/read boundary and starts a 'bounded dry/live-gated' eval job, which conveys some context about when to use it. However, it provides no explicit when-to-use vs alternatives guidance, no exclusions, and doesn't clarify when this tool should be chosen over the closely-named siblings hermes_eval_start or hermes_eval_run.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Install Server

Other Tools

Latest Blog Posts

MCP directory API

We provide all the information about MCP servers via our MCP API.

curl -X GET 'https://glama.ai/api/mcp/v1/servers/hermegeddon/hermes-toolkit-mcp'

If you have feedback or need assistance with the MCP directory API, please join our Discord server