Skip to main content
Glama

colmena-mcp 🐝

Servidor MCP (stdio) para que Claude Code orqueste y valide, como un product manager, mientras una colmena de agentes obreros —Codex (Luna) y OpenCode (DeepSeek, etc.)— hace el trabajo pesado. Tú gastas pocos tokens: briefs cortos de ida, reportes de ≤15 líneas de vuelta.

  • Workers por alias en un colmena.yml: proveedor + modelo + esfuerzo + prioridad + presupuesto y, opcionalmente, free: true para registrar costo cero. Las herramientas solo aceptan un alias, nunca un modelo o flag libre.

  • Presupuesto y ruteo: el servidor cuenta el gasto por worker y por mes; cada job puede reservar un costo estimado (reserve_usd) al encolar, de modo que N jobs concurrentes descuentan gasto + reservas y no agotan el mismo saldo. Un worker free conserva el costo nominal aparte, no reserva y no queda bloqueado por presupuesto. Sin worker explícito, elige el proveedor preferido disponible y luego aplica kind y prioridad.

  • Aislamiento por llamada: worktree (rama colmena/<id>, por defecto en repos git), inplace o readonly.

  • Paralelismo con cola, sesiones reanudables, resúmenes, compactación y relevo entre agentes.

  • Plugin notify: toast de Windows al lanzar agentes, latido cada 10 min mientras haya trabajo, y aviso al terminar o fallar.

  • Plugins report y present: crean un reporte HTML de la ronda y una presentación papercraft de cierre del hito, respectivamente.

  • Widget de escritorio: la tool widget inicia, consulta y cierra la escena animada de Colmena.

  • Mejora continua: improve lanza un agente que deja en docs/backlog/ ítems priorizados con briefs listos para delegar; report y wait te invitan cuando toca.

  • Sin base de datos: estado en ~/.colmena/ (jobs/, worktrees/, reports/, usage.json, activity.log, audit.log).

Requisitos

Node ≥ 22, git, y al menos uno de: Codex CLI autenticado (necesitas una versión reciente si usas esfuerzo max; 0.162 funciona, 0.130 lo rechaza) y/o OpenCode (≥ 1.18). Los binarios se detectan solos (codex.exe más reciente de %LOCALAPPDATA%\OpenAI\Codex\bin; el opencode.exe real detrás del shim npm).

Related MCP server: Claude PM MCP

Instalación

git clone https://github.com/jdsalasca/colmena-mcp.git
cd colmena-mcp
npm install
npm test
claude mcp add -s user colmena -- node "<ruta-absoluta>/colmena-mcp/src/server.js"

Humo real (gasta unas pocas llamadas): npm run smoke -- luna-max,ds-flash --report. Opcional y nunca en CI: por proveedor ejecuta una tarea mínima y comprueba, reportando cada una, la selección del worker y los metadatos persistidos (provider/model/effort) frente a colmena.yml, el formato RESULT/FILES/TESTS/RISKS, la señal final del proveedor cuando la emite (Codex: turn.completed; OpenCode no emite señal final) y que el modelo expuesto en sus eventos coincida con el configurado — si el proveedor no lo expone, el smoke no afirma el modelo ejecutado. Devuelve código distinto de cero si alguna comprobación falla y elimina sus temporales incluso en fallo.

Configuración: colmena.yml

Ubicación: $COLMENA_CONFIG o ~/.colmena/colmena.yml. Sin archivo se usan los valores por defecto. Ejemplo completo en colmena.example.yml:

workers:
  luna-max:       {provider: codex,    model: gpt-6-luna, effort: max, priority: 1, strengths: [code, refactor, tests]}
  ds-flash:       {provider: opencode, model: opencode-go/deepseek-v4.1-flash, effort: max, priority: 2, strengths: [code, docs, summary, report], budget: {monthly_usd: 10}}
  max-hive:       {provider: opencode, model: opencode-go/muse-spark-1.3-contributor, effort: high, priority: 9, strengths: [bulk], budget: {monthly_usd: 5}}
roles:    {reporter: ds-flash, summarizer: ds-flash, reviewer: luna-max, presenter: luna-max}
defaults: {worker: luna-max, max_parallel: 4, timeout_min: 60, exit_grace_s: 20, retry_transient: 1, wait_max_s: 600, cancel_jobs_on_shutdown: false, reserve_usd: 0}
preferences: {provider: auto} # codex | opencode para priorizar un proveedor sin reiniciar
plugins:
  notify: {enabled: true, on: [start, finish, fail], heartbeat_min: 10}
  report: {enabled: true, default_style: papercraft}
  present: {enabled: true, default_style: papercraft-deck}
  improve: {enabled: true, hints: true}
  widget: {enabled: true}
standards:
  enabled: true
  # preamble: |-
  #   Personaliza el preámbulo español integrado para tus jobs run.
providers:
  opencode:
    isolate_config: true
    # config_dir: C:/Users/tu-usuario/.colmena/opencode-config

Notas:

  • defaults.exit_grace_s (20 s) da tiempo al proceso de Codex para salir después de entregar su mensaje final y emitir turn.completed. Si sigue activo al vencer, Colmena mata el árbol del proceso y termina el job como done, con finishedByGrace: true y un mensaje en el resultado. Si llega antes el timeout general pero Codex ya entregó, también queda done; OpenCode no usa esta gracia porque step_finish puede ser solo un paso intermedio. Edita el YAML y llama a reload_config para aplicar workers, roles, defaults, plugins y proveedores sin reiniciar.

  • defaults.cancel_jobs_on_shutdown es false por defecto: al cerrar el servidor MCP se detienen sus lectores y temporizadores, pero los procesos desacoplados siguen trabajando y escriben events.jsonl / stderr.log en su job. La siguiente instancia adopta los procesos vivos, recupera los terminados desde su offset guardado y reencola los pendientes (su prompt queda en prompt.txt hasta que arrancan o se cancelan). Usa true para volver a cancelar los jobs en cola o en ejecución al cerrar; reload_config aplica el ajuste.

  • Los errores del proveedor que OpenCode escribe en events.jsonl ({"type":"error", error:{name, data:{message, isRetryable}}}) ya no se pierden: result.error nombra al proveedor real (opencode salió con código 1: <stderr o mensaje del evento>) y, cuando un job falla en menos de 30 s con un error reintentable (isRetryable: true o mensaje con Unexpected server error), Colmena lo reintenta automáticamente una vez en el mismo worktree y worker. defaults.retry_transient (entero ≥ 0, defecto 1; 0 desactiva el reintento) lo controla y reload_config lo recoge. El reintento es del mismo job: suma el uso de ambos intentos y lo registra una sola vez en el ledger, emite job.started/job.finished una sola vez y guarda meta.retries.

  • COLMENA_MAX_PARALLEL, COLMENA_JOB_TIMEOUT_MIN, COLMENA_EXIT_GRACE_S y COLMENA_RETRY_TRANSIENT y COLMENA_WAIT_MAX_S conservan prioridad sobre los valores YAML.

  • preferences.provider acepta auto (ruteo actual), codex u opencode. La tool preferences consulta la preferencia y el worker elegido ahora, o la cambia en memoria y en el YAML efectivo (COLMENA_CONFIG o $COLMENA_HOME/colmena.yml) para el siguiente run; no requiere reinicio. Si no hay workers disponibles de ese proveedor, el router usa otro y devuelve un note. worker explícito siempre manda; las tools auxiliares continúan usando sus roles.

  • workers muestra free por worker; stats {since_days?} resume jobs, éxito, duración, costo registrado y nominalCostUsd por worker, tokens, tipos y fallos de la ventana indicada (30 días por defecto). Por worker también separa la calidad observada: reviewed, accepted, needsWork, reviewCoverage y acceptanceRate cuentan solo veredictos explícitos de verdict, así que un job sin veredicto no cuenta como rechazado.

  • verdict {job_id, verdict: accepted|needs_work, note?} registra la aceptación humana del orquestador sobre un job ya revisado con review/diff. Es la única vía que fija el veredicto (nunca se infiere del estado done) y exige un job_id válido; meta.json conserva verdict, verdictNote y verdictAt. Regístralo antes de merge.

  • workers.<alias>.free: true declara que el modelo de ese worker está cubierto a costo cero: el ledger registra cost_usd: 0, meta.json conserva nominalCostUsd y result muestra cost_usd: 0 junto con nominal_cost_usd. El flag exime al worker de su presupuesto mensual. Úsalo solo si tu plan garantiza el costo cero; el costo nominal sigue visible para auditar lo que reportó el proveedor.

  • reserve_usd (por worker, o defaults.reserve_usd como valor global; defecto 0) es el costo estimado que cada job reserva al encolar. El router y la tool workers descuentan spent_usd + reserved_usd: un worker no acepta un job nuevo si su reserva no cabe en el presupuesto, así N jobs simultáneos no consumen el mismo saldo. Al terminar o cancelar, la reserva se libera y el ledger registra el costo real, aunque haya superado la estimación. Los jobs adoptados tras un reinicio conservan su reserva (meta.reservedUsd) y los huérfanos la liberan. Solo los workers con budget y sin free reservan.

  • meta.json, status y result conservan model, provider y effort del worker seleccionados al crear cada job, aunque la configuración se recargue después.

  • effort se pasa como model_reasoning_effort (Codex) o --variant (OpenCode).

  • providers.opencode.isolate_config está activo por defecto: OpenCode usa $COLMENA_HOME/opencode-config como XDG_CONFIG_HOME. Así no hereda los servidores MCP, plugins, agentes, AGENTS.md ni skills de la configuración global del usuario; los estándares de Colmena llegan por el preámbulo. La autenticación se conserva en XDG_DATA_HOME. Define config_dir para usar una configuración mínima propia (la carpeta se crea si falta), o isolate_config: false para volver a usar la configuración habitual.

  • Evidencia de la comparación reportada para una ejecución trivial: el contexto de entrada bajó de ~47k a ~8k tokens; opencode-go/deepseek-v4.1-flash bajó de $0.0074 a $0.0011 por ejecución; y opencode-go/cat-jam-free, que fallaba globalmente con maximum number of items is 128, respondió con costo reportado 0. La configuración global también hizo que un job usara chatgpt-coordinator durante más de 10 minutos y se observó ProviderHeaderTimeoutError en step-5-preview.

  • OpenCode informa el costo en USD de cada ejecución. Codex no: para contabilizarlo añade price_per_mtok: {input: …, output: …} al worker.

  • El saldo real de tus cuentas no se puede consultar por API: el presupuesto es declarativo + conteo local (usage.json, que además guarda las reservas de los jobs vivos).

  • Regla de reparto: Luna va solo por Codex (luna-max). En OpenCode Go el worker principal es DeepSeek V4.1 Flash (ds-flash, $0.15 entrada / $0.60 salida por Mtok, revisado 2026-10-16), con presupuesto mensual. No se usa Luna a través de OpenCode.

  • OpenCode carga mucho contexto propio (~30-50k tokens por ejecución): conviene delegarle tareas con cierto peso.

max-hive: maximizar tareas en paralelo a costo ~0

max-hive es el worker para maximizar muchas tareas pequeñas en paralelo con costo cercano a cero (tests masivos, generación repetitiva, migraciones mecánicas, auditorías por archivo, borradores). Usa un modelo "contributor" del plan Go: sin zero data retention (no le mandes secretos ni código sensible) y con calidad menor que luna-max, así que lo que produce lo valida el orquestador (review/diff) antes de fusionar. Tiene prioridad 9 y fortaleza bulk: el router solo lo elige si lo pides (worker: "max-hive" o kind: "bulk") o si no queda otro disponible.

  • Evita los modelos -free: traen cuota; max-hive busca modelos contributor del plan Go.

  • Costo ~0 no es verificable desde aquí: OpenCode reporta un costo nominal por ejecución (≈ $0.004 con muse-spark-1.3-contributor; gemini-4-argon-contributor ≈ $0.16, ¡caro!). Si tu plan Go cubre un modelo a costo cero, añade free: true a ese worker: Colmena registrará costo 0, preservará el nominal reportado y no lo bloqueará por presupuesto. Esto refleja tu declaración local, no verifica la factura real de tu cuenta. max-hive mantiene su tope de seguridad mientras no se marque free.

  • Cómo buscarle otro modelo (para Claude): node scripts/opencode-models.mjs --contributor lista los contributor del más barato al más caro; --max-out 0.6 --json filtra por precio. Elige el más barato con ventana de contexto suficiente, cambia model/effort en colmena.yml (si no ofrece max, usa su mejor variante), llama reload_config, y valídalo con una ejecución real (run con worker: "max-hive", isolation: "readonly") revisando cost_usd y que el reporte salga en formato RESULT/FILES/TESTS/RISKS.

Variables de entorno

COLMENA_HOME, COLMENA_CONFIG, COLMENA_CODEX_BIN, COLMENA_OPENCODE_BIN, COLMENA_MAX_PARALLEL, COLMENA_JOB_TIMEOUT_MIN, COLMENA_EXIT_GRACE_S, COLMENA_WAIT_MAX_S, COLMENA_NOTIFIER (toast|log|none). Los nombres LUNA_* de la v0.1 se siguen aceptando.

Herramientas

Tool

Para qué

workers

Workers con prioridad, fortalezas, preferencia (preferred), gasto del mes, reservado, restante y disponibilidad

preferences

Consulta o cambia en caliente auto / codex / opencode; muestra también el worker que elegiría el router

stats

Resumen histórico por estado, worker y tipo (since_days, defecto 30)

reload_config

Relee y valida colmena.yml; jobs posteriores usan los cambios sin reiniciar

run / run_many

Lanza uno o varios agentes (worker?, kind?, isolation?, wait: true espera el reporte)

wait, status, list

Seguimiento (wait hasta defaults.wait_max_s, defecto 600 s, tope 1800 s; timeout_s entre 1 y 1800; al vencer devuelve pending con estado y elapsedS sin cancelar; mode: any/all; añade hint de mejora continua al cerrar una ronda)

result

Reporte RESULT/FILES/TESTS/RISKS, archivos, diffstat, rama, worker, modelo, proveedor, esfuerzo y costos registrado/nominal

diff

Diff truncado; el completo queda en disco

continue

Reanuda la sesión (mismo worker y workdir)

summarize, compact

Resumen / brief de relevo de una sesión (rol summarizer)

handoff

Agente nuevo con los resúmenes de otros como contexto

review

Revisión solo lectura de un job o cwd (rol reviewer)

verdict

Registra la aceptación humana (accepted/needs_work, note?) de un job revisado; stats la agrega por worker

cancel

Cancela y mata el árbol de procesos

merge

Fusiona colmena/<id> (manual; se niega con destino sucio; restaura ante conflictos)

cleanup

Borra worktrees y ramas colmena/* propios (force para descartar trabajo no fusionado)

report

HTML de cierre de ronda (job_ids, style?, title?, open?); next sugiere present e indica lo que falta de improve

present

Presentación HTML papercraft de un hito (job_ids, title?, subtitle?, notes?, style?, open?)

improve

Mejora continua: agente en worktree que escribe docs/backlog/<fecha>-<focus>.md (backlog/features/debt/all) con briefs listos para delegar

widget

action: start | status | stop: agrega el widget al escritorio, consulta su PID verificado o lo cierra

Flujo recomendado: workers → run_many → wait → result → review/diff → verdict → merge → report → present → auditar el deck → improve. La skill skills/colmena-delegation explica cómo redactar los briefs y validar la presentación antes de compartirla.

Widget de escritorio

Usa widget {action: start} para abrir la escena; status informa running solo cuando el PID del registro coincide con la ruta real del proceso, y stop cierra ese proceso y espera su salida. El servidor hereda COLMENA_HOME; el registro Rust está en $COLMENA_HOME/widget-process.json. plugins.widget.enabled (defecto true) habilita la tool. El ejecutable se busca primero en COLMENA_WIDGET_BIN y luego en widget/dist/colmena-widget.exe. Si falta, compílalo dentro de widget/ con cargo build --release y copia target/release/colmena-widget.exe a dist/.

Notificaciones

Con plugins.notify activo recibes un toast de Windows agrupado al lanzar agentes, con el proveedor visible (luna-max (codex)), y un latido cada heartbeat_min mientras haya trabajos corriendo o en cola. Los avisos de término y fallo identifican el proveedor ([codex] luna-max). Todas las notificaciones terminan con un overview actualizado por proveedor, por ejemplo En curso: codex 2 · opencode 1 · +1 en cola, o En curso: ninguno cuando no queda trabajo. Sin trabajo no hay latido. El cuerpo del toast respeta el límite de 300 caracteres y acorta la tarea para conservar el overview. Todo queda también en ~/.colmena/activity.log.

Estilos HTML

Cada estilo es una carpeta styles/<nombre>/ con style.md y template.html; se buscan primero en ~/.colmena/styles/ y luego en el repo. papercraft genera reportes de ronda con tarjetas y papercraft-deck genera presentaciones por diapositivas. Si el agente de cualquiera de las tools falla o produce HTML inválido, se rellena la plantilla con un renderizador determinista (usedFallback: true).

Presentaciones de hitos

present {job_ids, title?, subtitle?, notes?, style?, open?} delega la redacción al rol presenter (por defecto luna-max, Codex) y crea <COLMENA_HOME>/reports/<fecha>-<slug>-deck/deck.html, junto con data.json con los jobs, métricas y notas del orquestador. plugins.present.enabled habilita la tool y plugins.present.default_style elige su estilo inicial (papercraft-deck). El HTML incluido funciona sin red ni frameworks, navega con flechas, espacio, Home y End, y tiene modo de impresión.

Al cerrar una feature o un hito, genera el deck y ábrelo para auditar cada afirmación frente a result, los archivos y las pruebas reales. Usa continue sobre presenterJob o vuelve a generar la presentación con correcciones concretas si hace falta. Comparte la ruta/enlace con el dueño solo después de aprobar la revisión; present no lo entrega ni lo publica automáticamente.

Mejora continua (plugin improve)

improve {cwd?, focus?, worker?} lanza un agente (el router usa kind: docs) en un worktree: analiza el repositorio y escribe docs/backlog/<YYYY-MM-DD>-<focus>.md con ítems priorizados (id, título, impacto, esfuerzo, riesgo y evidencia) y un brief autocontenido por ítem, listo para delegar con TDD/código limpio/DRY. focus: backlog, features, debt o all (defecto). Fusiona su rama como cualquier job (diff/review/merge).

Con plugins.improve: {enabled: true, hints: true} hay invitaciones (nunca asedio):

  • report añade next con la sugerencia de generar y auditar el deck, además de los foci de improve que no se lanzaron en las últimas 24 h para ese repositorio.

  • wait añade hint cuando todos los jobs terminaron y no hay improve reciente.

  • El prompt MCP continuous-improvement describe la ronda completa: workers → run_many → wait → review → merge → report → improve.

enabled: false oculta la tool, el prompt y las invitaciones; hints: false silencia solo las invitaciones. reload_config aplica el cambio en caliente.

Seguridad

Los agentes tienen internet por defecto: Codex con --search y OpenCode con webfetch; el preámbulo les pide consultar documentación y versiones actuales cuando dependan de una API o dato externo y citar la fuente. También corren sin sandbox ni aprobaciones (Codex: --dangerously-bypass-approvals-and-sandbox; OpenCode: --auto). Con inplace un agente puede modificar o borrar cualquier archivo accesible a tu usuario. Por eso worktree es el valor por defecto en repos git, merge nunca se ejecuta solo, cleanup solo toca colmena/* bajo COLMENA_HOME/worktrees, el YAML no admite flags arbitrarios y cada lanzamiento queda en audit.log. readonly es real: -s read-only en Codex y --agent plan en OpenCode (verificado). Úsalo solo en repos y máquinas de confianza.

Desarrollo

npm test usa proveedores falsos (test/fake-codex.js, test/fake-opencode.js) y repos git temporales; no gasta llamadas reales. Los fakes aceptan knobs de error de contrato sin red (FAKE_NO_FINAL, FAKE_EXPOSE_MODEL, FAKE_RAW) y test/runner.test.js ejecuta scripts/smoke.js contra ellos para validar las comprobaciones del humo real (npm run smoke, que no forma parte de npm test ni de CI). Diseño: docs/superpowers/specs/ · Planes: docs/superpowers/plans/.

Licencia MIT.

Available Tools

17 tools
cancelB

Cancela un job (mata el árbol de procesos).

ParametersJSON Schema
NameRequiredDescriptionDefault
job_idYes

TDQS

B3/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries the full behavioral burden. It does disclose one valuable trait — that cancellation kills the process tree, implying a destructive, non-graceful termination — but says nothing about permissions, idempotency, or behavior when the job is already finished.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

A single short clause with the destructive effect front-loaded in parentheses; nothing is wasted. It is arguably too terse for the gaps it leaves, but as structure it is tight and readable.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

No annotations and no output schema, and the lone parameter is undocumented in both schema and prose. For a simple cancel operation the description covers the essentials (what it does, destructiveness) but omits return behavior and failure conditions.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0% for the single required parameter, so the burden falls on the description, which never mentions job_id or its expected format. The description adds no parameter meaning at all.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

States a specific verb (cancel) and resource (a job), and the parenthetical 'mata el árbol de procesos' clarifies the actual effect. It does not differentiate itself from potential siblings like 'cleanup' or 'wait', but the core action is unambiguous.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

There is no guidance on when to use this versus alternatives such as 'cleanup' or 'wait', nor any stated preconditions (e.g. the job must be running). The reader is left to infer all usage context.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

cleanupB

Elimina worktrees y ramas colmena/* creados por este servidor (de un job, o más viejos que N días).

ParametersJSON Schema
NameRequiredDescriptionDefault
forceNonecesario para descartar trabajo no fusionado
job_idNo
older_than_daysNo

TDQS

B3.1/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries the full burden. It discloses that worktrees and branches are deleted, but says nothing about irreversibility, what happens to unmerged work, or that the operation is scoped only to artifacts this server created — the destructive consequence detail lives only in the schema's force field.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

A single front-loaded sentence with the action verb first and no filler. The packed parenthetical carries two modes but stays readable; nothing is wasted.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a destructive, zero-annotation tool with no output schema and only 33% parameter coverage, the description omits critical context: reversibility, safety prerequisites, and whether both selectors can be combined. It is insufficient for an agent to invoke this safely.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 33%: force is documented, while job_id and older_than_days are bare. The description partially compensates by mapping the two selection modes ('de un job, o más viejos que N días') to those undocumented params, but adds no detail on mutual exclusivity or precedence between them.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

States a specific verb (Elimina) and resource (worktrees y ramas colmena/*), plus a scope qualifier (creados por este servidor). It clearly distinguishes what gets cleaned from general-purpose siblings like cancel or merge, though it never names an alternative tool explicitly.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Usage is only implied: the parenthetical reveals two selection modes (by job_id, or by older_than_days), which tells the agent how to target cleanup. It never says when cleanup should be run instead of cancel or merge, nor any preconditions (e.g., branch must be merged first).

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

compactC

Comprime la sesión de un job en un brief de relevo (summary.md) reutilizable con handoff.

ParametersJSON Schema
NameRequiredDescriptionDefault
job_idYes

TDQS

C2.9/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries the full behavioral burden. It reveals that a summary.md artifact is created, but says nothing about where it is written, whether it overwrites an existing file, idempotency, or permission requirements for a mutation-style operation.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

A single front-loaded sentence with no filler; the core action and artifact appear first. It is efficiently sized for a one-parameter tool, though the parenthetical is slightly awkward.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a one-param tool this is thin: no output schema means the description should explain the produced summary.md and its lifecycle, and it leaves the overlap with the summarize/handoff siblings unresolved.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

There is one required parameter with 0% schema description coverage, so the description must compensate. 'La sesión de un job' loosely ties job_id to a job, but gives no format, source, or valid-value guidance for the parameter.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

States a specific verb (comprime) and resource (la sesión de un job) and names the concrete artifact produced (summary.md). However, it does not distinguish itself from close siblings such as summarize or handoff, and the trailing 'con handoff' is ambiguous since handoff is itself a sibling tool.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Implies usage by describing the output as 'reutilizable con handoff', which hints at a downstream workflow, but never states when to choose compact over the sibling summarize tool or any precondition for running it.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

continueC

Reanuda la sesión de un agente con un mensaje de seguimiento (mismo workdir).

ParametersJSON Schema
NameRequiredDescriptionDefault
job_idYes
messageYes

TDQS

C2.2/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries the full burden, yet it discloses almost nothing beyond the action itself. It does not state auth requirements, whether the session must be in a specific state to continue, what happens on failure, or how the response is delivered. Two words of scope ('mismo workdir') are the only behavioral hint.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness3/5

Is the description appropriately sized, front-loaded, and free of redundancy?

A single short sentence with no wasted words, but it is under-specified rather than concise – there is essentially no front-loaded structure because there is so little content. Size is appropriate; information density is poor.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a mutation-style tool with two required parameters, no annotations, no output schema, and 0% schema coverage, the description is far too thin. An agent cannot determine prerequisites, failure modes, or what a successful continuation returns.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0% and the description mentions neither parameter by name or meaning. 'message' is loosely implied by 'mensaje de seguimiento', but 'job_id' is completely undocumented and the description does not compensate for the total coverage gap.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose3/5

Does the description clearly state what the tool does and how it differs from similar tools?

States a specific verb (reanuda/resume) and resource (sesión de un agente), and adds the 'mismo workdir' scope. However, it does not distinguish this tool from siblings like 'run', 'handoff', or 'status', which an agent could plausibly confuse with resuming work. Purpose is clear but not differentiated.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description gives no explicit when-to-use or when-not-to-use guidance, and names no alternative. It only implies usage via the 'follow-up message' phrasing. With 17 siblings, an agent receives no routing help.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

diffC

Diff del trabajo (truncado; el completo queda en disco).

ParametersJSON Schema
NameRequiredDescriptionDefault
job_idYes
max_charsNo

TDQS

C2.7/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries the full burden, and it does disclose one real behavior: output is truncated and the full diff is written to disk. That is valuable and non-obvious. It still omits whether the job must be finished, what happens if it is still running, and whether large diffs have other limits.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

A single short sentence with the core purpose front-loaded and the truncation caveat in a parenthetical, so every clause earns its place. It is terse to the point of under-specification, but not padded.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With no annotations, no output schema, and zero parameter documentation, the description should compensate and does not. The truncation/disk note is the only substantive addition; an agent still lacks the job lifecycle context and parameter semantics needed to invoke this reliably.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 0% and neither of the two parameters (job_id, max_chars) is mentioned in the description. The truncation note loosely gestures at max_chars, but it never explains that max_chars controls the truncation or gives a default/format for either parameter.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose3/5

Does the description clearly state what the tool does and how it differs from similar tools?

It identifies a verb (diff) and a resource (the job's work) plus an output caveat, so the agent knows it returns a diff. However it never names what a 'job' is or which sibling produces one, so differentiation from tools like result, report, or review is left to inference.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to call this versus alternatives such as result, report, or status, and no mention of prerequisites (e.g., a completed job). Usage is only implied by the tool name.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

handoffC

Lanza un agente nuevo con el resumen de otros agentes como contexto.

ParametersJSON Schema
NameRequiredDescriptionDefault
cwdNoDirectorio del proyecto (defecto: cwd del servidor)
fromYes
kindNoTipo de tarea (code, docs, refactor, tests...) para que el router prefiera workers con esa fortaleza
taskYesBrief claro y autocontenido: objetivo, archivos, criterio de aceptación. El agente no ve esta conversación.
workerNoAlias de worker de colmena.yml (ver tool workers). Si se omite, el router elige: defaults.worker o el siguiente con presupuesto
isolationNoworktree (defecto en repos git: rama colmena/<id> aislada) | inplace (edita el directorio) | readonly (solo lectura)
handoff_fromNojob_ids cuyos resúmenes se inyectan como contexto
context_filesNoRutas que el agente debe leer primero

TDQS

C2.9/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries the full behavioral burden, yet it says nothing about whether the launched agent runs asynchronously, what identifier or handle comes back, concurrency/budget limits, or how the injected summaries are merged. The schema mentions router/worker selection and isolation modes, but the description supplies none of that context.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

One compact, front-loaded sentence with zero filler. It is efficient, though for an 8-parameter orchestration tool the brevity crosses into under-specification rather than pure conciseness.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

An 8-parameter, 2-required orchestration tool with no annotations and no output schema needs more than a single sentence. Missing is any explanation of the handoff lifecycle, return value, or how from/handoff_from interact.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is high (88%), so the baseline is 3. The phrase 'resumen de otros agentes' loosely maps to handoff_from, but the description does not disambiguate the required 'from' array from the optional 'handoff_from' array, which are the two parameters most likely to confuse a caller.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

States a specific verb and resource ('lanza un agente nuevo') plus the distinguishing mechanism ('con el resumen de otros agentes como contexto'). However, it never differentiates itself from close siblings like run, run_many or continue, so an agent must infer which launch tool to pick.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

There is no explicit when-to-use, when-not-to-use, or named alternative. The only hint is the purpose statement itself, which is too thin to guide selection against run or continue.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

listC

Lista jobs recientes.

ParametersJSON Schema
NameRequiredDescriptionDefault
limitNo
stateNo

TDQS

C2.2/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries the full burden. It implies a read-only listing but says nothing about pagination, ordering, default limits, or what 'recent' actually means, all of which matter for a list operation.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness3/5

Is the description appropriately sized, front-loaded, and free of redundancy?

It is only one short sentence, so it is concise and front-loaded, but brevity here reflects under-specification rather than economy of information.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a tool with two undocumented parameters, no annotations, and no output schema, the description is far too thin. An agent lacks the basics needed to invoke it correctly, though the general intent of listing jobs is at least conveyed.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0% for two parameters (limit, state), and the description never mentions them. 'Recientes' hints at a recency scope but does not explain how limit or state modify the query, so the parameters remain entirely opaque.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose3/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description gives a verb (listar) and a resource (jobs) with a scope hint (recientes), but the tool name is a bare 'list' and nothing distinguishes it from siblings like status, result, or run. An agent cannot tell from this text alone what makes this listing different from the other job-related tools.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

There is no when-to-use guidance, no mention of alternatives such as status or result, and no prerequisite or context. The agent must guess whether this is the right entry point for inspecting jobs.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

mergeB

Fusiona la rama colmena/ del job en la rama actual de su cwd. Manual: revisa antes con diff/review. Se niega si el destino tiene cambios sin commitear.

ParametersJSON Schema
NameRequiredDescriptionDefault
job_idYes
strategyNo

TDQS

B3.4/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries the full behavioral burden. It usefully discloses one refusal condition (uncommitted changes in the destination), but says nothing about the destructive/history-rewriting nature of the merge, what the strategy field changes, permission requirements, or the return value. Partial disclosure for a mutating operation.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two tight sentences, front-loaded with the action and followed by the workflow hint and precondition. No filler, though the positioning of the precondition last slightly buries the most important behavioral constraint.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a mutating, annotation-less tool with no output schema and 0% schema coverage, the description covers the operation and one precondition but omits the strategy parameter's semantics and the safety profile of a branch merge. Adequate minimum but with clear gaps.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 0% for two parameters. The description implies what job_id means (it identifies the colmena/<id> branch) but never explains the 'strategy' enum, whose merge vs squash values produce materially different history outcomes. The most consequential parameter is left undocumented.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

States a specific verb (fusiona/merges), the exact resource (la rama colmena/<id> del job) and the destination (la rama actual de su cwd). An agent can tell this is a git-merge style operation, though the sibling differentiation comes mostly from the naming of diff/review rather than from an explicit scope statement.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Explicitly routes the agent to review first ('Manual: revisa antes con diff/review') and gives a precondition ('Se niega si el destino tiene cambios sin commitear'). It names the alternatives but does not state when merging is preferable to alternatives like continue or handoff.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

reportA

Genera un reporte HTML bonito de lo logrado por los jobs indicados (ronda final). El worker del rol reporter lo redacta con el estilo elegido (defecto papercraft); si falla, se usa un renderizador de respaldo. Devuelve la ruta del HTML.

ParametersJSON Schema
NameRequiredDescriptionDefault
openNoAbrir en el navegador al terminar
styleNoNombre de estilo (carpeta styles/<nombre>); defecto: plugins.report.default_style
titleNo
job_idsYes
subtitleNo

TDQS

A3.6/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries the burden and does well: it discloses the reporter-role worker generation path, the default papercraft style, the fallback renderer on failure, and the return value (HTML path). It omits permissions, overwrite behavior, and error semantics, keeping it short of a 5.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Three short sentences with the purpose front-loaded, then execution behavior, then return value. No filler, though the compressed '(ronda final)' aside slightly reduces readability.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

It correctly covers the return value in the absence of an output schema and explains the fallback path. It still leaves three undocumented parameters and no permission/error context for a 5-parameter tool, so it is adequate but incomplete.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is only 40% (open and style documented; title, subtitle, job_ids bare), so the description must compensate. It surfaces the real default style name 'papercraft' (the schema only references plugins.report.default_style) and ties inputs to 'jobs indicados', but adds nothing for open, title, or subtitle.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

States a specific verb and resource: generating a pretty HTML report of what the listed jobs achieved. 'Jobs indicados (ronda final)' scopes it clearly enough to separate it from summarize/result, though it never names a sibling explicitly.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The parenthetical '(ronda final)' implies this is meant to run after a final round of jobs, giving implicit timing guidance. However, there is no explicit when-to-use/when-not or routing against siblings like summarize or result.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

resultC

Reporte compacto (RESULT/FILES/TESTS/RISKS), archivos tocados y rama.

ParametersJSON Schema
NameRequiredDescriptionDefault
detailNomin (defecto, ~300 tokens) | normal | full
job_idYes

TDQS

C2.4/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries the full behavioral burden and discloses only the output shape. It says nothing about read-only vs mutating behavior, whether the job must be in a terminal state, latency, or error cases — significant gaps for a job-result tool.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

A single compact sentence front-loads the output sections, with no filler. It is terse to the point of omitting the verb, but it is not bloated.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

No output schema exists, so the description must carry return-value meaning; it partially does by naming the sections, but omits the action it performs, the meaning of job_id, and the detail-level tradeoffs. For a job-scoped retrieval tool this is under-specified.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 50%: 'detail' has an inline enum description, but 'job_id' is undocumented in both schema and description. The description never mentions either parameter or the detail levels, so it does not compensate for the coverage gap.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose3/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description names the output sections (RESULT/FILES/TESTS/RISKS), touched files and branch, which hints at a job-result retrieval tool, but it never states the verb or resource explicitly — no 'get/retrieve the result of a job'. It also does not distinguish itself from close siblings like report, status, or summarize.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

There is no indication of when to use this tool versus report, status, summarize, compact, or review, and no prerequisites (e.g., whether the job must be finished). The agent must infer usage entirely from the tool name.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

reviewC

Revisión en solo lectura de los cambios de un job (o de un cwd).

ParametersJSON Schema
NameRequiredDescriptionDefault
cwdNo
focusNo
job_idNo

TDQS

C2.9/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries the full behavioral burden. It does disclose the read-only nature ('solo lectura'), which is useful, but says nothing about whether the job must be running, which changes are examined (working tree vs. committed), permissions, or what the review returns.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

A single short sentence with the read-only constraint and the two target scopes front-loaded; no filler. It is efficient, though the brevity is partly under-specification rather than true economy.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With three undocumented parameters, no annotations, no output schema, and many overlapping siblings (diff, report, status, result), the description is too thin. An agent lacks the information needed to pick this tool or to invoke focus correctly.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 0% for all three parameters. The description implicitly maps 'job' to job_id and 'cwd' to cwd, but adds no format or semantics for them, and the 'focus' parameter is entirely undocumented in both the schema and the description.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

States a specific verb and resource: a read-only review of the changes produced by a job or a cwd. That is clear enough to act on, but it never distinguishes itself from close siblings such as diff, report, or status, so an agent must guess which is the right one for examining changes.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Usage is only implied by the scope 'changes of a job (or a cwd)' – it tells the agent what the tool operates on, not when to prefer it over diff, report, or status. No prerequisites, exclusions, or alternative-selection guidance are given.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

runB

Lanza un agente obrero (Codex u OpenCode según el worker; sin aprobaciones, con internet). Devuelve job_id; con wait=true espera el reporte (hasta timeout_s).

ParametersJSON Schema
NameRequiredDescriptionDefault
cwdNoDirectorio del proyecto (defecto: cwd del servidor)
kindNoTipo de tarea (code, docs, refactor, tests...) para que el router prefiera workers con esa fortaleza
taskYesBrief claro y autocontenido: objetivo, archivos, criterio de aceptación. El agente no ve esta conversación.
waitNo
workerNoAlias de worker de colmena.yml (ver tool workers). Si se omite, el router elige: defaults.worker o el siguiente con presupuesto
isolationNoworktree (defecto en repos git: rama colmena/<id> aislada) | inplace (edita el directorio) | readonly (solo lectura)
timeout_sNo
handoff_fromNojob_ids cuyos resúmenes se inyectan como contexto
context_filesNoRutas que el agente debe leer primero

TDQS

B3.3/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries the full burden, and it does disclose key traits: the agent runs without approvals and with internet access, returns a job_id, and can block up to timeout_s. It omits the side-effect profile (file edits), permission/auth requirements, and concurrency or budget behavior, so substantial gaps remain for a spawning tool.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two dense sentences, front-loaded with the core action and followed by the return/wait contract. Every clause carries information; nothing is padded, though the parenthetical 'sin aprobaciones, con internet' could be slightly tighter.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a 9-param async job-spawning tool with no output schema, no annotations, and 16 siblings, the definition covers the basics (what it launches, job_id, blocking) but leaves routing decisions and the output contract unaddressed, so an agent could easily pick the wrong sibling or misuse wait/timeout combinations.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 78%, just under the high-coverage baseline, and the description usefully compensates for the two undocumented params: wait (blocks for the report) and timeout_s (upper bound on the wait). It also clarifies the worker dependency (Codex vs OpenCode) that governs the worker param.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states a concrete verb and resource: it launches a worker agent (Codex/OpenCode depending on the worker), so the agent knows this spawns an autonomous job rather than running inline. It is clear despite the generic name 'run', but it never names how it differs from close siblings like run_many, continue, or handoff.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

There is no explicit when-to-use guidance and no alternatives named. The only implied usage cue is 'con wait=true espera el reporte', which tells the agent how to block, not when this tool should be preferred over run_many or continue.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

run_manyB

Lanza varios agentes en paralelo (tope COLMENA_MAX_PARALLEL simultáneos, el resto en cola).

ParametersJSON Schema
NameRequiredDescriptionDefault
tasksYes

TDQS

B3.2/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries the full burden. It does disclose one genuinely useful behavioral trait — simultaneous execution capped at COLMENA_MAX_PARALLEL with overflow queued — but says nothing about whether the call blocks, what it returns (job ids?), or how partial failures are reported.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

A single sentence with zero waste; the parallelism behavior and the queueing constraint are both front-loaded. Nothing needs trimming.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For an orchestrator that spawns up to 20 nested agent tasks, with no annotations and no output schema, the description is too thin: it omits return values, blocking behavior, failure semantics, and any pointer to the status/result/merge siblings needed to follow up on launched jobs.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is reported at 0% for the top-level 'tasks' parameter, and the description adds no parameter meaning at all: it does not mention the array shape, the 1-20 item bounds, or the nested task/isolation/worker fields. The nested schema properties are individually documented, but the description itself compensates for none of the gap.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

States a specific verb and resource: it launches several agents in parallel. The phrase 'varios ... en paralelo' implicitly contrasts with the singular sibling 'run', so an agent can distinguish batch from single-agent execution without opening the schema.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Usage is implied — batch execution is for multiple independent tasks — but the description never names the alternative ('run' for a single agent) or states when to prefer one over the other. No prerequisites or exclusions are given.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

statusC

Estado de un job.

ParametersJSON Schema
NameRequiredDescriptionDefault
job_idYes

TDQS

C2.2/5.0
Behavior1/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations and no output schema, so the description carries the full burden – and it says nothing about whether this polls, blocks, returns terminal states, or what an unknown/expired job_id yields. Four words cannot satisfy that burden.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Extremely short and front-loaded; nothing is wasted. It loses a point only because the brevity is under-specification rather than disciplined compression.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness1/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

A single-param tool is simple, but with no annotations, no output schema, no parameter docs, and no sibling differentiation, the definition leaves everything an agent needs unanswered – especially the distinction from 'result' and 'wait'.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 0% and the single parameter 'job_id' has no description anywhere. The description mentions 'un job' but adds no format, origin, or validity information for job_id.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose3/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states the resource ('job') and the returned concept ('estado'), so the purpose is discernible. But it names no specific verb beyond the implicit 'get', and gives no differentiation from siblings like result, wait, or list. Adequate but vague.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance at all on when to use this versus 'result' (get job output) or 'wait' (block until completion). With 17 siblings and several job-related ones, the absence of any routing guidance is a real gap.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

summarizeC

Un agente (rol summarizer) resume la sesión de un job.

ParametersJSON Schema
NameRequiredDescriptionDefault
focusNo
job_idYes

TDQS

C2.4/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries the full behavioral burden, and it discloses almost nothing. The aside '(rol summarizer)' hints that an LLM agent performs the work — implying nondeterminism, cost, and latency — but it never states whether the operation is read-only, whether it mutates job state, how long it takes, or whether output is persisted.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness3/5

Is the description appropriately sized, front-loaded, and free of redundancy?

It is a single short sentence with no filler and the action is front-loaded, which is structurally sound. However, the brevity comes from under-specification rather than tight editing, and the mixed-language framing ('Un agente...') spends words on implementation detail instead of contract.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With no annotations, no output schema, and 0% parameter description coverage, the description is the only source of information and it leaves the tool largely opaque. An agent cannot determine prerequisites, scope of the summary, or what 'focus' narrows without trial and error.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the description must compensate for two undocumented parameters, and it does not. It never explains what job_id identifies or what the optional 'focus' string does — arguably the most important thing to know about a summarization tool, since focus would steer the summary.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose3/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states a verb and resource ('resume la sesión de un job'), so the basic action is identifiable, but the phrasing 'Un agente (rol summarizer) resume...' describes the implementing mechanism rather than the tool's contract. It gives no way to tell it apart from siblings such as report, review, compact, or result, which all plausibly touch a job's session output.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

There is no when-to-use guidance, no prerequisite (e.g. must the job be finished?), and no mention of alternatives despite a crowded sibling set (report, review, result, status). Usage is only implied by the verb 'resume'.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

waitB

Espera a uno o todos los jobs (máx 600 s) y devuelve reportes compactos.

ParametersJSON Schema
NameRequiredDescriptionDefault
modeNo
job_idsYes
timeout_sNo

TDQS

B3.3/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries the full burden. It does disclose the blocking nature and the 600 s ceiling, which is real behavioral value, but says nothing about what happens on timeout, whether the wait is interruptible, or error behavior.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

A single sentence with no filler; the action, scope, and limit are all front-loaded before the return-value clause.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Three parameters, no output schema, and no annotations. The description covers the wait semantics and the timeout cap but leaves timeout defaults, return-report structure, and failure behavior unspecified.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the description must compensate. It partially does: 'uno o todos' maps to the any/all enum, and 'máx 600 s' documents the timeout_s ceiling, though the schema lacks the default and units for timeout_s and never clarifies job_ids semantics.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

States a specific verb (wait) and resource (jobs), plus scope (one or all) and a hard cap (max 600 s). It does not differentiate itself from neighboring tools such as status or result, which an agent could easily confuse with waiting on a job.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to prefer waiting over polling status, reading result, or cancelling. The 'one or all' phrasing hints at the mode parameter but never states the condition under which each is appropriate.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

workersA

Lista los workers de colmena.yml con prioridad, fortalezas, gasto del mes, presupuesto restante y disponibilidad. Úsalo para decidir a quién delegar.

ParametersJSON Schema
NameRequiredDescriptionDefault

No parameters

TDQS

A3.9/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries the full behavioral burden, and it does disclose the returned fields (priority, strengths, monthly spend, remaining budget, availability). The read-only nature is implied by 'Lista', but nothing is said about auth needs or side effects beyond that.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two sentences, zero filler: the resource and its contents come first, the usage cue second. Every clause earns its place and nothing is buried.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a zero-parameter read tool with no output schema and no annotations, the description covers the essential return content an agent needs. It is complete enough to call correctly, with only minor gaps around the exact output shape.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The tool takes zero parameters, so there is no parameter semantics to explain and the baseline is 4. The description correctly adds no misleading parameter detail.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

States a specific verb and resource ('Lista los workers de colmena.yml') and enumerates what each entry contains (priority, strengths, spend, budget, availability). It is clearly distinguishable from generic siblings like 'list' or 'status', though it never names them explicitly to sharpen the contrast.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

'Úsalo para decidir a quién delegar' gives a clear use context, but there are no exclusions and no reference to alternative siblings (e.g. 'status', 'list', 'result') that an agent might otherwise pick. Usage is implied rather than fully guided.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Tool Schema Changelog

Recent tool additions, removals, and schema changes observed during successful MCP inspections.

  1. 17 tool updatesv0.1.0
    • First observedcancel
    • First observedcleanup
    • First observedcompact
    • First observedcontinue
    • First observeddiff
    • First observedhandoff
    • First observedlist
    • First observedmerge
    • First observedreport
    • First observedresult
    • First observedreview
    • First observedrun
    • First observedrun_many
    • First observedstatus
    • First observedsummarize
    • First observedwait
    • First observedworkers

TDQS

B3/5.0

Scored across 17 tools

Disambiguation4/5

The set clearly separates most orchestrator actions, but summarize vs compact and wait vs result share reporting/summarization duties, and run/handoff/continue form a related launch-resume family. The descriptions usually resolve these overlaps, though a few boundaries require careful reading.

Naming Consistency4/5

Names are consistently lowercase and mostly single words, mixing imperative verbs (run, cancel, merge) with resource nouns (workers, status, result) in a readable way. The only multi-word name, run_many, uses snake_case cleanly, so the convention is predictable despite the verb/noun mix.

Tool Count4/5

17 tools is slightly above the ideal 3–15 range, but the agent-orchestration domain is broad and each tool maps to a distinct lifecycle action. No tool is clearly redundant, though a leaner design could combine some summary/reporting operations.

Completeness4/5

The surface covers the orchestration lifecycle well: delegation, parallel runs, handoff, monitoring, cancellation, review, merge, cleanup, reporting, and session summarization/compaction. Minor gaps include no tools for inspecting raw job logs or configuring worker budget/priority settings, but agents can mostly work around these.

Maintenance

ActivityMaintained
ResponsivenessNo issues

Related MCP Connectors

Related MCP Servers

  • A
    license
    Not graded
    quality
    C
    maintenance
    Enables multiple AI coding CLIs (Claude Code, Gemini/Antigravity, Codex, and OpenCode) to collaborate as a coordinated team by routing cross-agent prompts, sharing messages and review tickets, tracking tasks on a shared store, and isolating each agent in its own Git worktree with turn-budget safeguards—all inspectable and steerable from a local web dashboard.
    MIT
  • A
    license
    Not graded
    quality
    B
    maintenance
    Enables Claude Code to launch and supervise multiple concurrent Claude Code sessions in tmux, sending them briefs, reading their progress, answering their prompts, and managing isolated git worktrees.
    2
    MIT