Skip to main content
Glama

parse_log

Convert raw CI/test logs into structured test results, auto-detecting Jest, Vitest, or Pytest output for easier analysis.

Instructions

Parse raw CI/test log text and extract structured test results. Auto-detects framework (Jest, Vitest, Pytest) from the log content.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
textYesRaw CI log or test output text to parse
frameworkNoForce a specific framework instead of auto-detecting

Schema Changelog

Changes observed during successful MCP inspections.

  1. First observedv0.1.0

TDQS

A3.5/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations provided, the description carries the full behavioral burden, and it does little beyond stating auto-detection. It does not say what happens when detection fails or the log is malformed, whether parsing is deterministic/pure, or what the structured result looks like. For a tool with zero annotation coverage this is a notable gap.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two tight sentences with zero waste; the core purpose is front-loaded and the framework detail follows naturally.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

There is no output schema, so the description should ideally hint at the shape of the extracted results or at least the failure mode for unparseable logs. It covers inputs adequately but leaves the return contract and error behavior unspecified.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100% and both parameters are documented inline, including the enum values and the override semantics. The description only restates the auto-detect behavior, adding no syntax or format detail beyond the schema, so the baseline 3 applies.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

States a specific verb (parse) and resource (raw CI/test log text) plus the outcome (extract structured test results), and names the supported frameworks. An agent can tell it apart from the sibling parse_artifact, which implies parsing a stored artifact rather than raw log text.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The auto-detect default and the force-a-framework escape hatch are stated, which implies when to pass the framework parameter. However, there is no guidance on when to prefer this tool over parse_artifact or how it relates to get_failures/get_test_detail, leaving the selection decision to inference.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.