Skip to main content
Glama

Log a real-world outcome for a graded prompt

log_outcome

Record real prompt results including success, turns to fix, scope creep, files changed, and root cause naming, to improve grading alignment.

Instructions

Records what actually happened after a prompt (previously scored via grade_prompt) was used — whether it succeeded, how many turns/messages it took to resolve, whether the fix stayed in scope, and whether the prompt named the bug's root cause and location. This is the data that lets Promptest MCP tell you what actually predicts good outcomes for YOUR prompting style, not just what the rubric guesses in the abstract.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
notesNoAny free-text notes on what happened.
taskIdYesThe taskId returned by grade_prompt.
succeededNoDid the AI's response/fix actually work?
scopeCreepNoDid the AI change files/behavior beyond what was asked?
filesChangedNoList of files actually modified, if known.
turnsToResolveNoHow many back-and-forth turns/messages it took to reach a working result.
namedRootCauseAndLocationNoDid the ORIGINAL prompt explicitly name the root cause and where the fix belongs (not just what was wrong)? This is the single strongest predictor CRG-RIS found for lower cost and correctly-scoped fixes.
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries full burden. It describes the logging action and data collected but does not disclose side effects, authentication needs, or rate limits. For a logging tool, the description is adequate but not rich; it assumes the agent understands it is write-only and non-destructive.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two sentences: the first enumerates key fields concisely, the second explains the strategic value. Every word contributes. No redundancy or filler.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given 7 parameters, no output schema, and no annotations, the description adequately explains the tool's role in the workflow (post-grade_prompt), what data it collects, and why it matters. It could be improved by mentioning the return value (e.g., taskId or confirmation), but it is largely complete for a logging tool.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% (all 7 parameters have descriptions). The tool description adds contextual value by explaining the significance of 'namedRootCauseAndLocation' as the strongest predictor, but it does not add new parameter details beyond what the schema already provides. Baseline 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description uses a specific verb ('records') and resource ('real-world outcome for a graded prompt'), listing concrete fields (succeeded, turns, scope creep, etc.). It clearly distinguishes from sibling 'grade_prompt' which scores before use, and explains the broader context of Promptest MCP analytics.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies the tool should be used after a prompt has been used and previously scored via grade_prompt. It also explains the value ('lets Promptest MCP tell you what actually predicts good outcomes'). However, it does not explicitly state when NOT to use it or name alternative tools for other scenarios.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Install Server

Other Tools

Latest Blog Posts

MCP directory API

We provide all the information about MCP servers via our MCP API.

curl -X GET 'https://glama.ai/api/mcp/v1/servers/cortexresearch/promptest-mcp'

If you have feedback or need assistance with the MCP directory API, please join our Discord server