Skip to main content
Glama

generate_report

Create a 3-page PDF report on model quality: summary metrics, predicted vs actual scatter, error distribution, and feature importance. Returns structured quality metrics for further analysis.

Instructions

Generate a procurement-style model-quality PDF report (3 pages).

Page 1: summary metrics + predicted vs actual scatter.
Page 2: error distribution + median % error by price band.
Page 3: top-N feature importance.

The PDF is the human deliverable; the return value also echoes the same
numbers as a structured `quality` block (identical to get_model_quality)
so you can both hand the user the file AND reason over the metrics.

Works best with models trained via the MCP train tool (which stores
holdout data). For older models, the report may be unavailable.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
model_idYes
output_pathNo

Output Schema

TableJSON Schema
NameRequiredDescriptionDefault
resultYes

Schema Changelog

Changes observed during successful MCP inspections.

  1. First observedv1.1.1

TDQS

A4.1/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations provided, the description carries the full behavioral burden. It explains that the PDF is the primary deliverable, that the return value additionally includes the same metrics as a structured quality block, and that availability depends on training via the MCP train tool. This is meaningful behavioral context, though it does not specify what happens when the report is unavailable or how output_path behaves when omitted.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is well-organized and front-loaded: the deliverable is stated first, then the page breakdown, then the return-value behavior, then the constraint about older models. Each sentence adds necessary information and there is no filler or repetition of schema details.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The description covers the report's content, the structured return value, and the dependency on holdout data from the train tool, which is the core non-obvious context. It is missing a few operational details such as output_path default behavior and how the tool signals unavailability, but it is largely sufficient for an agent to decide whether and how to invoke this tool.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the description must compensate for the input schema. It does not explain model_id requirements or the behavior of output_path (e.g., what happens when null or how the default path is chosen). The usage context implies model_id refers to a trained model, but explicit parameter-level guidance is missing.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description names a specific deliverable ('procurement-style model-quality PDF report') and details the exact page-level contents, so an agent knows precisely what this tool produces. It also differentiates the tool from siblings by noting the returned quality block is 'identical to get_model_quality', which clarifies the relationship to that nearby tool.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description gives clear context: use this when you need a human-readable PDF report, and it notes that the structured metrics are available for reasoning. It also warns that the report may be unavailable for older models and explains why (reliance on holdout data from the MCP train tool). It does not explicitly say 'use get_model_quality instead when you only need metrics', so it stops short of a complete routing guide.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.