Skip to main content
Glama

generate_graded_activity

Produce a graded .pka activity file that automatically scores IP addressing and routing tasks, enabling headless lab grading.

Instructions

Serialize a .pka activity with scored IP addressing and routing criteria.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
objectivesNo
output_pathYes
topology_idNo
instructionsNo

Output Schema

TableJSON Schema
NameRequiredDescriptionDefault

No arguments

Schema Changelog

Changes observed during successful MCP inspections.

  1. First observedv0.1.0

TDQS

C2.6/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries the full burden of behavioral disclosure. It implies file output via 'Serialize' but does not state whether output_path is overwritten, whether a topology must already exist, what happens with optional parameters, or what is returned. This is a meaningful gap for a generation tool.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, front-loaded sentence with no filler words. It is concise, though the brevity contributes to under-specification elsewhere.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a tool with four parameters, one required, and no annotations, the description is too thin. It provides a high-level output statement but omits parameter roles, prerequisites, error behavior, and relationship to the sibling topology tools, leaving the agent under-equipped to call it correctly.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0% and the description does not compensate by defining output_path, objectives, topology_id, or instructions. None of the four parameters receive any added meaning beyond their titles, so the agent cannot reliably construct arguments.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description uses a specific verb (Serialize) and names the resource (.pka activity) plus the distinguishing content (scored IP addressing and routing criteria), so an agent can tell it apart from siblings like generate_pkt or set_device_config. It stops short of 5 because it does not clarify what 'scored' means or mention the output path, but the core purpose is unambiguous.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

There is no guidance on when to call this tool instead of validate_current_topology, create_topology, generate_pkt, or inspect_pkt. No alternatives, prerequisites, or exclusions are mentioned, so the agent must infer usage from the name alone.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.