Skip to main content
Glama

platform_eval_personas

Manage evaluation personas for AI agent testing, including create, update, list, delete, and generate templates for evals in Arch Studio.

Instructions

[Arch Evaluate] Arch generates eval assets, runs eval workflows, and reads CI evidence. Manage eval personas through the mounted Studio API paths under /api/projects/:projectId/evals/personas. Actions: list, get, create, update, delete, templates, generate.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
bodyNoRequest body for create/update/generate
queryNoOptional query params for list
actionYes
confirmNoSet true for delete
personaIdNoPersona ID for get/update/delete
projectIdYesProject ID

Schema Changelog

Changes observed during successful MCP inspections. Dates show when Glama detected each change.

  1. First observedv1.5.0

TDQS

B3.1/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries the full burden for behavioral disclosure. It only lists actions and mentions the API path, but does not disclose side effects (e.g., whether delete is permanent, whether create/update are idempotent, any authorization requirements, or what happens on failure). The description gives minimal behavioral context beyond the action names, which is inadequate for a mutation-heavy tool.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single paragraph that front-loads the high-level context ('[Arch Evaluate]...') before stating the tool's purpose and actions. It is concise with no redundant phrasing, though the introductory sentence about Arch generating eval assets is somewhat generic and could be trimmed. Overall, it is efficiently structured and wastes little space.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a tool with seven distinct actions and no output schema, the description is incomplete. It does not explain what each action returns, what 'templates' or 'generate' specifically do, or any behavioral nuances like required confirm for delete. With no output schema and minimal annotation coverage, the description should provide more operational detail to enable correct invocation, but it falls short.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema already provides descriptions for most parameters (83% coverage), including that 'body' is for create/update/generate, 'query' is optional for list, 'confirm' must be set for delete, and 'personaId' is for get/update/delete. The tool description adds little beyond the schema; it does not elaborate on parameter formats or valid values beyond what is already present. Since schema coverage is high, the baseline of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool's purpose: 'Manage eval personas' and enumerates the supported actions (list, get, create, update, delete, templates, generate). The resource (personas) is specific and distinct from sibling tools like platform_eval_scenarios or platform_eval_runs, though it does not explicitly differentiate itself from them. The verb and resource are clear, so the purpose is unambiguous.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage by stating it manages personas, but it provides no explicit guidance on when to choose this tool over the many sibling eval tools (scenarios, evaluators, sets, runs). There is no mention of alternatives or exclusions. The context is clear for personas, but the absence of any when-not-to-use or alternative routing leaves the guidance at the implied level.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Latest Blog Posts

MCP directory API

We provide all the information about MCP servers via our MCP API.

curl -X GET 'https://glama.ai/api/mcp/v1/servers/Koredotcom/agents-mcp-tools'

If you have feedback or need assistance with the MCP directory API, please join our Discord server