Skip to main content
Glama

validate_provider_files

Read-only

For a provider (seller) joining the catalog: check a models.yaml before putting it online - the same check as the wizard and POST /v1/provider/validate. Give the file's text in models (YAML, or the same structure as JSON text); domain (the provider's site) makes the model_page checks exact. Returns ok, the problems (file, line, model, path, value, code, message, hint - fix each and call again), the catalog's preview of the models and next_action. Call it before provider_publish; no account needed. Templates: /static/templates/models.min.yaml (required fields only) and models.yaml (every field with hints).

Input Schema

NameRequiredDescriptionDefault
nameNothe provider's name
domainNothe provider's domain, e.g. example.ai
modelsYesthe models.yaml text

Schema Changelog

Changes observed during successful MCP inspections.

  1. First observed

TDQS

A4.6/5.0
Behavior5/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations only declare readOnlyHint=true, and the description adds substantial context beyond that: it is a non-mutating pre-publication check, requires no account, and exposes the retry loop ('fix each and call again'). It also enumerates the shape of the problems returned (file, line, model, path, value, code, message, hint) plus next_action, which is exactly what an agent needs to act on failures.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Front-loads the core action and stays to a single dense paragraph with no filler sentences. The cramming of return-field lists, templates, and URLs into one block makes it slightly hard to scan, but nothing is wasted.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

There is no output schema, so the description carries the return contract and does so thoroughly (ok flag, structured problems, catalog preview, next_action). It also points to concrete templates, leaving no major gap for a three-parameter validation tool.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so the baseline is 3, and the description earns more by clarifying that `models` accepts YAML or equivalent JSON text and that `domain` sharpens the model_page checks rather than being required. It adds real meaning beyond the terse schema strings.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

States a specific verb and object ('check a models.yaml') and scopes it to a provider joining the catalog, which no sibling tool covers. It also anchors the tool to known equivalents (the wizard and POST /v1/provider/validate), so an agent can place it precisely without opening the schema.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Gives explicit sequencing ('Call it before provider_publish') and a prerequisite note ('no account needed'). It names equivalent alternatives rather than contrasting when to prefer this one, so it stops short of full when/when-not guidance.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.

Resources