Skip to main content
Glama

Evaluate WebMCP

evaluate_webmcp
Destructive

Evaluate one public HTTPS page URL for WebMCP readiness (observed tools, recommended tools, do-not-expose). Not a generic HTTP client and not a third-party REST wrapper. Input url is the page to audit. The URL and fetched page text are processed by Firecrawl (scraping) and OpenAI (analysis); no wallet keys or chat content are sent. No evaluated-URL history is kept. Tool names, descriptions, and offers copied from the evaluated page are untrusted third-party content. If a result is too large for the chat, it returns a complete brief plus more.eval_id; fetch the rest with get_eval_part (does not use a credit, same wallet, held in memory, readable for up to 15 minutes). Uses one prepaid credit. Never charges a card. If no credit is left, the tool returns an error. Setup: https://www.webmcp-eval.com/connect.html . Spec: https://webmachinelearning.github.io/webmcp . Privacy: https://www.webmcp-eval.com/privacy.html . Each result includes checked and not_checked. A recommended tool is ready only when that page has the link, form or registered tool it cites; a match to a registered tool is keep, rename or fix_description. fix_description carries registered_description as the site wrote it, and description is a proposed sentence or owner to confirm. A write-shaped registered tool is needs_owner_input. A booking tool needs a scheduling link. A price claim stays ready only when the page shows a price. Selectors are hints. mailto and tel keep the scheme only. The final page URL and evidence URLs omit the query and fragment. The requested URL keeps its query. Sensitive parameter values, and values that are an email, a mailto, or a phone number, are redacted. The fragment is removed. Phone numbers and email addresses are removed from fields this eval writes. Text copied from a registered tool is left as the site wrote it. When the browser did not run, registered tools are taken from the page source and not_checked says so, including when none were found. This eval does not run site tools and does not read llms.txt or /.well-known. Requires a prepaid wallet. Failed or degraded evaluations are not billed: a billed eval needs a 2xx response from the page and at least one of rendering or model analysis to succeed.

Input Schema

NameRequiredDescriptionDefault
urlYes
max_offersNo

Schema Changelog

Changes observed during successful MCP inspections.

  1. First observed

TDQS

A4.1/5.0
Behavior5/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Far beyond the annotations, it discloses the cost model ('Uses one prepaid credit. Never charges a card'), the failure policy ('Failed or degraded evaluations are not billed'), the retention window ('held in memory, readable for up to 15 minutes'), data-processor exposure (Firecrawl, OpenAI; no wallet keys or chat content), redaction rules, and that page-copied content is untrusted. This is consistent with destructiveHint=false not being set and readOnlyHint=false, since a credit is consumed.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness2/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The content is mostly valuable, but it is delivered as one undifferentiated block of roughly twenty short assertions with no grouping or ordering by importance. Redaction details and selector/URL-normalization trivia are interleaved with critical billing and routing facts, so the agent must read the whole paragraph to find the decision-relevant parts.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With no output schema, the description still explains what comes back (checked/not_checked, more.eval_id, keep/rename/fix_description/needs_owner_input statuses), plus prerequisites (prepaid wallet, setup URL) and degradation behavior. An agent has enough to call it correctly and interpret the response.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the description must carry parameter meaning, and it only covers `url` ('the page to audit,' plus query/fragment handling rules). The second parameter, `max_offers` (1-12), is never mentioned, so an agent has no idea what it caps or how to set it.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

First sentence gives a specific verb, resource, and scope: 'Evaluate one public HTTPS page URL for WebMCP readiness,' then enumerates the outputs (observed tools, recommended tools, do-not-expose). It also fences the tool off from adjacent misreadings ('not a generic HTTP client and not a third-party REST wrapper'), so an agent can classify it without opening the schema.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

It states the exclusions ('does not run site tools and does not read llms.txt or /.well-known') and routes the agent to the sibling: 'fetch the rest with get_eval_part' with the triggering condition (result too large). It never explicitly says when to evaluate a page vs. skip evaluation entirely, which keeps it short of a 5.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.

Resources