Skip to main content
Glama

Desvela ARD Registry — free preflight(domain)

Test what a domain actually serves AI crawlers

crawler_block_test

What the domain's CDN really does, as opposed to what its robots.txt says. Sends each AI crawler's real user-agent at the homepage and compares the response against a browser: a site can allow GPTBot in robots.txt and still have its CDN answer it a 403, and robots.txt cannot tell you that. Verdicts per crawler: ok, blocked (refused, or redirected off the site while the browser got the page), throttled (429, which is "too fast" and not "not you"), degraded (a 200 with a fraction of the bytes, the shape of a JS-gated page), or error. When measurable is false there is no verdict to give: the site refused or redirected away the control request too, or it opted out of our crawling (optedOut, no requests sent). Live probe, ~6 requests. Free. Use preflight for the declared policy; use this for the observed one.

Input Schema

NameRequiredDescriptionDefault
domainYes

Schema Changelog

Changes observed during successful MCP inspections.

  1. Added

TDQS

A4.5/5.0
Behavior5/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries the full burden and does so: it discloses that this is a live probe making ~6 requests against the target, that it is free, that results depend on a browser control request, and that it can be skipped when the site opted out (optedOut, no requests sent). The full verdict taxonomy (ok/blocked/throttled/degraded/error) and the throttle-vs-block distinction are exactly the kind of behavioral context annotations would otherwise supply.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Front-loaded with the core distinction (observed CDN behavior vs robots.txt), followed by the verdict taxonomy, edge cases, cost, and sibling routing — all load-bearing. Slightly redundant in restating the robots.txt-can't-tell-you point and the parenthetical glosses, but nothing is padding.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

No output schema and no annotations, so the description must define the result shape; it does so via the verdict vocabulary and the measurable=false case. It stops short of describing the actual response structure (per-crawler mapping, whether bytes/status codes are returned), which is the remaining gap for a tool whose whole value is its output.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

One required parameter at 0% schema description coverage; only the JSON Schema pattern hints at the accepted format. The description implies the argument is a bare domain (it probes 'the homepage', not an arbitrary URL), which is useful, but it never states format, scheme handling, or subdomain behavior explicitly.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

States a specific action (probe the homepage with each AI crawler's real user-agent and compare against a browser) on a specific resource (a domain's CDN behavior). It explicitly contrasts with the declared policy in robots.txt, which makes it impossible to confuse with the sibling preflight tool.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines5/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Ends with an explicit routing rule: 'Use preflight for the declared policy; use this for the observed one.' It also implicitly scopes usage to live probing of a single domain, and the measurable=false explanation tells the agent when the tool yields no verdict rather than a false negative.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.

Resources