Check a page before using it
preflightFree. Before an agent spends money or time on a URL: is it allowed (robots.txt for this service and, if you pass user_agent, for your own bot; Content Signals such as ai-input and ai-train; meta robots), does a bot check or sign-in stand in the way, and which engine each task needs — plain fetch, Kitesurf (Cloudflare's lightweight agent browser) or Chromium. Rate-limited per IP.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | The page (http or https) | |
| user_agent | No | Your own bot's robots.txt name (e.g. "MyAgentBot") to check its rules too |