cf_managed_robots
Read, configure, or disable Cloudflare's managed robots.txt and Content-Signals policy on a zone. Apply AI bot blocking, crawler protection, and content bot rules.
Instructions
Get / configure / disable Cloudflare's managed robots.txt and Content-Signals policy on a zone (rides on the Bot Management config). action='get' reads the current state (read-only, un-gated). action='configure' enables/sets the managed robots.txt (managed_robots), the Content-Signals variant (cf_robots_variant: off / policy_only), and the AI-bot blocking levers (ai_bots_protection, content_bots_protection, crawler_protection). action='disable' turns managed robots.txt and the Content-Signals policy back off. NOTE: managed robots.txt and the Content-Signals policy are MUTUALLY EXCLUSIVE in Cloudflare - valid combinations are managed_robots=true + cf_robots_variant='off' (managed robots.txt) OR managed_robots=false + cf_robots_variant='policy_only' (the policy); the tool rejects the invalid combo locally. Writes are gated (SEO_MCP_ALLOW_DESTRUCTIVE) and need confirm=; supports dry_run. Always returns a caveat distinguishing the stated-preference signals from the levers that actually enforce at the edge.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| zone | No | Zone hostname, e.g. 'example.com'. Defaults to the configured CF_ZONE. | |
| action | Yes | get (read), configure (write), or disable (write). | |
| confirm | No | For writes: must equal the resolved zone hostname. | |
| dry_run | No | Preview the change without writing. | |
| managed_robots | No | configure only: enable (true) or disable (false) Cloudflare managed robots.txt. | |
| cf_robots_variant | No | configure only: the Content-Signals / Robots Access Control License variant. | |
| ai_bots_protection | No | configure only: edge rule to block AI scrapers/crawlers (enforces). | |
| crawler_protection | No | configure only: link-maze punishment for AI crawlers (enforces). | |
| content_bots_protection | No | configure only: edge rule to block content bots (enforces). |