Generate a dataset from collected crawler data, halting the crawler before the full 7-day period ends. Use when enough data is gathered and you need results without waiting.
MIT
Cloudflare Workers MCP server: ai-crawler-policy
E-commerce competitor intelligence, VOC sentiment, Amazon ASIN analysis, Reddit growth playbooks.