crawl-censusBrowser AutomationWeb ScrapingAgent OrchestrationtaylorsmithggAlicense-Not gradedqualityBmaintenanceProvides preflight checks and domain intelligence so agents can skip domains that will refuse them or charge a fee, covering robots.txt, edge refusals, and HTTP 402 paywalls. Updated 4 days ago (2026-08-23 18:33 UTC)MIT