A
licenseNot graded
qualityD
maintenancePerforms comprehensive crawler compliance risk assessment for webpages, evaluating legal, ethical, and technical risks including robots.txt rules, anti-crawling mechanisms, sensitive data detection, and providing crawl permissibility ratings.
12
3
MIT