domain_security_audit
Audit any domain list for TLS certificate validity, HTTP security headers, redirect chains, and robots.txt/llms.txt AI-bot rules, returning one scored, graded row per domain.
Instructions
Domain Security Audit checks TLS certificate validity, HSTS/CSP and other HTTP security headers, the redirect chain and robots.txt/llms.txt AI-bot rules for any list of domains — one scored, graded row per domain. Billed to your own Apify account: ~$0.005 per result (Apify free-plan price, lower on paid plans).
Input Schema
TableJSON Schema
| Name | Required | Description | Default |
|---|---|---|---|
| domains | Yes | Domains — Enter the domains to audit, one row is returned per domain, e.g. apify.com. Full URLs and www. prefixes are accepted and stripped automatically (https://www.apify.com/store becomes apify.com), so you can paste a list straight out of your CRM. Example: ["apify.com"]. | |
| checkTls | No | Check TLS certificate — Connect on port 443 and read the peer certificate's validity dates, issuer, subject, SAN count, days until expiry and whether the chain is trusted. Turn off to skip this and save a few seconds per domain. | |
| checkRobots | No | Check robots.txt and llms.txt — Fetch /robots.txt (disallow-all detection, sitemap count, and which AI crawlers such as GPTBot, ClaudeBot and Google-Extended are blocked) and /llms.txt (presence, title, size). | |
| checkHeaders | No | Check HTTP security headers — Read HSTS, Content-Security-Policy, X-Frame-Options, X-Content-Type-Options, Referrer-Policy, Permissions-Policy, Server, X-Powered-By, Cache-Control and cookie flags from the final response after redirects. | |
| followRedirects | No | Follow redirect chain — Start at http://<domain>/ and follow Location headers manually (up to 10 hops) to find the final URL, whether it upgrades to HTTPS and whether it adds or drops the www. prefix. Turn off to check the headers of http://<domain>/ directly with no redirect following. |