well_known_audit
Inspect a host's security.txt and robots.txt to identify missing disclosure policies and admin-only paths. Reveals security findings from standard public files.
Instructions
Fetch and parse a host's security.txt and robots.txt.
Both are standard public files. security.txt (RFC 9116) gives the vulnerability-disclosure contact, policy, and encryption key; its absence is itself a finding for a security-conscious site. robots.txt lists the paths the operator asks crawlers to skip — frequently admin/internal areas worth noting during recon.
Args: host: Hostname to inspect, e.g. "example.com". timeout: Per-request network timeout in seconds.
Returns: A dict with host, security_txt (present flag, parsed fields, structural issues, location), and robots_txt (present flag, sitemaps, disallow/allow paths, user_agents).
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| host | Yes | ||
| timeout | No |