well_known
Fetches and parses robots.txt, sitemap.xml, security.txt, and humans.txt from a target host to discover site structure.
Instructions
Fetch and parse a host's disclosure files: robots.txt (extracting the referenced paths), sitemap.xml (extracting URLs), security.txt and humans.txt. A quick, low-noise way to discover structure. In scope only.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| target | Yes |