A
licenseNot graded
qualityC
maintenanceEnables AI apps to research own and competitor websites by reading robots.txt-respecting sitemaps and RSS/Atom feeds, returning tables of pages with URL, title, description, date, and HTTP status, or Google site: search links when no sitemap is available.
1
Apache 2.0