Enables AI assistants to discover and extract sitemaps from any website, providing tools for finding sitemap files, extracting URLs, and performing full crawls.
Enables querying and retrieving webpage content from websites by parsing sitemap.xml files and fetching HTML content from specified URLs. Includes built-in rate limiting and supports listing available pages and accessing raw sitemap data.
Enables querying and retrieving webpage content from websites by parsing sitemap.xml files and fetching HTML content. Includes rate limiting protection and supports listing available pages and accessing raw sitemap data.
Enables querying and retrieving webpage content from websites by parsing sitemap.xml files and fetching HTML content from specified URLs. Includes rate limiting protection and supports listing all available pages from a sitemap.
Enables querying and retrieving content from webpages by parsing sitemap.xml files and fetching HTML content from specified URLs. Includes built-in rate limiting for protection against abuse.
Enables querying and retrieving webpage content from websites by parsing sitemap.xml files and fetching HTML content from specified URLs. Includes built-in rate limiting for responsible web scraping.