Find knowledge base entries similar to a given entry by comparing tags and content, returning ranked results to discover related patterns and examples.
MIT
Ask before you fetch: will this domain serve your crawler, refuse it, or charge it?
Bounded crawl-readiness check for agent access: robots.txt, sitemap.xml, llms.txt, homepage.