llms.txt 檢查工具

Tools have distinct purposes: check_ai_crawler_access focuses on robots.txt AI crawler permissions, check_llms_txt is a broader site audit, generate_llms_txt creates a draft, and validate_llms_txt checks content format. However, check_llms_txt partially overlaps with check_ai_crawler_access by also reporting robots.txt AI crawler settings, which could cause mild confusion.

All tool names use a consistent snake_case verb_noun pattern: check_ai_crawler_access, check_llms_txt, generate_llms_txt, validate_llms_txt. The verbs are clear and the pattern is predictable.

Four tools form a coherent, well-scoped set for llms.txt auditing and generation. Each tool earns its place without redundancy or missing core functionality.

The set covers generating, validating, and checking llms.txt and AI crawler access, providing a full lifecycle for auditing. A minor gap is the absence of a tool to update or fix detected issues, but agents can work around it.