fetch_llms_txt
Need LLM-friendly documentation? Fetch and parse a site's llms.txt file to get a structured list of documentation links in one request.
Instructions
Fetch and parse an llms.txt file to discover LLM-friendly documentation.
USE THIS TOOL WHEN:
A site provides an llms.txt file for AI-friendly content discovery
You need to understand what documentation is available
You want to fetch structured docs in a single request
WHAT IS llms.txt: A proposal for sites to provide LLM-friendly content at /llms.txt. It's a markdown file listing documentation links with descriptions. See https://llmstxt.org for the specification.
WORKFLOW:
fetch_llms_txt(url="https://example.com/llms.txt") → Get structure
Review sections and links
Either use include_content=True or fetch_batch for specific pages
EXAMPLES:
fetch_llms_txt(url="https://fastht.ml/docs/llms.txt")
fetch_llms_txt(url="https://example.com/llms.txt", include_content=True)
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | URL to an llms.txt file (e.g., https://example.com/llms.txt) | |
| include_content | No | If true, also fetch content of all linked pages. Default false. | |
| max_length_per_url | No | When include_content=True, max chars per linked page. Default 2000. |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| result | Yes |