llms.txt for agents
Server Details
Any site's llms.txt: find the covering index, read its linked docs as markdown, search sections.
- Status
- Healthy
- Last Tested
- Transport
- Streamable HTTP
- URL
- Repository
- ux-xd/llms-txt-mcp
- GitHub Stars
- 0
- Server Listing
- llms-txt
Available Tools
3 toolsllms_indexARead-onlyIdempotentInspect
Find and parse the llms.txt that covers a site or page URL: title, summary, H2 sections of title links with notes, the Optional section, and (HEAD-probed only) whether an llms-full.txt exists. Use first, before llms_page, whenever the user needs a product or library's own docs; every rung tried is returned so a miss is diagnosable.
| Name | Required | Description | Default |
|---|---|---|---|
| site | Yes | Site or page URL, e.g. "docs.stripe.com" or "https://hono.dev/docs/". The most specific covering llms.txt wins. | |
| refresh | No | Bypass the 24 h cache and fetch again. | |
| task_context | Yes | One sentence on what the user is ultimately trying to do (the task this call serves). Required; it tunes the result and is how this free service learns what agents need. |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With readOnly, openWorld, and idempotent annotations already covering safety and side effects, the description adds valuable behavioral context: the HEAD-probed nature of the llms-full.txt check, the fact that every attempted rung is returned, and that misses are diagnosable. This goes well beyond what annotations alone communicate.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Two sentences with no filler. The core behavior and output contents are front-loaded, and the usage guidance follows naturally. Every clause earns its place, and the structure gives the agent the key decision information early.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Despite lacking an output schema, the description conveys what will be returned (title, summary, H2 links, Optional section, llms-full.txt indicator) and how failures behave ('every rung tried is returned so a miss is diagnosable'). Combined with the annotations and the sibling-routing guidance, an agent has enough context to invoke it correctly.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, so the schema already documents all three parameters. The description reinforces the URL-centric purpose and mentions the parsed output, but it does not add meaningful detail about the parameters themselves beyond what the schema provides. Baseline 3 is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description uses a specific verb ('Find and parse') with a clear resource ('the llms.txt that covers a site or page URL') and enumerates the exact parsed contents (title, summary, H2 sections, Optional section, llms-full.txt existence). It also differentiates from the sibling llms_page by saying 'Use first, before llms_page,' so an agent can distinguish it without opening the schema.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description explicitly states when to use this tool: 'Use first, before llms_page, whenever the user needs a product or library's own docs.' This provides clear routing relative to llms_page. It does not explicitly mention when llms_search would be preferable, so the guidance is strong but not fully exhaustive.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
llms_pageARead-onlyIdempotentInspect
Return one docs page as markdown, paginated: tries Accept: text/markdown negotiation, the page's rel="alternate" markdown mirror, the .md / .html.md / index.md conventions, then a bounded HTML-to-markdown conversion. Use on the URLs llms_index returns, or on any docs URL you already hold.
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | Page URL (http/https). | |
| offset | No | Character offset to continue from (use next_offset from a truncated result). | |
| max_chars | No | Characters of markdown to return in this call. | |
| task_context | Yes | One sentence on what the user is ultimately trying to do (the task this call serves). Required; it tunes the result and is how this free service learns what agents need. |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
The description thoroughly discloses the internal fallback chain (Accept negotiation, alternate markdown mirror, file conventions, final HTML-to-markdown conversion) and the bounded pagination behavior. This goes well beyond the readOnly and idempotent annotations, giving the agent a realistic expectation of how the tool behaves and what it may return.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single, information-dense sentence that front-loads the core purpose and pagination behavior before the usage note. Every clause adds value, and there is no filler or repetition of schema details.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
The tool is moderately complex, but the description covers its purpose, input source, fallback behaviors, pagination, and the role of task_context. No output schema exists, yet the mention of 'truncated result' in the offset parameter plus the markdown return behavior is sufficient for correct invocation.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100%, so the parameters are already fully documented in the input schema. The description adds helpful context about pagination and the source of URLs, but it does not add substantial new parameter-level meaning beyond what the schema already provides.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description states a specific action ('Return one docs page as markdown') and a clear resource ('docs page'), with pagination behavior explicitly mentioned. It also distinguishes itself from siblings by referencing llms_index as the source of URLs, making its role in the tool family clear.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description gives explicit guidance: 'Use on the URLs llms_index returns, or on any docs URL you already hold.' This clearly states when to use the tool. It does not explicitly mention llms_search as an alternative or state when not to use it, but the context is still clear enough for an agent.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
llms_searchARead-onlyIdempotentInspect
Search the llms.txt indexes this server has parsed (section headings ×3, link titles ×2, notes ×1) and get the matching docs links with their covering index; pass site to search one site (it is indexed on demand). Use to jump straight to the right page of a docs set instead of reading the whole index.
| Name | Required | Description | Default |
|---|---|---|---|
| site | No | Restrict to one site (indexed via llms_index if not yet cached). | |
| limit | No | ||
| query | Yes | Words to match against section headings, link titles and notes. | |
| max_bytes | No | Byte cap on the results array. | |
| task_context | Yes | One sentence on what the user is ultimately trying to do (the task this call serves). Required; it tunes the result and is how this free service learns what agents need. |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Annotations already convey read-only, open-world, and idempotent behavior. The description adds meaningful context beyond those annotations: the weighted fields searched (headings ×3, titles ×2, notes ×1), the per-site scoping, and the fact that a site may be indexed on demand. No contradiction with the annotations is evident.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Two sentences deliver purpose, scope, filtering behavior, and a usage recommendation with no filler. The most important information is front-loaded, and the parenthetical weight details are compact and useful.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a search tool with no output schema, the description communicates the essential returned content: matching docs links and their covering index. It does not describe result ordering, ranking, or exact response shape, but the limit and max_bytes parameters plus the stated output are enough for an agent to call it correctly.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
With 80% schema description coverage, the schema already explains most parameters. The description adds extra meaning for 'query' by revealing the weighted index fields and for 'site' by clarifying single-site scoping with on-demand indexing, which is not fully captured in the schema.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description states a specific action ('Search the llms.txt indexes') and a concrete result ('get the matching docs links with their covering index'). It also distinguishes itself from reading the whole index, which maps to the sibling llms_index tool.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
It explicitly says when to use this tool: 'jump straight to the right page of a docs set instead of reading the whole index,' clearly positioning it against the index-reading sibling. It also explains the 'site' restriction and on-demand indexing, though it does not explicitly spell out when to prefer llms_page.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
Frequently Asked Questions
Claiming proves that you control a remote MCP connector. It does not move, proxy, or interrupt the server.
Open the connector listing, choose Claim ownership, and sign in to Glama.
Complete one verification method:
GitHub identity — fastest for official registry listings. For a namespace such as
io.github.alice/server, link the matching GitHub user or an account that owns the GitHub organization, then choose Claim with GitHub.HTTP challenge — works when you can deploy a public file. Generate a token, publish the exact JSON Glama shows at
/.well-known/glama.jsonon the same origin as the connector, then choose Check HTTP challenge.DNS challenge — works when you control DNS but cannot change the server. Generate a token, create the exact TXT record Glama shows, wait for it to propagate, then choose Check DNS challenge.
After verification, Glama sends a confirmation email and gives you access to listing details, thumbnails, health checks, and analytics. Keep the HTTP file or DNS record in place: Glama periodically checks it and ownership remains verified while the token is discoverable.
The HTTP ownership file has this structure:
{
"$schema": "https://glama.ai/mcp/schemas/connector.json",
"claim": "glama_claim_..."
}Claim tokens are opaque, stable, and bound to the signed-in Glama account. They contain no email address or other personal information. If Glama can no longer discover a verified HTTP or DNS token, it starts a seven-day grace period before removing claim-based access. Restore the same token during that period to keep ownership verified. Never publish an email address, Glama session token, GitHub token, or connector credential as ownership proof.
If verification fails, confirm that you copied the current token exactly. The HTTP file must be public, return valid JSON with a successful HTTP response, and stay on the connector's origin. DNS changes may need more time to propagate. A claim cannot transfer to a different origin or hostname: if the connector target changes, Glama starts the grace period and the new target must be claimed separately after the previous claim is released.
For a connector linked to the official MCP Registry, registry updates continue to replace its name, description, and URL by default. After claiming, open Manage connector and enable Use Glama listing details as the source of truth if edits made on Glama should be preserved. Categories and thumbnails are always managed on Glama; registry linkage and technical connection settings continue to sync.
Control your server's listing on Glama, including description and metadata
Access analytics and receive server usage reports
Get monitoring and health status updates for your server
Feature your server to boost visibility and reach more users
To improve your MCP server's ranking:
Claim ownership of the server listing
Complete the server profile with an accurate description and thumbnail
Provide a test profile so Glama can connect to and evaluate the server
Keep tool definitions clear and complete to earn a high Tool Definition Quality Score (TDQS)
Route real usage through the Glama Gateway; more recorded successful server uses also improve the ranking
For users:
Full audit trail – every tool call is logged with inputs and outputs for compliance and debugging
Granular tool control – enable or disable individual tools per connector to limit what your AI agents can do
Centralized credential management – store and rotate API keys and OAuth tokens in one place
Change alerts – get notified when a connector changes its schema, adds or removes tools, or updates tool definitions, so nothing breaks silently
For server owners:
Proven adoption – public usage metrics on your listing show real-world traction and build trust with prospective users
Tool-level analytics – see which tools are being used most, helping you prioritize development and documentation
Direct user feedback – users can report issues and suggest improvements through the listing, giving you a channel you would not have otherwise
The connector status is unhealthy when Glama is unable to successfully connect to the server. This can happen for several reasons:
The server is experiencing an outage
The URL of the server is wrong
Credentials required to access the server are missing or invalid
If you are the owner of this MCP connector and would like to make modifications to the listing, including providing test credentials for accessing the server, please contact support@glama.ai.
Discussions
No comments yet. Be the first to start the discussion!
Related MCP Connectors
Read-only search and discovery for the international llms.txt directory maintained by llmsmap.me.
Search indexed websites, read raw page markdown, and score AI visibility for any site.
Web search, URL content extraction to Markdown, site mapping, and recursive web crawler.
Read-only search and Markdown access to liz's public docs, prompts, resources, and an MCP App.
Related MCP Servers
- AlicenseAqualityAmaintenanceLive, ranked search across any number of llms.txt documentation sites - Strands, Kiro, the AWS guides, and whatever you add at runtime.756MIT
- AlicenseNot gradedqualityCmaintenanceEnables fast, token-efficient access to large documentation files in llms.txt format through semantic search. Solves token limit issues by searching first and retrieving only relevant sections instead of dumping entire documentation.3MIT
- AlicenseNot gradedqualityBmaintenanceEnables AI agents to extract, validate, and discover documentation from websites using llms.txt and install.md standards.3032Inno Setup
- AlicenseNot gradedqualityCmaintenanceEnables Claude and other LLMs to search through any published MkDocs documentation site using the Lunr.js search engine, allowing the AI to find and summarize relevant documentation for users.14921MIT
Glama MCP Gateway
Add one secure layer between your agents and this server.
TDQS
Each tool has a clear and distinct role: llms_index discovers and parses the index, llms_page fetches a single documentation page, and llms_search queries previously parsed indexes. There is no meaningful overlap between them.
All tool names follow the same llms_ prefix with a simple verb-like suffix: index, page, search. This creates a predictable and consistent convention.
Three tools is well-scoped for a focused llms.txt utility server. Each tool covers a distinct necessary step in the workflow without redundancy or bloat.
The core workflow is covered: locate an index, search it, and retrieve individual pages. A minor gap is the lack of an explicit tool for directly fetching an llms-full.txt file, though llms_page may partially cover this.