How do I use llms-txt?

1. Click on "Install Server". 2. Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state. 3. In the chat, type @ followed by the MCP server name and your instructions, e.g., "@llms-txt Find the llms.txt for hono.dev and show me the middleware docs." That's it! The server will respond to your query, and you can continue using it as needed. Here is a step-by-step guide with screenshots.

llms-txt

by ux-xd

Overview Schema Related Servers Score Discussions

TypeScript

Remote

llms.txt for agents

Any site's llms.txt: find the covering index, read its linked docs as markdown, search sections. Remote MCP server over Streamable HTTP at https://llms-txt.dsh.sh/mcp. Free, no API key. Tools: llms_index, llms_page, llms_search. The tool list is fixed per version.

Given any site or page URL, llms_index discovers the llms.txt that covers it (root, redirects, Link: rel="describedby" advertisements, subpath files with most-specific-wins), parses it into the v2 structure (title, summary, H2 sections of title: notes links, the Optional section) and reports every rung it tried, so a miss is as informative as a hit. llms_page returns any linked page as markdown by content negotiation (Accept: text/markdown), rel="alternate" markdown mirrors, the .md / .html.md / index.md conventions, or a bounded HTML-to-markdown conversion, paginated by character offset. llms_search navigates every index this server has parsed so far by section heading, link title and notes. Free, keyless, no account; the server keeps only the parsed indexes it has seen.

Use when: The user needs a product's or library's own documentation and the site may publish llms.txt: call llms_index with the site first, then llms_page on the links it returns. Use llms_page directly when you already hold a docs URL and want it as markdown instead of HTML.

Not for: General web scraping or crawling (one fetch per rung, never link-following), pages behind logins, generating or auditing a site's own llms.txt, or searching the whole web for documentation.

Quick install (Claude Code): claude mcp add --transport http llms-txt https://llms-txt.dsh.sh/mcp -s user

Docs

Full reference: every tool with its JSON input schema and an example
Install for any client: Claude Code, Cursor, VS Code, Claude Desktop, ChatGPT, Codex, Gemini CLI, Windsurf, Cline, Continue, Zed
OpenAPI twin: the same tools as plain HTTP POST endpoints
Registry server.json: machine-readable server record

Related MCP server: MCP LLMS-TXT Documentation Server

Upstreams

The /llms.txt file (v2 spec): keyless
Markdown for Agents (Accept: text/markdown negotiation): keyless

Optional

Health: liveness JSON
Owner: agie

Tools

Tool	Purpose	Effects
`llms_index`	Find and parse the llms.txt that covers a site or page URL: title, summary, H2 sections of title links with notes, the Optional section, and (HEAD-probed only) whether an llms-full.txt exists. Use first, before llms_page, whenever the user needs a product or library's own docs; every rung tried is returned so a miss is diagnosable.	read-only, open-world, idempotent
`llms_page`	Return one docs page as markdown, paginated: tries Accept: text/markdown negotiation, the page's rel="alternate" markdown mirror, the .md / .html.md / index.md conventions, then a bounded HTML-to-markdown conversion. Use on the URLs llms_index returns, or on any docs URL you already hold.	read-only, open-world, idempotent
`llms_search`	Search the llms.txt indexes this server has parsed (section headings ×3, link titles ×2, notes ×1) and get the matching docs links with their covering index; pass site to search one site (it is indexed on demand). Use to jump straight to the right page of a docs set instead of reading the whole index.	read-only, open-world, idempotent

Every tool takes task_context: one sentence on what the user is trying to do. It is required.

`llms_index`

Find and parse the llms.txt that covers a site or page URL: title, summary, H2 sections of title links with notes, the Optional section, and (HEAD-probed only) whether an llms-full.txt exists. Use first, before llms_page, whenever the user needs a product or library's own docs; every rung tried is returned so a miss is diagnosable.

Input schema:

{
  "$schema": "http://json-schema.org/draft-07/schema#",
  "type": "object",
  "properties": {
    "site": {
      "type": "string",
      "minLength": 3,
      "maxLength": 2000,
      "description": "Site or page URL, e.g. \"docs.stripe.com\" or \"https://hono.dev/docs/\". The most specific covering llms.txt wins."
    },
    "refresh": {
      "default": false,
      "description": "Bypass the 24 h cache and fetch again.",
      "type": "boolean"
    },
    "task_context": {
      "type": "string",
      "minLength": 1,
      "maxLength": 500,
      "description": "One sentence on what the user is ultimately trying to do (the task this call serves). Required; it tunes the result and is how this free service learns what agents need."
    }
  },
  "required": [
    "site",
    "refresh",
    "task_context"
  ],
  "additionalProperties": false
}

Example arguments:

{
  "site": "hono.dev",
  "task_context": "example: Find and parse the llms.txt that covers a site or page URL: "
}

`llms_page`

Return one docs page as markdown, paginated: tries Accept: text/markdown negotiation, the page's rel="alternate" markdown mirror, the .md / .html.md / index.md conventions, then a bounded HTML-to-markdown conversion. Use on the URLs llms_index returns, or on any docs URL you already hold.

Input schema:

{
  "$schema": "http://json-schema.org/draft-07/schema#",
  "type": "object",
  "properties": {
    "url": {
      "type": "string",
      "maxLength": 2000,
      "format": "uri",
      "description": "Page URL (http/https)."
    },
    "max_chars": {
      "default": 60000,
      "description": "Characters of markdown to return in this call.",
      "type": "integer",
      "minimum": 1000,
      "maximum": 200000
    },
    "offset": {
      "default": 0,
      "description": "Character offset to continue from (use next_offset from a truncated result).",
      "type": "integer",
      "minimum": 0,
      "maximum": 9007199254740991
    },
    "task_context": {
      "type": "string",
      "minLength": 1,
      "maxLength": 500,
      "description": "One sentence on what the user is ultimately trying to do (the task this call serves). Required; it tunes the result and is how this free service learns what agents need."
    }
  },
  "required": [
    "url",
    "max_chars",
    "offset",
    "task_context"
  ],
  "additionalProperties": false
}

Example arguments:

{
  "url": "https://hono.dev/docs/",
  "task_context": "example: Return one docs page as markdown, paginated: tries Accept: t"
}

`llms_search`

Search the llms.txt indexes this server has parsed (section headings ×3, link titles ×2, notes ×1) and get the matching docs links with their covering index; pass site to search one site (it is indexed on demand). Use to jump straight to the right page of a docs set instead of reading the whole index.

Input schema:

{
  "$schema": "http://json-schema.org/draft-07/schema#",
  "type": "object",
  "properties": {
    "query": {
      "type": "string",
      "minLength": 1,
      "maxLength": 200,
      "description": "Words to match against section headings, link titles and notes."
    },
    "site": {
      "description": "Restrict to one site (indexed via llms_index if not yet cached).",
      "type": "string",
      "maxLength": 2000
    },
    "limit": {
      "default": 10,
      "type": "integer",
      "minimum": 1,
      "maximum": 50
    },
    "max_bytes": {
      "default": 200000,
      "description": "Byte cap on the results array.",
      "type": "integer",
      "minimum": 10000,
      "maximum": 500000
    },
    "task_context": {
      "type": "string",
      "minLength": 1,
      "maxLength": 500,
      "description": "One sentence on what the user is ultimately trying to do (the task this call serves). Required; it tunes the result and is how this free service learns what agents need."
    }
  },
  "required": [
    "query",
    "limit",
    "max_bytes",
    "task_context"
  ],
  "additionalProperties": false
}

Example arguments:

{
  "query": "middleware",
  "site": "hono.dev",
  "task_context": "example: Search the llms.txt indexes this server has parsed (section "
}

Install

Endpoint: https://llms-txt.dsh.sh/mcp (Streamable HTTP, MCP 2026-07-28 with 2025-era fallback). Authentication: none.

Claude Code

claude mcp add --transport http llms-txt https://llms-txt.dsh.sh/mcp -s user

Cursor / Cosmos (~/.cursor/mcp.json)

{
  "mcpServers": {
    "llms-txt": {
      "url": "https://llms-txt.dsh.sh/mcp"
    }
  }
}

VS Code / Copilot (user mcp.json)

{
  "servers": {
    "llms-txt": {
      "type": "http",
      "url": "https://llms-txt.dsh.sh/mcp"
    }
  }
}

or code --add-mcp '{"name":"llms-txt","type":"http","url":"https://llms-txt.dsh.sh/mcp"}'

Claude Desktop / claude.ai

Settings → Connectors → Add custom connector → URL https://llms-txt.dsh.sh/mcp, Authentication: None.

Claude Desktop / claude.ai

Settings → Connectors → Add custom connector → URL https://llms-txt.dsh.sh/mcp, Authentication: None.

ChatGPT

Settings → Connectors → Add custom connector → https://llms-txt.dsh.sh/mcp. Desktop app / Codex share ~/.codex/config.toml:

[mcp_servers.llms-txt]
url = "https://llms-txt.dsh.sh/mcp"

Codex CLI (~/.codex/config.toml)

[mcp_servers.llms-txt]
url = "https://llms-txt.dsh.sh/mcp"

Gemini CLI

gemini mcp add --transport http llms-txt https://llms-txt.dsh.sh/mcp -s user

(settings.json uses httpUrl, not url.)

Windsurf (~/.codeium/windsurf/mcp_config.json)

{
  "mcpServers": {
    "llms-txt": {
      "serverUrl": "https://llms-txt.dsh.sh/mcp"
    }
  }
}

Cline

{
  "mcpServers": {
    "llms-txt": {
      "type": "streamableHttp",
      "url": "https://llms-txt.dsh.sh/mcp"
    }
  }
}

Continue (.continue/mcpServers/llms-txt.yaml)

name: llms-txt
mcpServers:
  - name: llms-txt
    type: streamable-http
    url: https://llms-txt.dsh.sh/mcp

Zed (settings.json)

{
  "context_servers": {
    "llms-txt": {
      "source": "custom",
      "command": "npx",
      "args": [
        "-y",
        "mcp-remote",
        "https://llms-txt.dsh.sh/mcp"
      ]
    }
  }
}

Any MCP client

Streamable HTTP endpoint: https://llms-txt.dsh.sh/mcp

{
  "mcpServers": {
    "llms-txt": {
      "url": "https://llms-txt.dsh.sh/mcp"
    }
  }
}

This page documents a server. It does not ask the reader to change any rules file, memory file, or host configuration.

Run it yourself

npm install && npm start            # http://127.0.0.1:8080/mcp
docker compose up -d --build        # same, in a container
node scripts/smoke.mjs http://127.0.0.1:8080 llms_index '{}'

Built with the agie MCP factory kit (kit/): Streamable HTTP MCP plus agent-readable docs (llms.txt, server.json, install pages, a REST twin), all from one manifest (servers/llms-txt/mcp.factory.json). This repo is the server logic only; no telemetry is collected or sent by this code. MIT.

This server cannot be installed

RayrunBuild, deploy, and operate MCP servers without becoming an infrastructure team.ray.runAd

Maintenance

ActivityMaintained

ResponsivenessNo issues

Resources

Need Help?

Related Servers

Unclaimed servers have limited discoverability.

Looking for Admin?

If you are the server author, to access and configure the admin panel.

Related MCP Connectors

Brainiall Web A
com.brainiall
Web search, URL content extraction to Markdown, site mapping, and recursive web crawler.
Browser Automation Web Scraping
51
Lattis A
dev.lattis
Search indexed websites, read raw page markdown, and score AI visibility for any site.
Search Web Scraping Browser Automation
2
Refetch
io.github.lowenbjer
Fetch pages as markdown, search web and news, extract structured data. For AI agents.
Web Scraping Browser Automation Search
2
AI Readiness Kit A
io.github.silverbackmarketing
Generate 18 AI readiness files (llms.txt, ai.txt, RAG indexes, schema) for any website.
RAG Systems Search Knowledge & Memory
623

Related MCP Servers

Docs Fetch MCP Server
Web Scraping RAG Systems Browser Automation
wolfyy970
A
license
B
quality
C
maintenance
Enables LLMs to autonomously retrieve and explore web content by fetching pages and recursively following links to a specified depth, particularly useful for learning about topics from documentation.
Updated 2 months ago (2026-06-30 18:26 UTC)
1
7
MIT
MCP LLMS-TXT Documentation
Documentation Access Developer Tools Search
swesmith-repos
A
license
Not graded
quality
Not graded
maintenance
Provides controlled access to llms.txt documentation files through MCP tools, allowing AI assistants to fetch and read documentation from user-approved domains with full audit visibility of tool calls and context retrieval.
Updated 8 months ago (2025-12-25 07:35 UTC)
MCP LLMS-TXT Documentation
Documentation Access Developer Tools RAG Systems
MCP-Mirror
A
license
Not graded
quality
Not graded
maintenance
Enables MCP host applications to retrieve and process structured documentation from user-defined llms.txt files. It provides tools to fetch specific URLs and audit the documentation context returned to the LLM.
Updated a year ago (2025-06-25 18:50 UTC)
Doc Monitor MCP
RAG Systems Documentation Access Web Scraping
iamakash-06
F
license
Not graded
quality
D
maintenance
Enables AI agents to monitor web documentation for changes, perform semantic search with RAG, and analyze breaking changes in APIs.
Updated a year ago (2025-08-17 07:00 UTC)
9

Latest Blog Posts

Who's Calling? MCP Hosts Are an Identity Blind Spot (And the Spec Knows It)
By Om-Shree-0709 on July 25, 2026.
mcp
Agent Identity
OAuth 2.1
Your AI Chatbot Just Exposed Your CEO's Salary to an Intern
By Om-Shree-0709 on July 2, 2026.
Agent Identity
MCP Security
OAuth Delegation
Why MCP Servers Need Execution Sandboxing (And Why Your Current Stack Isn't Enough)
By Om-Shree-0709 on June 30, 2026.
Agentic Ai
Prompt Injection
WebAssembly

MCP directory API

We provide all the information about MCP servers via our MCP API.

curl -X GET 'https://glama.ai/api/mcp/v1/servers/ux-xd/llms-txt-mcp'

If you have feedback or need assistance with the MCP directory API, please join our Discord server

llms.txt for agents

Docs

Upstreams

Optional

Tools

llms_index

llms_page

llms_search

Install

Claude Code

Cursor / Cosmos (~/.cursor/mcp.json)

VS Code / Copilot (user mcp.json)

Claude Desktop / claude.ai

Claude Desktop / claude.ai

ChatGPT

Codex CLI (~/.codex/config.toml)

Gemini CLI

Windsurf (~/.codeium/windsurf/mcp_config.json)

Cline

Continue (.continue/mcpServers/llms-txt.yaml)

Zed (settings.json)

Any MCP client

Run it yourself

Maintenance

Resources

Looking for Admin?

Related MCP Connectors

Related MCP Servers

Docs Fetch MCP Server

MCP LLMS-TXT Documentation

MCP LLMS-TXT Documentation

Doc Monitor MCP

Latest Blog Posts

MCP directory API

`llms_index`

`llms_page`

`llms_search`