Skip to main content
Glama

MCP LLMS.txt Explorer

MCP LLMS.txt Explorer

A Model Context Protocol server for exploring websites with llms.txt files. This server helps you discover and analyze websites that implement the llms.txt standard.

Features

Resources

  • Check websites for llms.txt and llms-full.txt files
  • Parse and validate llms.txt file contents
  • Access structured data about compliant websites

Tools

  • check_website - Check if a website has llms.txt files
    • Takes domain URL as input
    • Returns file locations and validation status
  • list_websites - List known websites with llms.txt files
    • Returns structured data about compliant websites
    • Supports filtering by file type (llms.txt/llms-full.txt)

Development

Install dependencies:

pnpm install

Build the server:

pnpm run build

For development with auto-rebuild:

pnpm run watch

Installation

Installing via Smithery

To install mcp-llms-txt-explorer for Claude Desktop automatically via Smithery:

npx -y @smithery/cli install @thedaviddias/mcp-llms-txt-explorer --client claude

Installing Manually

To use this server:

# Clone the repository git clone https://github.com/thedaviddias/mcp-llms-txt-explorer.git cd mcp-llms-txt-explorer # Install dependencies pnpm install # Build the server pnpm run build

Configuration with Claude Desktop

To use with Claude Desktop, add the server config:

On MacOS: ~/Library/Application Support/Claude/claude_desktop_config.json On Windows: %APPDATA%/Claude/claude_desktop_config.json

{ "mcpServers": { "llms-txt-explorer": { "command": "node", "args": ["/path/to/llms-txt-explorer/build/index.js"], } } }

For npx usage, you can use:

{ "mcpServers": { "llms-txt-explorer": { "command": "npx", "args": ["-y", "@thedaviddias/mcp-llms-txt-explorer"] } } }

Debugging

Since MCP servers communicate over stdio, debugging can be challenging. We recommend using the MCP Inspector, which is available as a package script:

pnpm run inspector

The Inspector will provide a URL to access debugging tools in your browser.

License

This project is licensed under the MIT License—see the LICENSE file for details.

Install Server
A
security – no known vulnerabilities
F
license - not found
A
quality - confirmed to work

remote-capable server

The server can be hosted and run remotely because it primarily relies on remote services or has no dependency on the local environment.

A server that helps discover and analyze websites implementing the llms.txt standard, allowing users to check if websites have llms.txt files and list known compliant websites.

  1. Features
    1. Resources
    2. Tools
  2. Development
    1. Installation
      1. Installing via Smithery
      2. Installing Manually
      3. Configuration with Claude Desktop
      4. Debugging
    2. License

      Related MCP Servers

      • A
        security
        A
        license
        A
        quality
        This server enables LLMs to retrieve and process content from web pages, converting HTML to markdown for easier consumption.
        Last updated -
        1
        61,532
        TypeScript
        MIT License
        • Linux
        • Apple
      • A
        security
        A
        license
        A
        quality
        Server for interacting with Meilisearch through LLM interfaces like Claude.
        Last updated -
        21
        114
        Python
        MIT License
      • -
        security
        A
        license
        -
        quality
        Provides access to Redis databases. This server enables LLMs to interact with Redis key-value stores through a set of standardized tools.
        Last updated -
        56
        29
        JavaScript
        MIT License
        • Apple
        • Linux
      • -
        security
        A
        license
        -
        quality
        An MCP server that provides tools to load and fetch documentation from any llms.txt source, giving users full control over context retrieval for LLMs in IDE agents and applications.
        Last updated -
        553
        Python
        MIT License
        • Apple

      View all related MCP servers

      MCP directory API

      We provide all the information about MCP servers via our MCP API.

      curl -X GET 'https://glama.ai/api/mcp/v1/servers/thedaviddias/mcp-llms-txt-explorer'

      If you have feedback or need assistance with the MCP directory API, please join our Discord server