MCP LLMS.txt Explorer

MCP LLMS.txt Explorer

A Model Context Protocol server for exploring websites with llms.txt files. This server helps you discover and analyze websites that implement the llms.txt standard.

Features

Resources

• Check websites for llms.txt and llms-full.txt files
• Parse and validate llms.txt file contents
• Access structured data about compliant websites

Tools

• check_website - Check if a website has llms.txt files
  • Takes domain URL as input
  • Returns file locations and validation status
• list_websites - List known websites with llms.txt files
  • Returns structured data about compliant websites
  • Supports filtering by file type (llms.txt/llms-full.txt)

Development

Install dependencies:

Build the server:

For development with auto-rebuild:

Installation

Installing via Smithery

To install mcp-llms-txt-explorer for Claude Desktop automatically via Smithery:

Installing Manually

To use this server:

Configuration with Claude Desktop

To use with Claude Desktop, add the server config:

On MacOS: ~/Library/Application Support/Claude/claude_desktop_config.json On Windows: %APPDATA%/Claude/claude_desktop_config.json

For npx usage, you can use:

Debugging

Since MCP servers communicate over stdio, debugging can be challenging. We recommend using the MCP Inspector, which is available as a package script:

The Inspector will provide a URL to access debugging tools in your browser.

License

This project is licensed under the MIT License—see the LICENSE file for details.