Skip to main content
Glama
README.md
# MCP LLMS.txt Explorer

<a href="https://glama.ai/mcp/servers/lhyj3pva0z">
  <img width="380" height="200" src="https://glama.ai/mcp/servers/lhyj3pva0z/badge" alt="LLMS.txt Explorer MCP server" />
</a>

[![smithery badge](https://smithery.ai/badge/@thedaviddias/mcp-llms-txt-explorer)](https://smithery.ai/server/@thedaviddias/mcp-llms-txt-explorer)

A Model Context Protocol server for exploring websites with llms.txt files. This server helps you discover and analyze websites that implement the llms.txt standard.

## Features

### Resources
- Check websites for llms.txt and llms-full.txt files
- Parse and validate llms.txt file contents
- Access structured data about compliant websites

### Tools
- `check_website` - Check if a website has llms.txt files
  - Takes domain URL as input
  - Returns file locations and validation status
- `list_websites` - List known websites with llms.txt files
  - Returns structured data about compliant websites
  - Supports filtering by file type (llms.txt/llms-full.txt)

## Development

Install dependencies:
```bash
pnpm install
```

Build the server:
```bash
pnpm run build
```

For development with auto-rebuild:
```bash
pnpm run watch
```

## Installation

### Installing via Smithery

To install mcp-llms-txt-explorer for Claude Desktop automatically via [Smithery](https://smithery.ai/server/@thedaviddias/mcp-llms-txt-explorer):

```bash
npx -y @smithery/cli install @thedaviddias/mcp-llms-txt-explorer --client claude
```

### Installing Manually
To use this server:

```bash
# Clone the repository
git clone https://github.com/thedaviddias/mcp-llms-txt-explorer.git
cd mcp-llms-txt-explorer

# Install dependencies
pnpm install

# Build the server
pnpm run build
```

### Configuration with Claude Desktop

To use with Claude Desktop, add the server config:

On MacOS: `~/Library/Application Support/Claude/claude_desktop_config.json`
On Windows: `%APPDATA%/Claude/claude_desktop_config.json`

```json
{
  "mcpServers": {
    "llms-txt-explorer": {
      "command": "node",
      "args": ["/path/to/llms-txt-explorer/build/index.js"]
    }
  }
}
```

For npx usage, you can use:
```json
{
  "mcpServers": {
    "llms-txt-explorer": {
      "command": "npx",
      "args": ["-y", "@thedaviddias/mcp-llms-txt-explorer"]
    }
  }
}
```

### Debugging

Since MCP servers communicate over stdio, debugging can be challenging. We recommend using the [MCP Inspector](https://github.com/modelcontextprotocol/inspector), which is available as a package script:

```bash
pnpm run inspector
```

The Inspector will provide a URL to access debugging tools in your browser.

## License

This project is licensed under the MIT License—see the LICENSE file for details.

TDQS

B3.1/5.0

Scored across 2 tools

Disambiguation5/5

The two tools have clearly distinct purposes: check_website verifies the presence of llms.txt files on a specific website, while list_websites retrieves a list of known websites that already have such files. There is no overlap in functionality, making it easy for an agent to select the appropriate tool based on the task.

Naming Consistency5/5

Both tools follow a consistent verb_noun pattern (check_website and list_websites), using snake_case and clear action verbs. This uniformity makes the tool set predictable and easy to understand, with no deviations in naming conventions.

Tool Count2/5

With only two tools, the server feels under-scoped for exploring llms.txt files. While the tools cover basic checking and listing, there are likely missing operations such as fetching file contents, updating lists, or analyzing data, which limits the server's utility for comprehensive exploration.

Completeness2/5

The tool set is severely incomplete for an 'Explorer' server. It lacks essential operations like retrieving the actual llms.txt content, validating file structure, searching within files, or managing the list of websites. This creates significant gaps that will hinder agents from performing meaningful exploration tasks.

Maintenance

ActivityInactive
ResponsivenessUnresponsive