MCP Llms Txt Explorer

🚀 MCP LLMS.txt Explorer

A Model Context Protocol server for exploring websites containing llms.txt files. This server helps you discover and analyze websites implementing the llms.txt standard.

✨ Features

Resources

• Check if a website has llms.txt and llms-full.txt files.
• Parse and validate the content of llms.txt files.
• Access structured data from compliant websites.

Tools

• check_website - Check if a website has an llms.txt file.
  • Accepts a domain URL as input.
  • Returns the file location and validation status.
• list_websites - List known websites with llms.txt files.
  • Returns structured data of compliant websites.
  • Supports filtering by file type (llms.txt/llms-full.txt).

📦 Installation

Installation via Smithery

To automatically install mcp-llms-txt-explorer for Claude Desktop via Smithery:

npx -y @smithery/cli install @thedaviddias/mcp-llms-txt-explorer --client claude

Manual Installation

To use this server:

# Clone the repository
git clone https://github.com/thedaviddias/mcp-llms-txt-explorer.git
cd mcp-llms-txt-explorer

# Install dependencies
pnpm install

# Build the server
pnpm run build

Configuration with Claude Desktop

To use with Claude Desktop, add the following configuration:

On MacOS: ~/Library/Application Support/Claude/claude_desktop_config.json On Windows: %APPDATA%/Claude/claude_desktop_config.json

{
  "mcpServers": {
    "llms-txt-explorer": {
      "command": "/path/to/llms-txt-explorer/build/index.js"
    }
  }
}

For npx usage, you can use:

{
  "mcpServers": {
    "llms-txt-explorer": {
      "command": "npx",
      "args": ["-y", "@thedaviddias/mcp-llms-txt-explorer"]
    }
  }
}

🔧 Technical Details

Development

Install dependencies:

pnpm install

Build the server:

pnpm run build

Development with automatic rebuild:

pnpm run watch

Debugging

Since MCP servers communicate via stdio, debugging can be challenging. We recommend using MCP Inspector, which is available as a package script:

pnpm run inspector

The Inspector will provide a URL to access the debugging tools in a browser.

📄 License

This project is licensed under the MIT License. See the LICENSE file for details.