Skip to main content
Glama
samayhuf-star

Website Intelligence MCP Server

README.md
# Website Intelligence MCP Server

A [Model Context Protocol (MCP)](https://modelcontextprotocol.io) server that exposes 10 website intelligence tools for AI agents. Each tool wraps a REST API endpoint hosted at `http://64.227.2.61/intel/`.

## Tools

| Tool | Description | Parameter |
|------|-------------|-----------|
| `url_to_markdown` | Convert any website to clean Markdown | `url` |
| `metadata_extractor` | Extract page metadata (title, description, OG tags, etc.) | `url` |
| `technology_detector` | Detect CMS, frameworks, analytics, CDN, and more | `url` |
| `contact_finder` | Find emails, phone numbers, social media links | `url` |
| `seo_analyzer` | SEO analysis — title tags, meta descriptions, headings, images | `url` |
| `robots_txt_parser` | Fetch and parse `robots.txt` rules | `url` |
| `sitemap_discoverer` | Discover XML/RSS sitemaps | `url` |
| `ssl_checker` | Check SSL certificate validity, expiry, and issuer | `domain` |
| `dns_lookup` | DNS records lookup (A, AAAA, CNAME, MX, NS, TXT, etc.) | `domain` |
| `website_summary` | AI-powered summary of page content | `url` |

Every tool accepts an optional `api_key` parameter for authenticated access.

## Installation

```bash
pip install web-intel-mcp-server
```

## Usage

### With an MCP client (Claude Desktop, etc.)

Add to your MCP client config:

```json
{
  "mcpServers": {
    "web-intel": {
      "command": "web-intel-mcp-server",
      "type": "stdio"
    }
  }
}
```

### Standalone

```bash
# Run with default stdio transport
web-intel-mcp-server

# Or directly with Python
python -m mcp_server
```

### Testing with the MCP Inspector

```bash
npx @modelcontextprotocol/inspector web-intel-mcp-server
```

## API Access & Payments

The underlying API supports **Solana USDC payments** for higher-rate access. If you need increased limits or a dedicated API key:

1. Contact the operator with your Solana wallet address
2. Send USDC on Solana to the provided wallet
3. Receive your `X-API-Key` for authenticated requests

Without an API key, endpoints may have rate limits or require one depending on server configuration.

## Development

```bash
# Clone and install in editable mode
git clone https://github.com/samayhuf-star/web-intel-mcp-server.git
cd web-intel-mcp-server
pip install -e .
```

## License

MIT