Skip to main content
Glama
thunderbit-com

thunderbit-web-scraping-mcp

Official
README.md
# Thunderbit MCP Server

> Open-source toolkit for the Thunderbit Open API — CLI, MCP server, and Claude Code plugin.

[![npm: @thunderbit/mcp-server](https://img.shields.io/npm/v/@thunderbit/mcp-server.svg?label=%40thunderbit%2Fmcp-server)](https://npmjs.com/package/@thunderbit/mcp-server)
[![npm: @thunderbit/thunderbit-cli](https://img.shields.io/npm/v/@thunderbit/thunderbit-cli.svg?label=%40thunderbit%2Fcli)](https://npmjs.com/package/@thunderbit/thunderbit-cli)
[![License: MIT](https://img.shields.io/badge/License-MIT-blue.svg)](LICENSE)

This monorepo ships three packages, all backed by the [Thunderbit Open API](https://thunderbit.com/docs/introduction):

| Package | Purpose | Audience |
|---------|---------|----------|
| [`@thunderbit/thunderbit-cli`](packages/cli) | Command-line tool for distill / extract / batch | Developers, scripts, CI |
| [`@thunderbit/mcp-server`](packages/mcp-server) | Model Context Protocol server (7 tools) | AI assistants — Claude Desktop, Cursor, Cline, Claude Code |
| [`thunderbit` Claude Code plugin](packages/claude-plugin) | Bundled MCP + 4 skills | Claude Code users |

Get a free API key at [app.thunderbit.com/console/api-keys](https://app.thunderbit.com/console/api-keys).

---

## Quick Start

### CLI

```bash
npm i -g @thunderbit/thunderbit-cli
export THUNDERBIT_API_KEY=tb_your_api_key_here
thunderbit distill https://example.com -f markdown
```

### MCP Server (Claude Desktop / Cursor / Cline)

Edit your MCP client config:

```json
{
  "mcpServers": {
    "thunderbit": {
      "command": "npx",
      "args": ["-y", "@thunderbit/mcp-server"],
      "env": { "THUNDERBIT_API_KEY": "tb_your_api_key_here" }
    }
  }
}
```

### Claude Code Plugin

```bash
claude plugin marketplace add thunderbit-com/thunderbit-mcp-server
claude plugin add thunderbit
export THUNDERBIT_API_KEY=tb_your_api_key_here
```

---

## What you can do

- Convert any web page into clean, LLM-ready Markdown
- Extract structured data from pages using JSON Schema
- Get AI-suggested fields when you don't know what's on a page
- Run batch jobs on up to 100 URLs at a time

---

## Pricing

Distill — 1 credit. Extract — 20 credits. Suggest fields — free. Batch jobs scale per URL. Status polling is free.

Top up at [app.thunderbit.com/console/billing](https://app.thunderbit.com/console/billing).

---

## Development

```bash
git clone https://github.com/thunderbit-com/thunderbit-mcp-server.git
cd thunderbit-mcp-server
# each package is independent
cd packages/mcp-server && npm install
cd packages/cli && npm install
```

---

## API Reference

The full HTTP contract is documented in [`openapi.yaml`](openapi.yaml) (OpenAPI 3.1) — base URL `https://openapi.thunderbit.com`, Bearer auth with your `THUNDERBIT_API_KEY`.

---

## License

MIT © Thunderbit