# LiteLLM MCP Server Bridge

A Model Context Protocol (MCP) server that connects Antigravity to your deployed LiteLLM instance.

## Features

This MCP server provides the following tools:

- **chat_completion** - Generate chat completions using any model in your LiteLLM instance
- **completion** - Generate text completions using the legacy endpoint
- **list_models** - List all available models
- **health_check** - Check LiteLLM instance health status
- **create_embedding** - Generate embeddings
- **model_info** - Get detailed information about a specific model
- **create_image** - Generate images using models available in your instance
- **create_speech** - Generate speech audio from text (TTS)
- **rerank** - Rerank documents based on a search query
- **key_generate** - Generate a new LiteLLM Proxy API key (admin feature)
- **key_info** - Get details and spend info for a LiteLLM Proxy API key (admin feature)

## Setup

### 1. Configure Antigravity

Add the following to your Antigravity MCP configuration. This will use `npx` to fetch and run the latest version of the published package on-the-fly.

```json
{
  "mcpServers": {
    "litellm": {
      "command": "npx",
      "args": [
        "-y",
        "litellm-mcp-server@latest"
      ],
      "env": {
        "LITELLM_BASE_URL": "https://your-litellm-url",
        "LITELLM_API_KEY": "your-api-key-here"
      }
    }
  }
}
```

### 2. Set Your Secrets

Replace `your-litellm-url` and `your-api-key-here` in the configuration with your actual LiteLLM Base URL and API key.

## Usage Examples

Once configured, you can use the MCP tools in Antigravity:

### Chat Completion

```
Use the chat_completion tool to generate a response using gpt-4
```

### List Models

```
Use the list_models tool to see what models are available
```

### Health Check

```
Use the health_check tool to verify the LiteLLM instance is running
```

## Environment Variables

- `LITELLM_BASE_URL` - Your LiteLLM instance URL
- `LITELLM_API_KEY` - Your LiteLLM API key for authentication

## Troubleshooting

### Server won't start

1. Ensure Node.js is installed: `node --version`
2. Check dependencies are installed: `npm install`
3. Verify the script path in your Antigravity config is correct
4. Check that your API key is valid

### Connection errors

1. Verify your LiteLLM instance is accessible: `curl https://your-litellm-url/health`
2. Check your API key has proper permissions
3. Ensure your network allows connections to the LiteLLM instance

### Tool not showing up

1. Restart Antigravity after adding the MCP server configuration
2. Check Antigravity logs for any error messages
3. Verify the JSON configuration is valid

## Architecture

The MCP server acts as a bridge:

```
Antigravity ←→ MCP Server (this script) ←→ LiteLLM Instance
```

All requests from Antigravity are forwarded to your LiteLLM instance with proper authentication headers.

## License

MIT