Server Configuration
Describes the environment variables required to run the server.
| Name | Required | Description | Default |
|---|---|---|---|
| LLM_MODEL | No | Override the default LLM model. | |
| AWS_REGION | No | AWS region for Bedrock embeddings (amazon.titan-embed-text-v2:0). Requires IAM permissions. | |
| GEMINI_API_KEY | No | API key for Google Gemini. Used for both LLM (gemini-2.0-flash) and embeddings (text-embedding-004) by default. | |
| OPENAI_API_KEY | No | API key for OpenAI. Used for both LLM (gpt-4o-mini) and embeddings (text-embedding-3-small) by default. | |
| EMBEDDING_MODEL | No | Override the default embedding model. | |
| ANTHROPIC_API_KEY | No | API key for Anthropic. Used for LLM (claude-sonnet-4-5-20250929) by default. |
Capabilities
Features and capabilities supported by this server
| Capability | Details |
|---|---|
| tools | {
"listChanged": true
} |
Tools
Functions exposed to the LLM to take actions
| Name | Description |
|---|---|
| ragchat_setup | Initialize a domain with a knowledge base from markdown content. Each ## section becomes a searchable document with vector embeddings. This is the first step — run this before testing or serving. |
| ragchat_test | Send a test message to a domain's chat. Uses RAG search + LLM to generate a response, same as production. Good for verifying the knowledge base works. |
| ragchat_serve | Start a local HTTP chat server for a domain. The server runs on localhost and handles POST /chat requests. Use ragchat_widget to get the embed code that connects to this server. |
| ragchat_widget | Generate an embeddable chat widget. Returns a tag that creates a floating chat bubble on any webpage. Connects to the chat server started with ragchat_serve. |
| ragchat_status | List all configured domains with document counts and config status. Shows what's been set up and what's ready to serve. |
Prompts
Interactive templates invoked by user choice
| Name | Description |
|---|---|
No prompts | |
Resources
Contextual data attached and managed by the client
| Name | Description |
|---|---|
No resources | |