Server Configuration
Describes the environment variables required to run the server.
| Name | Required | Description | Default |
|---|---|---|---|
| AI21_API_KEY | No | API key for AI21 Labs (Jamba models) | |
| GROK_API_KEY | No | API key for x.ai (Grok) models | |
| CLAUDE_API_KEY | No | API key for Anthropic Claude models | |
| COHERE_API_KEY | No | API key for Cohere enterprise models | |
| GEMINI_API_KEY | No | API key for Google Gemini models | |
| OPENAI_API_KEY | No | API key for OpenAI models (gpt-4o, etc.) | |
| MISTRAL_API_KEY | No | API key for Mistral AI models | |
| ANYSCALE_API_KEY | No | API key for Anyscale enterprise-grade serving | |
| DEEPSEEK_API_KEY | No | API key for DeepSeek reasoning models | |
| TOGETHER_API_KEY | No | API key for Together AI models | |
| FIREWORKS_API_KEY | No | API key for Fireworks AI inference | |
| GROQ_FAST_API_KEY | No | API key for Groq fast inference | |
| STABILITY_API_KEY | No | API key for Stability AI models | |
| OPENROUTER_API_KEY | No | API key for OpenRouter (access to 200+ models) | |
| PERPLEXITY_API_KEY | No | API key for Perplexity AI web-connected search | |
| HUGGINGFACE_API_KEY | No | API key for HuggingFace Hub (access to 800k+ models) | |
| REPLICATE_API_TOKEN | No | API token for Replicate open-source models |
Tools
Functions exposed to the LLM to take actions
| Name | Description |
|---|---|
No tools | |
Prompts
Interactive templates invoked by user choice
| Name | Description |
|---|---|
No prompts | |
Resources
Contextual data attached and managed by the client
| Name | Description |
|---|---|
No resources | |