Server Configuration
Describes the environment variables required to run the server.
| Name | Required | Description | Default |
|---|---|---|---|
| OLLAMA_HOST | No | Host URL for Ollama services (Local models) | http://localhost:11434 |
| XAI_API_KEY | No | API key for xAI services (Grok models) | |
| GROQ_API_KEY | No | API key for Groq services (Llama 3, Mixtral, etc.) | |
| LLAMA_API_KEY | No | API key for Meta Llama services (Direct Meta access) | |
| COHERE_API_KEY | No | API key for Cohere services (Command models) | |
| GOOGLE_API_KEY | No | API key for Google services (Gemini Pro, Gemini Flash, etc.) | |
| NVIDIA_API_KEY | No | API key for NVIDIA services (Various models) | |
| OPENAI_API_KEY | No | API key for OpenAI services (GPT-4, GPT-3.5, DALL-E, etc.) | |
| MISTRAL_API_KEY | No | API key for Mistral AI services (Mistral Large, Medium, Small) | |
| CEREBRAS_API_KEY | No | API key for Cerebras services (Fast inference) | |
| DEEPSEEK_API_KEY | No | API key for DeepSeek services (DeepSeek Chat & Coder) | |
| TOGETHER_API_KEY | No | API key for Together AI services (Open source models) | |
| ANTHROPIC_API_KEY | No | API key for Anthropic services (Claude 3.5, Claude 3, etc.) | |
| DEEPINFRA_API_KEY | No | API key for DeepInfra services (Optimized models) | |
| FIREWORKS_API_KEY | No | API key for Fireworks AI services (Fast inference) | |
| SAMBANOVA_API_KEY | No | API key for SambaNova services (Enterprise models) | |
| OPENROUTER_API_KEY | No | API key for OpenRouter services (Multi-provider access) | |
| PERPLEXITY_API_KEY | No | API key for Perplexity services (Sonar models) | |
| HUGGINGFACE_API_KEY | No | API key for HuggingFace services (Open source models) | |
| IBM_WATSONX_API_KEY | No | API key for IBM WatsonX services (IBM models) |
Schema
Prompts
Interactive templates invoked by user choice
| Name | Description |
|---|---|
No prompts | |
Resources
Contextual data attached and managed by the client
| Name | Description |
|---|---|
No resources | |
Tools
Functions exposed to the LLM to take actions
| Name | Description |
|---|---|
No tools | |