Server Configuration
Describes the environment variables required to run the server.
| Name | Required | Description | Default |
|---|---|---|---|
| DEVICE | Yes | If your system has Nvidia GPU CUDA Toolkit setup, you can set the device to cuda, otherwise set it to cpu | cuda |
| DOCUMENT_DIR | Yes | Absolute path to the directory where documents are stored | |
| RERANKER_MODEL | Yes | Absolute path to the local reranker model or HuggingFace model identifier | |
| EMBEDDING_MODEL | Yes | Absolute path to the local embedding model or HuggingFace model identifier | |
| CHROMA_DB_PERSIST_DIR | Yes | Absolute path to the directory where ChromaDB databases are persisted |
Schema
Prompts
Interactive templates invoked by user choice
| Name | Description |
|---|---|
No prompts | |
Resources
Contextual data attached and managed by the client
| Name | Description |
|---|---|
No resources | |
Tools
Functions exposed to the LLM to take actions
| Name | Description |
|---|---|
No tools | |