Server Configuration
Describes the environment variables required to run the server.
| Name | Required | Description | Default |
|---|---|---|---|
| GITHUB_TOKEN | No | GitHub token for testing models for free with rate limits. | |
| EVAL_DATA_DIR | Yes | Path to the JSONL evaluation dataset. | |
| AZURE_CLIENT_ID | No | The ID of your Service Principal (app registration). Required when using service-principal. | |
| AZURE_TENANT_ID | No | The ID of your Azure Active Directory tenant. Required when using service-principal. | |
| AZURE_CLIENT_SECRET | No | The secret credential for the Service Principal. Required when using service-principal. | |
| AZURE_OPENAI_API_KEY | No | API key for Azure OpenAI. Required for text quality evaluators. | |
| AZURE_OPENAI_ENDPOINT | No | Endpoint for Azure OpenAI. Required for text quality evaluators. | |
| AZURE_AI_SEARCH_API_KEY | No | The API key for your Azure AI Search service. Required when using api-search-key. | |
| AZURE_OPENAI_DEPLOYMENT | No | Deployment name (e.g., gpt-4o). Required for text quality evaluators. | |
| AZURE_AI_SEARCH_ENDPOINT | Yes | The endpoint URL for your Azure AI Search service. It should look like this: https://<your-search-service-name>.search.windows.net/. | |
| AZURE_OPENAI_API_VERSION | No | Version of the OpenAI API. Required for text quality evaluators. | |
| AZURE_AI_PROJECT_ENDPOINT | No | Used for Azure AI Agent querying and evaluation. | |
| AZURE_AI_SEARCH_API_VERSION | No | API Version to use. Defaults to 2025-03-01-preview. | 2025-03-01-preview |
| SEARCH_AUTHENTICATION_METHOD | Yes | Authentication method to use: service-principal or api-search-key. |
Capabilities
Server capabilities have not been inspected yet.
Tools
Functions exposed to the LLM to take actions
| Name | Description |
|---|---|
No tools | |
Prompts
Interactive templates invoked by user choice
| Name | Description |
|---|---|
No prompts | |
Resources
Contextual data attached and managed by the client
| Name | Description |
|---|---|
No resources | |