Skip to main content
Glama

Server Configuration

Describes the environment variables required to run the server.

NameRequiredDescriptionDefault
GROQ_MODELNoModel for triage and Q&A when using Groq.openai/gpt-oss-20b
OLLAMA_URLNoURL of the local Ollama server when LLM_PROVIDER=ollama.
MAX_TICKETSNoCap on queue size.600
GROQ_API_KEYNoAPI key for the default Groq provider.
LLM_PROVIDERNoLLM provider: groq (default) or ollama for a local model.groq
OLLAMA_MODELNoOllama model name when LLM_PROVIDER=ollama.
TICKETS_PATHNoPath to the tickets JSON file.data/tickets.json
VECTOR_STORENoVector store: numpy to skip FAISS, otherwise auto.auto
EMBEDDING_MODELNofastembed model name.BAAI/bge-small-en-v1.5
EMBEDDING_BACKENDNoEmbedding backend: fastembed, hashing or auto.auto
RATE_LIMIT_PER_MINNoPer-client rate limit on endpoints that write or call the LLM.10
DUPLICATE_THRESHOLDNoSimilarity threshold for duplicate detection; tune per embedder.
RATE_LIMIT_GLOBAL_PER_MINNoOverall rate limit on endpoints that write or call the LLM.60

Instructions

Guidance the server publishes about itself, which clients place ahead of the tool catalog so the model reads it before choosing anything.

This server publishes no instructions, or was last inspected before Glama recorded them.

Capabilities

Server capabilities have not been inspected yet.

Tools

Functions exposed to the LLM to take actions

NameDescription

No tools

Prompts

Interactive templates invoked by user choice

NameDescription

No prompts

Resources

Contextual data attached and managed by the client

NameDescription

No resources