io.github.0xzr/freellmpool
by Sarahl35694
Server Configuration
Describes the environment variables required to run the server.
| Name | Required | Description | Default |
|---|---|---|---|
| GROQ_API_KEY | No | Example provider credential passed to the container as `--env GROQ_API_KEY` to unlock more models and higher limits. Omit it for a credential-free start; the server answers only while an enabled keyless route is available. | |
| FREELLMPOOL_MODE | No | Routing/quota mode, e.g. `wise` for the conservative quota mode (smaller output budget, spread routing, confirmation for broad multi-model calls). Overridden per-command by `--mode normal|wise`. | |
| FREELLMPOOL_ROUTING | No | Routing strategy, e.g. `fast` to prefer the lowest-latency provider instead of the default least-used-first. | |
| FREELLMPOOL_PROXY_KEY | No | Bearer token that clients must present when the proxy port is deliberately exposed beyond loopback. Tailnet/LAN serving requires a real proxy bearer token by default. | |
| FREELLMPOOL_PUBLIC_BADGE | No | Set to `1` to make public badges embeddable and served live at `/badge.svg` and `/summary.svg`. |
Instructions
Guidance the server publishes about itself, which clients place ahead of the tool catalog so the model reads it before choosing anything.
This server publishes no instructions, or was last inspected before Glama recorded them.
Capabilities
Server capabilities have not been inspected yet.
Tools
Functions exposed to the LLM to take actions
| Name | Description |
|---|---|
No tools | |
Prompts
Interactive templates invoked by user choice
| Name | Description |
|---|---|
No prompts | |
Resources
Contextual data attached and managed by the client
| Name | Description |
|---|---|
No resources | |
This server cannot be deployed
Maintenance
ActivityMaintained
ResponsivenessNo issues