io.github.0xzr/freellmpool
by yuqik88779
Server Configuration
Describes the environment variables required to run the server.
| Name | Required | Description | Default |
|---|---|---|---|
| GROQ_API_KEY | No | Example provider credential; provider API keys (e.g. GROQ_API_KEY) unlock more models and higher limits. The server can start without credentials when an enabled keyless route is available. | |
| FREELLMPOOL_MODE | No | Conservative quota mode, e.g. FREELLMPOOL_MODE=wise makes ask default to a smaller output budget and spread routing, narrows tokenmax fan-out, and requires confirmation for broad multi-model calls. | |
| FREELLMPOOL_ROUTING | No | Routing strategy, e.g. FREELLMPOOL_ROUTING=fast prefers the lowest-latency provider instead of the default least-used-first. | |
| FREELLMPOOL_PROXY_KEY | No | Proxy bearer token. On loopback any placeholder API key works unless this is set; when deliberately exposing the proxy beyond loopback, set FREELLMPOOL_PROXY_KEY and require that Bearer token from clients. | |
| FREELLMPOOL_PUBLIC_BADGE | No | Set to 1 to let the proxy serve /badge.svg and /summary.svg live so public badges are embeddable. |
Instructions
Guidance the server publishes about itself, which clients place ahead of the tool catalog so the model reads it before choosing anything.
This server publishes no instructions, or was last inspected before Glama recorded them.
Capabilities
Server capabilities have not been inspected yet.
Tools
Functions exposed to the LLM to take actions
| Name | Description |
|---|---|
No tools | |
Prompts
Interactive templates invoked by user choice
| Name | Description |
|---|---|
No prompts | |
Resources
Contextual data attached and managed by the client
| Name | Description |
|---|---|
No resources | |
This server cannot be deployed
Maintenance
ActivityActive
ResponsivenessResponsive