io.github.0xzr/freellmpool
by kerstinc7303
Server Configuration
Describes the environment variables required to run the server.
| Name | Required | Description | Default |
|---|---|---|---|
| GROQ_API_KEY | No | Example provider API key (Groq). Provider keys are optional: omit them to start credential-free, in which case the pool can answer only while an enabled keyless route (e.g. Pollinations, OVHcloud, Kilo Gateway, LLM7) is available. Add keys for other providers to unlock more models and higher limits. | |
| FREELLMPOOL_MODE | No | Conservative quota mode, e.g. FREELLMPOOL_MODE=wise: ask defaults to a smaller output budget and spread routing, tokenmax narrows its default fan-out, and broad multi-model calls require confirmation. Per-command --mode normal|wise overrides this. | |
| FREELLMPOOL_ROUTING | No | Routing strategy for the pool. Set to "fast" to prefer the lowest-latency provider instead of the default least-used-first behavior. | |
| FREELLMPOOL_PROXY_KEY | No | Bearer token required from clients of the local proxy. On loopback, any placeholder API key works unless this is configured; Tailnet/LAN serving requires a real proxy bearer token by default. | |
| FREELLMPOOL_PUBLIC_BADGE | No | Set to 1 to make the proxy serve /badge.svg and /summary.svg publicly so badges are embeddable. |
Instructions
Guidance the server publishes about itself, which clients place ahead of the tool catalog so the model reads it before choosing anything.
This server publishes no instructions, or was last inspected before Glama recorded them.
Capabilities
Server capabilities have not been inspected yet.
Tools
Functions exposed to the LLM to take actions
| Name | Description |
|---|---|
No tools | |
Prompts
Interactive templates invoked by user choice
| Name | Description |
|---|---|
No prompts | |
Resources
Contextual data attached and managed by the client
| Name | Description |
|---|---|
No resources | |
This server cannot be deployed
Maintenance
ActivityActive
ResponsivenessNo issues