io.github.0xzr/freellmpool
by Megan8260
Server Configuration
Describes the environment variables required to run the server.
| Name | Required | Description | Default |
|---|---|---|---|
| GROQ_API_KEY | No | Provider credential for the Groq free tier (shown in the Docker example as `--env GROQ_API_KEY`). Omit it for a credential-free start; the pool can answer only while an enabled keyless route (e.g. Pollinations, OVHcloud, Kilo Gateway, LLM7) is available. | |
| FREELLMPOOL_MODE | No | Conservative quota mode, e.g. FREELLMPOOL_MODE=wise: ask defaults to a smaller output budget and spread routing, tokenmax narrows its default fan-out, and broad multi-model calls require confirmation. Per-command --mode normal|wise overrides the environment, and [settings] mode = "wise" works from config.toml. | |
| FREELLMPOOL_ROUTING | No | Routing preference: 'set FREELLMPOOL_ROUTING=fast to prefer the lowest-latency provider instead of the default least-used-first.' | |
| FREELLMPOOL_PROXY_KEY | No | Bearer token required from clients when the proxy is deliberately exposed beyond loopback: 'If you deliberately expose it, set FREELLMPOOL_PROXY_KEY and require that Bearer token from clients.' | |
| FREELLMPOOL_PUBLIC_BADGE | No | Set FREELLMPOOL_PUBLIC_BADGE=1 to make /badge.svg and /summary.svg public and embeddable; without it those live badge surfaces are not publicly served. |
Instructions
Guidance the server publishes about itself, which clients place ahead of the tool catalog so the model reads it before choosing anything.
This server publishes no instructions, or was last inspected before Glama recorded them.
Capabilities
Server capabilities have not been inspected yet.
Tools
Functions exposed to the LLM to take actions
| Name | Description |
|---|---|
No tools | |
Prompts
Interactive templates invoked by user choice
| Name | Description |
|---|---|
No prompts | |
Resources
Contextual data attached and managed by the client
| Name | Description |
|---|---|
No resources | |
This server cannot be deployed
Maintenance
ActivityActive
ResponsivenessNo issues