llm-sidecar
Server Configuration
Describes the environment variables required to run the server.
| Name | Required | Description | Default |
|---|---|---|---|
| OLLAMA_HOST | No | Local inference endpoint. | http://localhost:11434 |
| SEARXNG_URL | No | Where to find SearXNG. | http://localhost:8888 |
| LLM_SIDECAR_HOST | No | Daemon bind host. | 127.0.0.1 |
| LLM_SIDECAR_PORT | No | Daemon bind port. | 4001 |
| LLM_SIDECAR_NO_UI | No | Set to disable the dashboard UI. | |
| LLM_SIDECAR_TOKEN | No | Require Authorization: Bearer token for API access. | |
| LLM_SIDECAR_BUDGET | No | Budget level: free, cheap, best. | free |
| OPENROUTER_API_KEY | No | API key for OpenRouter. Unset means local-only. | |
| LLM_SIDECAR_NO_CACHE | No | Set to disable caching. | |
| LLM_SIDECAR_NO_LEDGER | No | Set to disable the usage ledger. | |
| LLM_SIDECAR_MODEL_FAST | No | Lock the fast tier to a specific model. | |
| LLM_SIDECAR_MODEL_BALANCED | No | Lock the balanced tier to a specific model. | |
| LLM_SIDECAR_MODEL_POWERFUL | No | Lock the powerful tier to a specific model. | |
| LLM_SIDECAR_SEARCH_PROVIDER | No | Search provider: auto, ddg, searxng. | auto |
Capabilities
Server capabilities have not been inspected yet.
Tools
Functions exposed to the LLM to take actions
| Name | Description |
|---|---|
No tools | |
Prompts
Interactive templates invoked by user choice
| Name | Description |
|---|---|
No prompts | |
Resources
Contextual data attached and managed by the client
| Name | Description |
|---|---|
No resources | |
Latest Blog Posts
- Who's Calling? MCP Hosts Are an Identity Blind Spot (And the Spec Knows It)By Om-Shree-0709 on .mcpAgent IdentityOAuth 2.1
- Your AI Chatbot Just Exposed Your CEO's Salary to an InternBy Om-Shree-0709 on .Agent IdentityMCP SecurityOAuth Delegation
- Why MCP Servers Need Execution Sandboxing (And Why Your Current Stack Isn't Enough)By Om-Shree-0709 on .Agentic AiPrompt InjectionWebAssembly
MCP directory API
We provide all the information about MCP servers via our MCP API.
curl -X GET 'https://glama.ai/api/mcp/v1/servers/awaistechnologist/llm-sidecar'
If you have feedback or need assistance with the MCP directory API, please join our Discord server