local-llm
by pakkio
Server Configuration
Describes the environment variables required to run the server.
| Name | Required | Description | Default |
|---|---|---|---|
| LOCAL_LLM_NGL | No | GPU layers to offload. Default: 99 | 99 |
| LOCAL_LLM_MODEL | No | Initial active model: e2b or e4b (or aliases gemma-4-e2b/gemma-4-e4b). Default: e2b | e2b |
| LOCAL_LLM_CTX_SIZE | No | Context size passed to llama-cli. Default: 8192 | 8192 |
| LOCAL_LLM_PROJECT_DIR | No | Path to the local_llm project directory (models/binaries live here). Default: /home/pakkio/w/local_llm | /home/pakkio/w/local_llm |
Capabilities
Server capabilities have not been inspected yet.
Tools
Functions exposed to the LLM to take actions
| Name | Description |
|---|---|
No tools | |
Prompts
Interactive templates invoked by user choice
| Name | Description |
|---|---|
No prompts | |
Resources
Contextual data attached and managed by the client
| Name | Description |
|---|---|
No resources | |
Latest Blog Posts
- Who's Calling? MCP Hosts Are an Identity Blind Spot (And the Spec Knows It)By Om-Shree-0709 on .mcpAgent IdentityOAuth 2.1
- Your AI Chatbot Just Exposed Your CEO's Salary to an InternBy Om-Shree-0709 on .Agent IdentityMCP SecurityOAuth Delegation
- Why MCP Servers Need Execution Sandboxing (And Why Your Current Stack Isn't Enough)By Om-Shree-0709 on .Agentic AiPrompt InjectionWebAssembly
MCP directory API
We provide all the information about MCP servers via our MCP API.
curl -X GET 'https://glama.ai/api/mcp/v1/servers/pakkio/mcp-local_llm'
If you have feedback or need assistance with the MCP directory API, please join our Discord server