LibreModel MCP Server
Click on "Deploy Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@LibreModel MCP Server chat with temperature 0.7: explain quantum computing basics"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
LibreModel MCP Server ๐ค
A Model Context Protocol (MCP) server that bridges Claude Desktop with your local LLM instance running via llama-server.
Features
๐ฌ Full conversation support with Local Model through Claude Desktop
๐๏ธ Complete parameter control (temperature, max_tokens, top_p, top_k)
โ Health monitoring and server status checks
๐งช Built-in testing tools for different capabilities
๐ Performance metrics and token usage tracking
๐ง Easy configuration via environment variables
Related MCP server: Llama 4 Maverick MCP Server
Quick Start
npm install @openconstruct/llama-mcp-serverA Model Context Protocol (MCP) server that bridges Claude Desktop with your local LLM instance running via llama-server.
Features
๐ฌ Full conversation support with LibreModel through Claude Desktop
๐๏ธ Complete parameter control (temperature, max_tokens, top_p, top_k)
โ Health monitoring and server status checks
๐งช Built-in testing tools for different capabilities
๐ Performance metrics and token usage tracking
๐ง Easy configuration via environment variables
Quick Start
1. Install Dependencies
cd llama-mcp
npm install2. Build the Server
npm run build3. Start Your LibreModel
Make sure llama-server is running with your model:
./llama-server -m lm37.gguf -c 2048 --port 80804. Configure Claude Desktop
Add this to your Claude Desktop configuration (~/.config/claude/claude_desktop_config.json):
{
"mcpServers": {
"libremodel": {
"command": "node",
"args": ["/home/jerr/llama-mcp/dist/index.js"]
}
}
}5. Restart Claude Desktop
Claude will now have access to LibreModel through MCP!
Usage
Once configured, you can use these tools in Claude Desktop:
๐ฌ chat - Main conversation tool
Use the chat tool to ask LibreModel: "What is your name and what can you do?"๐งช quick_test - Test LibreModel capabilities
Run a quick_test with type "creative" to see if LibreModel can write poetry๐ฅ health_check - Monitor server status
Use health_check to see if LibreModel is running properlyConfiguration
Set environment variables to customize behavior:
export LLAMA_SERVER_URL="http://localhost:8080" # Default llama-server URLAvailable Tools
Tool | Description | Parameters |
| Converse with MOdel |
|
| Run predefined capability tests |
|
| Check server health and status | None |
Resources
Configuration: View current server settings
Instructions: Detailed usage guide and setup instructions
Development
# Install dependencies
npm install # LibreModel MCP Server ๐ค
A Model Context Protocol (MCP) server that bridges Claude Desktop with your local LLM instance running via llama-server.
## Features
- ๐ฌ **Full conversation support** with LibreModel through Claude Desktop
- ๐๏ธ **Complete parameter control** (temperature, max_tokens, top_p, top_k)
- โ
**Health monitoring** and server status checks
- ๐งช **Built-in testing tools** for different capabilities
- ๐ **Performance metrics** and token usage tracking
- ๐ง **Easy configuration** via environment variables
## Quick Start
### 1. Install Dependencies
```bash
cd llama-mcp
npm install2. Build the Server
npm run build3. Start Your LibreModel
Make sure llama-server is running with your model:
./llama-server -m lm37.gguf -c 2048 --port 80804. Configure Claude Desktop
Add this to your Claude Desktop configuration (~/.config/claude/claude_desktop_config.json):
{
"mcpServers": {
"libremodel": {
"command": "node",
"args": ["/home/jerr/llama-mcp/dist/index.js"]
}
}
}5. Restart Claude Desktop
Claude will now have access to LibreModel through MCP!
Usage
Once configured, you can use these tools in Claude Desktop:
๐ฌ chat - Main conversation tool
Use the chat tool to ask LibreModel: "What is your name and what can you do?"๐งช quick_test - Test LibreModel capabilities
Run a quick_test with type "creative" to see if LibreModel can write poetry๐ฅ health_check - Monitor server status
Use health_check to see if LibreModel is running properlyConfiguration
Set environment variables to customize behavior:
export LLAMA_SERVER_URL="http://localhost:8080" # Default llama-server URLAvailable Tools
Tool | Description | Parameters |
| Converse with MOdel |
|
| Run predefined capability tests |
|
| Check server health and status | None |
Resources
Configuration: View current server settings
Instructions: Detailed usage guide and setup instructions
Development
# Install dependencies
npm install openconstruct/llama-mcp-server
# Development mode (auto-rebuild)
npm run dev
# Build for production
npm run build
# Start the server directly
npm startArchitecture
Claude Desktop โโ LLama MCP Server โโ llama-server API โโ Local ModelThe MCP server acts as a bridge, translating MCP protocol messages into llama-server API calls and formatting responses for Claude Desktop.
Troubleshooting
"Cannot reach LLama server"
Ensure llama-server is running on the configured port
Check that the model is loaded and responding
Verify firewall/network settings
"Tool not found in Claude Desktop"
Restart Claude Desktop after configuration changes
Check that the path to
index.jsis correct and absoluteVerify the MCP server builds without errors
Poor response quality
Adjust temperature and sampling parameters
Try different system prompts
License
CC0-1.0 - Public Domain. Use freely!
Built with โค๏ธ for open-source AI and the LibreModel project. by Claude Sonnet4
Development mode (auto-rebuild)
npm run dev
Build for production
npm run build
Start the server directly
npm start
## Architecture
Claude Desktop โโ LLama MCP Server โโ llama-server API โโ Local Model
The MCP server acts as a bridge, translating MCP protocol messages into llama-server API calls and formatting responses for Claude Desktop.
## Troubleshooting
**"Cannot reach LLama server"**
- Ensure llama-server is running on the configured port
- Check that the model is loaded and responding
- Verify firewall/network settings
**"Tool not found in Claude Desktop"**
- Restart Claude Desktop after configuration changes
- Check that the path to `index.js` is correct and absolute
- Verify the MCP server builds without errors
**Poor response quality**
- Adjust temperature and sampling parameters
- Try different system prompts
## License
CC0-1.0 - Public Domain. Use freely!
---
Built with โค๏ธ for open-source AI and the LibreModel project. by Claude Sonnet4
### 1. Install Dependencies
```bash
cd llama-mcp
npm install2. Build the Server
npm run build3. Start Your LibreModel
Make sure llama-server is running with your model:
./llama-server -m lm37.gguf -c 2048 --port 80804. Configure Claude Desktop
Add this to your Claude Desktop configuration (~/.config/claude/claude_desktop_config.json):
{
"mcpServers": {
"libremodel": {
"command": "node",
"args": ["/home/jerr/llama-mcp/dist/index.js"]
}
}
}5. Restart Claude Desktop
Claude will now have access to LibreModel through MCP!
Usage
Once configured, you can use these tools in Claude Desktop:
๐ฌ chat - Main conversation tool
Use the chat tool to ask LibreModel: "What is your name and what can you do?"๐งช quick_test - Test LibreModel capabilities
Run a quick_test with type "creative" to see if LibreModel can write poetry๐ฅ health_check - Monitor server status
Use health_check to see if LibreModel is running properlyConfiguration
Set environment variables to customize behavior:
export LLAMA_SERVER_URL="http://localhost:8080" # Default llama-server URLAvailable Tools
Tool | Description | Parameters |
| Converse with MOdel |
|
| Run predefined capability tests |
|
| Check server health and status | None |
Resources
Configuration: View current server settings
Instructions: Detailed usage guide and setup instructions
Development
# Install dependencies
npm install
# Development mode (auto-rebuild)
npm run dev
# Build for production
npm run build
# Start the server directly
npm startArchitecture
Claude Desktop โโ LLama MCP Server โโ llama-server API โโ Local ModelThe MCP server acts as a bridge, translating MCP protocol messages into llama-server API calls and formatting responses for Claude Desktop.
Troubleshooting
"Cannot reach LLama server"
Ensure llama-server is running on the configured port
Check that the model is loaded and responding
Verify firewall/network settings
"Tool not found in Claude Desktop"
Restart Claude Desktop after configuration changes
Check that the path to
index.jsis correct and absoluteVerify the MCP server builds without errors
Poor response quality
Adjust temperature and sampling parameters
Try different system prompts
License
CC0-1.0 - Public Domain. Use freely!
Built with โค๏ธ for open-source AI and the LibreModel project. by Claude Sonnet4
Available Tools
3 toolschatChat with LibreModelC
Have a conversation with LibreModel (Gigi)
Inputs: message (required), temperature, max_tokens, top_p, +2 more.
health_checkCheck LibreModel Server HealthB
Check if the llama-server is running and responsive
Inputs: no named parameters.
quick_testQuick LibreModel TestB
Run a quick test to see if LibreModel is responding
Inputs: test_type.
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
Loading tool schema changelogโฆ
TDQS
Scored across 3 tools
The tools have overlapping purposes that could cause confusion. 'chat' and 'quick_test' both involve interacting with LibreModel to check responsiveness, making them ambiguous. 'health_check' is more distinct but still overlaps in verifying server status.
The naming follows a consistent snake_case pattern across all tools, which is clear and readable. However, the verb styles are mixed ('chat' is a noun-like verb, 'health_check' and 'quick_test' are noun-based), slightly reducing consistency.
With only 3 tools, the set feels thin for a model server, lacking essential operations like model loading, configuration, or inference control. This minimal count suggests an incomplete surface for the domain.
The tool set is severely incomplete for a model server. There are no tools for core functions such as loading models, managing sessions, adjusting parameters, or handling inputs/outputs beyond basic chat and health checks, leaving significant gaps.
Maintenance
Related MCP Connectors
Talk to your public-facing AI from any MCP client โ Claude, ChatGPT, Cursor, Cline, Windsurf.
WHOOP recovery, strain, sleep and workouts in Claude via official WHOOP OAuth. Free, open source.
Connect ChatGPT and Claude to your Mac, Windows or Linux with secure MCP remote access.
Use your Mac, Windows or Linux computer from ChatGPT, Claude or Codex: files, commands, documents.
Related MCP Servers
- AlicenseNot gradedqualityBmaintenanceA bridge that allows Claude to communicate with locally running LLM models via LM Studio, enabling users to leverage their private models through Claude's interface.173MIT
- AlicenseNot gradedqualityDmaintenanceBridges Llama models with Claude Desktop through Ollama, enabling privacy-first local AI operations with 10+ built-in tools for file operations, web search, calculations, and custom model deployment. Features streaming support, hybrid intelligence workflows, and extensive Python ecosystem integration for research, development, and enterprise applications.MIT
- AlicenseAqualityDmaintenanceA bridge that enables Claude Code to interact with local Ollama instances for text generation, multi-turn chat, and vision-based analysis. It supports model management tasks such as listing, pulling, and showing details, alongside generating text embeddings.61MIT
- AlicenseAqualityBmaintenanceBridges Claude Code and Claude Desktop to a locally-running LLM, optimized for MLX LM on Apple Silicon with support for any OpenAI-compatible backend.419 PyPI1MIT