Provides containerization for the MCP server and Open WebUI, allowing them to run together in an isolated environment with proper dependency management
Enables running language models locally for AI interactions with complete privacy and control, specifically configured to use the deepseek-r1 model for this application
Local AI with Ollama, WebUI & MCP on Windows
A self-hosted AI stack combining Ollama for running language models, Open WebUI for user-friendly chat interaction, and MCP for centralized model management—offering full control, privacy, and flexibility without relying on the cloud.
This sample project provides an MCP-based tool server for managing employee leave balance, applications, and history. It is exposed via OpenAPI using mcpo
for easy integration with Open WebUI or other OpenAPI-compatible clients.
🚀 Features
- ✅ Check employee leave balance
- 📆 Apply for leave on specific dates
- 📜 View leave history
- 🙋 Personalized greeting functionality
📁 Project Structure
📋 Prerequisites
- Windows 10 or later (required for Ollama)
- Docker Desktop for Windows (required for Open WebUI and MCP)
- Install from: Docker Desktop for Windows
🛠️ Workflow
- Install Ollama on Windows
- Pull the
deepseek-r1
model - Clone the repository and navigate to the project directory
- Run the
docker-compose.yml
file to launch services
Install Ollama
➤ Windows
- Download the Installer:
- Visit Ollama Download and click Download for Windows to get
OllamaSetup.exe
. - Alternatively, download from Ollama GitHub Releases.
- Visit Ollama Download and click Download for Windows to get
- Run the Installer:
- Execute
OllamaSetup.exe
and follow the installation prompts. - After installation, Ollama runs as a background service, accessible at: http://localhost:11434.
- Verify in your browser; you should see:
- Execute
- Start Ollama Server (if not already running):
- Access the server at: http://localhost:11434.
Verify Installation
Check the installed version of Ollama:
Expected Output:
Pull the deepseek-r1
Model
1. Pull the Default Model (7B):
Using PoweShell
To Pull Specific Versions:
2. List Installed Models:
Expected:
Expected Output:
4. Alternative Check via API:
Expected Output:
A JSON response listing installed models, including deepseek-r1:latest
.
4. Test the API via PowerShell:
Expected Response: A JSON object containing the model's response to the "Hello, world!" prompt.
5. Run and Chat the Model via PowerShell:
- This opens an interactive chat session with the
deepseek-r1
model. - Type
/bye
and pressEnter
to exit the chat session.
🐳 Run Open WebUI and MCP Server with Docker Compose
- Clone the Repository:
- To launch both the MCP tool and Open WebUI locally (on Docker Desktop):
This will:
- Start the Leave Manager (MCP Server) tool on port
8000
- Launch Open WebUI at http://localhost:3000
🌐 Add MCP Tools to Open WebUI
The MCP tools are exposed via the OpenAPI specification at: http://localhost:8000/openapi.json.
- Open http://localhost:3000 in your browser.
- Click the Profile Icon and navigate to Settings.
- Select the Tools menu and click the Add (+) Button.
- Add a new tool by entering the URL: http://localhost:8000/.
💬 Example Prompts
Use these prompts in Open WebUI to interact with the Leave Manager tool:
- Check Leave Balance:
- Apply for Leave:
- View Leave History:
- Personalized Greeting:
🛠️ Troubleshooting
- Ollama not running: Ensure the service is active (
ollama serve
) and check http://localhost:11434. - Docker issues: Verify Docker Desktop is running and you have sufficient disk space.
- Model not found: Confirm the
deepseek-r1
model is listed withollama list
. - Port conflicts: Ensure ports
11434
,3000
, and8000
are free.
📚 Additional Resources
This server cannot be installed
A centralized employee leave management system that allows users to check leave balances, apply for leave, and view leave history through an OpenAPI interface.
Related MCP Servers
- -securityFlicense-qualityA server that implements a checklist management system with features like task creation, progress tracking, data persistence, and item comments.Last updated -53TypeScript
- AsecurityAlicenseAqualityProvides API access to a locally-hosted task management system with features for creating, updating, and organizing tasks, including support for urgency levels, effort estimates, subtasks, and bi-directional sync with Obsidian markdown files.Last updated -123PythonMIT License
- -securityAlicense-qualityA lightweight, modular API service that provides useful tools like weather, date/time, calculator, search, email, and task management through a RESTful interface, designed for integration with AI agents and automated workflows.Last updated -PythonMIT License
- AsecurityAlicenseAqualityA server that exposes PagerDuty API functionality to LLMs with structured inputs and outputs, enabling management of incidents, services, teams, and users.Last updated -14PythonMIT License