PromptLab MCP Server

PromptLab: AI Query Enhancement with MLflow Integration

PromptLab is an intelligent system that transforms basic user queries into optimized prompts for AI systems using MLflow Prompt Registry. It dynamically matches user requests to the most appropriate prompt template and applies it with extracted parameters.

🔍 Overview

PromptLab combines MLflow Prompt Registry with dynamic prompt matching to create a powerful, flexible system for prompt engineering:

• Centralized Prompt Management: Store, version, and manage prompts in MLflow
• Dynamic Matching: Intelligently match user queries to the best prompt template
• Version Control: Track prompt history with production and archive aliases
• Extensible: Easily add new prompt types without code changes

🏗️ Architecture

The system consists of three main components:

1. Prompt Registry (register_prompts.py) - Tool for registering and managing prompts in MLflow
2. Server (promptlab_server.py) - Server with dynamic prompt matching and LangGraph workflow
3. Client (promptlab_client.py) - Lightweight client for processing user queries

Workflow Process

1. Prompt Registration: Register prompt templates in MLflow with versioning and aliasing
2. Prompt Loading: Server loads all available prompts from MLflow at startup
3. Query Submission: User submits a natural language query via the client
4. Intelligent Matching: LLM analyzes the query and selects the most appropriate prompt template
5. Parameter Extraction: System extracts required parameters from the query
6. Template Application: Selected template is applied with extracted parameters
7. Validation & Adjustment: Enhanced prompt is validated and adjusted if needed
8. Response Generation: Optimized prompt produces a high-quality response

📂 Code Structure

Core Components:

register_prompts.py

• Purpose: Manages prompts in MLflow Registry
• Key Functions:
  • register_prompt(): Register a new prompt or version
  • update_prompt(): Update an existing prompt (archives previous production)
  • list_prompts(): List all registered prompts
  • register_from_file(): Register multiple prompts from JSON
  • register_sample_prompts(): Initialize with standard prompts

promptlab_server.py

• Purpose: Processes queries using LangGraph workflow
• Key Components:
  • load_all_prompts(): Loads prompts from MLflow
  • match_prompt(): Matches queries to appropriate templates
  • enhance_query(): Applies selected template
  • validate_query(): Validates enhanced queries
  • LangGraph workflow: Orchestrates the query enhancement process

promptlab_client.py

• Purpose: Provides user interface to the service
• Key Features:
  • Process queries with enhanced prompts
  • List available prompts
  • Display detailed prompt matching information

🚀 Getting Started

Prerequisites

• Python 3.12
• Dependencies in requirements.txt
• OpenAI API key for LLM capabilities

Installation

Registering Prompts

Before using PromptLab, you need to register prompts in MLflow:

Running the Server

Using the Client

📋 Prompt Management

Available Prompt Types

PromptLab supports a wide range of prompt types:

Registering New Prompts

You can register new prompts in several ways:

1. From Command Line

2. From a Template File

3. From a JSON File

Create a JSON file with multiple prompts:

Then register them:

Updating Existing Prompts

When you update an existing prompt, the system automatically:

1. Archives the previous production version
2. Sets the new version as production

Viewing Prompt Details

🛠️ Advanced Usage

Template Variables

Templates use variables in {{ variable }} format:

When matching a query, the system automatically extracts values for these variables.

Production and Archive Aliases

Each prompt can have different versions with aliases:

• production: The current active version (used by default)
• archived: Previous production versions

This allows for:

• Rolling back to previous versions if needed
• Tracking the history of prompt changes

Custom Prompt Registration

For specialized use cases, you can create highly customized prompts:

🔧 Troubleshooting

No Matching Prompt Found

If the system can't match a query to any prompt template, it will:

1. Log a message that no match was found
2. Use the original query without enhancement
3. Still generate a response

You can add more diverse prompt templates to improve matching.

LLM Connection Issues

If the LLM service is unavailable, the system falls back to:

1. Keyword-based matching for prompt selection
2. Simple parameter extraction
3. Basic prompt enhancement

This ensures the system remains functional even without LLM access.