Uses Azure OpenAI for intelligent SQL generation, intent classification, and business response enhancement with caching optimization for repeated queries
fabric-mcp-agent
🆕 Enhanced MVP with Multi-Stage Intelligence - A complete two-layer system combining an MCP-compliant server with advanced multi-stage agentic AI reasoning for Microsoft Fabric Data Warehouse access.
🎯 MVP Status: ENHANCED ✅
🆕 Major Update: Now features intelligent multi-stage execution with discovery → analysis → evaluation workflows for complex business intelligence queries.
🔷 Architecture Overview
Layer 1: Fabric DW MCP Server
Standards-compliant MCP server with 4 complete tools providing clean abstractions over Fabric Data Warehouse operations with full Azure AD authentication.
Layer 2: 🆕 Multi-Stage Agentic Reasoning Engine
Advanced intelligent system with 3 execution strategies:
- Single-Stage: Simple queries → Standard tool chain
- 🆕 Multi-Stage: Complex queries → Discovery → Analysis → Evaluation
- 🆕 Iterative: Advanced queries → Refinement loops (future)
🆕 Separation of Concerns Architecture:
- Intent Templates: Domain-agnostic execution patterns (
agentic_layer/prompts/intent/
) - Persona Modules: Business domain expertise (
agentic_layer/prompts/personas/
) - Runtime Integration: Dynamic combination for context-aware execution
🚀 Production Features
✅ Complete MCP Tools
run_sql_query
: Execute SQL from natural language questions or direct SQL with full error handlingget_metadata
: Retrieve comprehensive table schemas, sample data, and relationshipssummarize_results
: Generate business-friendly summaries with actionable insightsgenerate_visualization
: Create formatted data tables and chart configurations
✅ 🆕 Advanced Multi-Stage Intelligence
- Intelligent Execution Strategy: Automatic selection between single-stage and multi-stage workflows
- 🆕 3-Stage Discovery Process: Discovery → Analysis → Evaluation with AI-driven transitions
- 🆕 Domain-Agnostic Templates: Reusable execution patterns that work across all business domains
- 🆕 Persona-Driven Context: Business expertise modules for domain-specific knowledge
- 🆕 Pure Business Analysis: Stage 3 provides structured insights without SQL execution
- Enhanced JSON Parsing: Robust handling of complex business responses with intelligent fallbacks
- Azure OpenAI Caching: Automatic response optimization for repeated queries
✅ Enterprise Features
- 🆕 Token Usage Optimization: Data compression reducing token usage by 50-80%
- 🆕 Session-Based Logging: Complete session traces in
logs/sessions/
for easy debugging - Performance Monitoring: Real-time cost tracking and compression statistics
- Error Tracking: Full error context with automated recovery mechanisms
- Security: Azure AD authentication with read-only database access
🔄 🆕 Multi-Stage Execution Flow
Enhanced intelligent query processing with adaptive execution strategies:
Single-Stage Flow (Simple Queries)
🆕 Multi-Stage Flow (Complex Queries)
🆕 Key Innovation: Domain-agnostic templates + business personas = context-aware execution
📋 API Endpoints
MCP Standard Endpoints
GET /list_tools
- Returns all available MCP tools with schemasPOST /call_tool
- Execute specific MCP tool with arguments
Agentic Intelligence Endpoint
POST /mcp
- Full agentic reasoning with intent classification and tool chaining
🧪 Quick Start & Testing
1. Start the Server
(Ensure .env
is configured with Azure credentials)
2. Test MCP Tools Discovery
3. Test Individual MCP Tools
4. 🆕 Test Multi-Stage Intelligence (Recommended)
5. 🆕 Session Debugging & Monitoring
6. Access the Web UI
🎯 🆕 Enhanced Response Examples
Single-Stage Response (Simple Query)
🆕 Multi-Stage Response (Complex Query)
🌐 🆕 Enhanced Production Web UI
- 🆕 Multi-Stage Result Rendering: Structured business analysis display with confidence indicators
- 🆕 Business Analysis Section: Clear presentation of Stage 3 evaluation with findings and recommendations
- 🆕 Progressive Disclosure: Primary insights first, detailed data on demand
- 🆕 Smart Result Detection: Automatic detection of single-stage vs multi-stage responses
- Enhanced Data Tables: Interactive SQL results with sortable columns and hover effects
- Prompt Management: Live editing of persona modules with automatic backup
- Real-time Testing: All execution strategies accessible through responsive interface
- Quick Test Buttons: Pre-built queries for both simple and complex business scenarios
Configuration
The server requires the following environment variables in a .env
file located in the project root:
Variable | Description |
---|---|
FABRIC_SQL_SERVER | Fully qualified Fabric Data Warehouse server hostname |
FABRIC_SQL_DATABASE | Target database name in Fabric |
AZURE_CLIENT_ID | Azure Service Principal client ID (for AAD authentication) |
AZURE_CLIENT_SECRET | Azure Service Principal secret |
AZURE_TENANT_ID | Azure tenant (directory) ID |
AZURE_OPENAI_KEY | API key for your Azure OpenAI deployment |
AZURE_OPENAI_ENDPOINT | Endpoint URL for Azure OpenAI (e.g., https://xxxx.openai.azure.com) |
AZURE_OPENAI_DEPLOYMENT | Deployment name (e.g., "gpt-4o") |
Sample .env
📊 🆕 Enhanced Performance Monitoring
🆕 Multi-Stage Performance Analysis
Current Baseline: 40.7s total execution time
Stage | Duration | Operations | Optimization Target |
---|---|---|---|
Intent Classification | 3.4s (8.3%) | LLM routing | Caching patterns |
Stage 1: Discovery | 14.4s (35.4%) | SQL generation + execution | 50%+ reduction |
Stage 2: Analysis | 15.7s (38.5%) | SQL generation + execution | 50%+ reduction |
Stage 3: Evaluation | 7.1s (17.4%) | Pure LLM analysis | Prompt optimization |
Real-time Dashboard
🆕 Enhanced Metrics Output
🚀 🆕 Enhanced Production Deployment
This enhanced MVP is ready for production deployment with:
- ✅ 🆕 Multi-stage intelligent execution with adaptive strategy selection
- ✅ 🆕 Structured business analysis with confidence indicators and recommendations
- ✅ 🆕 Domain-agnostic architecture for rapid business domain expansion
- ✅ 🆕 Enhanced UI rendering with progressive disclosure and business insights
- ✅ Full error handling and recovery with intelligent JSON parsing fallbacks
- ✅ Comprehensive logging and monitoring with stage-level performance analytics
- ✅ Performance optimization with AI caching and clear optimization roadmap
- ✅ Security best practices implemented
- ✅ Scalable architecture for extension
📚 🆕 Comprehensive Documentation
- DESIGN_ARCHITECTURE.md - Complete system architecture with multi-stage workflow details
- CLAUDE.md - Development guide with enhanced testing commands and prompt structure
- agentic_layer/prompts/intent/README.md - Intent template framework documentation
- UI_DOCUMENTATION.md - Enhanced web interface with multi-stage result rendering
- API_RESPONSE_EXAMPLES.md - Complete API response examples for all execution strategies
- PERFORMANCE_OPTIMIZATION.md - Detailed optimization roadmap with specific targets and implementation phases
🎯 Ready for Enterprise: Complete documentation, performance analysis, and optimization roadmap for production scaling.
This server cannot be installed
hybrid server
The server is able to function both locally and remotely, depending on the configuration or use case.
Enables natural language querying of Microsoft Fabric Data Warehouses with intelligent SQL generation, metadata exploration, and business-friendly result summarization. Features two-layer architecture with MCP-compliant server and agentic AI reasoning for production-ready enterprise data access.
- 🎯 MVP Status: ENHANCED ✅
- 🔷 Architecture Overview
- 🚀 Production Features
- 🔄 🆕 Multi-Stage Execution Flow
- 📋 API Endpoints
- 🧪 Quick Start & Testing
- 🎯 🆕 Enhanced Response Examples
- 🌐 🆕 Enhanced Production Web UI
- Configuration
- 📊 🆕 Enhanced Performance Monitoring
- 🚀 🆕 Enhanced Production Deployment
- 📚 🆕 Comprehensive Documentation
Related MCP Servers
- AsecurityFlicenseAqualityEnables interaction with the Metal Framework by providing documentation search and code generation capabilities using natural language queries.Last updated -22
- -securityAlicense-qualityFacilitates interaction with Microsoft SQL Server Express, supporting database operations such as querying, table management, and schema inspection via natural language MCP commands.Last updated -4MIT License
- -securityFlicense-qualityA FastMCP server that provides natural language interaction with MS SQL databases, enabling users to query data, list tables, describe structures, and execute database operations through a conversational AI interface.Last updated -
- -securityFlicense-qualityA Python-based MCP server that enables interaction with Microsoft Fabric APIs for managing workspaces, lakehouses, warehouses, and tables through natural language.Last updated -11