# π§ AEC Outlook MCP - AEC-Specialized AI Email Intelligence
An MCP (Model Context Protocol) server that transforms Outlook email management with **RAG-based semantic search** and **Vision AI for architectural document analysis** - built specifically for Architecture, Engineering & Construction workflows.


[](https://opensource.org/licenses/MIT)
[](https://www.python.org/downloads/)
## π― Built for AEC Professionals
Unlike generic email tools, this is designed for the unique challenges of architectural practice:
### π Semantic Search with RAG
- **ChromaDB vector database** for intelligent email indexing
- **Natural language queries**: "Find emails about the BIM coordination meeting"
- **Attachment content search**: Search inside PDFs, Word docs, Excel files
### ποΈ Multi-Modal Vision AI
- **Claude Vision API** for architectural drawing analysis
- **Gemini Vision API** for technical document processing
- **Specialized prompts** for floor plans, elevations, sections, details
- **OCR fallback** with Tesseract (Korean + English)
### ποΈ AEC-Specific Features
- **Bilingual support**: Korean + English for international projects
- **Technical drawing analysis**: Understands architectural documents
- **RFI/Submittal parsing**: Extract key information from construction docs
- **100% Local processing**: Email data never leaves your machine
## π Features Overview
| Feature | Description |
|---------|-------------|
| **Semantic Search** | Natural language email queries via RAG |
| **Vision AI** | Claude + Gemini for image/PDF analysis |
| **Attachment Parsing** | PDF, Word, Excel, Images |
| **Date/Sender Filters** | Metadata-based search |
| **Folder Navigation** | Access all Outlook folders |
| **Local Processing** | Complete privacy, no cloud upload |
## π οΈ Installation
```bash
git clone https://github.com/dongwoosuk/aec-outlook-mcp.git
cd aec-outlook-mcp
python -m venv .venv
.venv\Scripts\activate # Windows
pip install -e .
```
For OCR support:
```bash
pip install -e ".[ocr]"
```
For Vision AI:
```bash
pip install anthropic google-generativeai
```
## βοΈ Configuration
### Environment Variables (Optional)
```bash
# For Vision AI features
set ANTHROPIC_API_KEY=your_claude_api_key
set GOOGLE_API_KEY=your_gemini_api_key
```
### Claude Desktop Configuration
Add to `claude_desktop_config.json`:
```json
{
"mcpServers": {
"outlook": {
"command": "path/to/aec_outlook_mcp/.venv/Scripts/python.exe",
"args": ["-m", "aec_outlook_mcp"],
"env": {
"PYTHONPATH": "path/to/aec_outlook_mcp"
}
}
}
}
```
## π Available Tools
| Tool | Description |
|------|-------------|
| `email_search` | Natural language semantic search |
| `email_search_by_sender` | Filter by sender |
| `email_search_by_date` | Filter by date range |
| `email_search_attachments` | Search attachment contents |
| `email_index_status` | Check indexing progress |
| `email_index_refresh` | Index new emails |
| `email_get_detail` | Get full email details |
| `email_list_folders` | List Outlook folders |
## π‘ Usage Examples
### In Claude Desktop:
```
"Find emails from the structural engineer about beam calculations"
"Search for RFI responses from last week"
"Find all emails with PDF attachments about the facade design"
"What did the contractor say about the schedule delay?"
```
### Vision AI for Attachments:
```
"Analyze the floor plan attached in John's email"
"What dimensions are shown in this elevation drawing?"
"Extract the specification details from the attached PDF"
```
## ποΈ Architecture
```
aec_outlook_mcp/
βββ aec_outlook_mcp/
β βββ server.py # Main MCP server
β βββ outlook_reader.py # Win32com Outlook integration
β βββ email_indexer.py # ChromaDB RAG indexing
β βββ attachment_parser.py # PDF/Word/Excel/Vision AI
β βββ config.py # Configuration management
β βββ cli.py # Command-line interface
βββ pyproject.toml
```
## π§ Technical Stack
| Component | Technology |
|-----------|------------|
| **Email Access** | win32com (Outlook COM API) |
| **Vector DB** | ChromaDB |
| **Embeddings** | sentence-transformers (all-MiniLM-L6-v2) |
| **PDF Parsing** | PyMuPDF |
| **Word Parsing** | python-docx |
| **Excel Parsing** | openpyxl |
| **OCR** | Tesseract (kor+eng) |
| **Vision AI** | Anthropic Claude, Google Gemini |
## π― Use Cases
### For Project Architects (PA)
- Quickly find client feedback across hundreds of emails
- Search RFI responses and submittal approvals
- Track consultant coordination threads
### For Project Managers (PM)
- Search contract and schedule discussions
- Find meeting notes and action items
- Track change order communications
### For Designers
- Find design review comments
- Search for reference images and inspiration
- Locate specification discussions
### Future: Office-Wide Deployment
- Centralized email intelligence for entire teams
- Shared knowledge base across projects
- AI-powered email analytics and reporting
## β οΈ Requirements
- **Windows** with Outlook Desktop app installed and logged in
- **Python 3.10+**
- Outlook must be running for email access
## π Privacy & Security
- **100% local processing**: Emails are indexed locally in ChromaDB
- **No cloud upload**: Email content never leaves your machine
- **API keys optional**: Vision AI features require API keys, but core search works without them
- **Data location**: `C:\Users\{USERNAME}\Documents\OutlookMCP\`
## π License
MIT License - see [LICENSE](LICENSE) file.
## π Acknowledgments
- Built on the [Model Context Protocol](https://github.com/anthropics/anthropic-cookbook/tree/main/misc/model_context_protocol) by Anthropic
- ChromaDB for vector storage
- sentence-transformers for embeddings
## π¬ Contact
Dongwoo Suk - Computational Design Specialist
- GitHub: [dongwoosuk](https://github.com/dongwoosuk)
- LinkedIn: [dongwoosuk](https://www.linkedin.com/in/dongwoosuk/)