AI Engineering Assistant (MCP Server)

An AI ops assistant that answers questions about backend job failures by calling real tools over MCP (Model Context Protocol). The LLM (via Groq) never guesses -- it calls MCP tools backed by a SQLite jobs table to get real data, then summarizes.

User -> FastAPI /chat -> LangGraph agent (Groq LLM) -> MCP tools -> SQLite

Structure

app/
  db/       SQLAlchemy models + seed data (Job table)
  mcp/      MCP server exposing job-ops tools (get_failed_jobs, search_jobs, ...)
  agent/    LangGraph ReAct agent wired to Groq + MCP tools
  api/      FastAPI routes (/chat, /health)
main.py     FastAPI entrypoint

Related MCP server: Data Agent Connector

Setup

python -m venv .venv
.venv\Scripts\activate          # Windows
pip install -r requirements.txt

copy .env.example .env
# edit .env and set GROQ_API_KEY

python -m app.db.seed           # creates + seeds app/db/ops.db

Run (two processes)

Terminal 1 -- MCP server (tools + SQLite):

python -m app.mcp.server

Terminal 2 -- FastAPI app (agent + chat endpoint):

uvicorn main:app --reload --port 8000

Try it

curl -X POST http://localhost:8000/chat \
  -H "Content-Type: application/json" \
  -d "{\"message\": \"What jobs failed recently and why?\"}"

The agent will call get_failed_jobs (and possibly get_job_by_id / search_jobs) via MCP, then summarize the real failures from SQLite.

Roadmap

• Tool permission tiers (read / write / dangerous) with human-in-the-loop approval

• Docker / monitoring / GitHub MCP tool servers

• Auth (API key or JWT) on the FastAPI layer

• Streaming responses

• Docker Compose for MCP server + API + Postgres