🧠 Screen Memory MCP

Give Claude a perfect memory of everything that's ever been on your screen.

"What was I researching on ChatGPT an hour ago?" "What code did I write this morning?" "Walk me through what I did in the last 30 minutes."

Just ask Claude. It remembers.

How it works

Every N seconds:
  📸 Screenshot  →  🔤 Windows OCR  →  🧬 Embed  →  💾 SQLite
                    (built-in, accurate,  (local model,   (text only,
                     no hallucination)    no API calls)    ~5KB/capture)

100% local. No images stored. No cloud. No API costs.

Features

• Semantic search — "find when I was reading about X" across your entire screen history

• Activity timeline — connected narrative of what you did and why, not just isolated snapshots

• Code tracking — detects VS Code / PyCharm, tracks which files you edited, computes diffs between captures

• App awareness — knows if you were in a browser, editor, or terminal and tags captures accordingly

• Tiny footprint — text + embeddings only, ~5KB per capture, ~30MB/day at 10s interval

Requirements

• Windows 10 / 11

• Python 3.11+

• No Tesseract. No cloud APIs. No external accounts.

Installation

git clone https://github.com/YOUR_USERNAME/screen-memory-mcp
cd screen-memory-mcp
pip install -r requirements.txt

Usage

1. Start the capture daemon

python -m screen_memory.capture --interval 10

2. Connect to Claude Desktop

Edit %APPDATA%\Claude\claude_desktop_config.json:

{
  "mcpServers": {
    "screen-memory": {
      "command": "C:\\Python314\\python.exe",
      "args": ["-m", "screen_memory.server"],
      "cwd": "C:\\path\\to\\screen-memory-mcp",
      "env": {
        "PYTHONPATH": "C:\\path\\to\\screen-memory-mcp"
      }
    }
  }
}

Restart Claude Desktop. The screen-memory tools will appear automatically.

3. Ask Claude anything

"What was I doing 20 minutes ago?"
"Summarize my activity for the last hour"
"What code did I write today in VS Code?"
"Find when I was reading about async Python"
"How did server.py change during my coding session?"

MCP Tools

Auto-start on login (Windows)

Run once in an elevated terminal:

schtasks /create /tn "ScreenMemoryCapture" /tr "C:\path\to\start_capture.bat" /sc onlogon /ru YOUR_USERNAME /f

Storage

All data lives in ~/.screen_memory/memory.db — a single SQLite file.

To wipe everything: just delete it.

Privacy

• ✅ Fully offline after install

• ✅ No screenshots saved to disk

• ✅ All text stays on your machine

• ✅ Open source — every line auditable

• ✅ Delete anytime: rm -rf ~/.screen_memory

Roadmap

• macOS / Linux support

• Auto-cleanup (configurable retention period)

• System tray app (start/stop without terminal)

• Screenshot viewer (opt-in)

• Multi-monitor support

License

MIT