PeepIt MCP

Captures macOS screen content and optionally analyzes it. Targets can be entire screen, specific app window, or all windows of an app (via app_target). Supports foreground/background capture. Output via file path or inline Base64 data (format: "data"). If a question is provided, image is analyzed by an AI model (auto-selected from PEEPIT_AI_PROVIDERS). Window shadows/frames excluded. PeepIt MCP 1.0.0-beta.1 using openai/gpt-4o, ollama/llava:latest

Analyzes a pre-existing image file from the local filesystem using a configured AI model.

This tool is useful when an image already exists (e.g., previously captured, downloaded, or generated) and you need to understand its content, extract text, or answer specific questions about it.

Capabilities:

• Image Understanding: Provide any question about the image (e.g., "What objects are in this picture?", "Describe the scene.", "Is there a red car?").

• Text Extraction (OCR): Ask the AI to extract text from the image (e.g., "What text is visible in this screenshot?").

• Flexible AI Configuration: Can use server-default AI providers/models or specify a particular one per call via 'provider_config'.

Example: If you have an image '/tmp/chart.png' showing a bar chart, you could ask: { "image_path": "/tmp/chart.png", "question": "Which category has the highest value in this bar chart?" } The AI will analyze the image and attempt to answer your question based on its visual content. PeepIt MCP 1.0.0-beta.1 using openai/gpt-4o, ollama/llava:latest

Lists various system items on macOS, providing situational awareness.

Capabilities:

• Running Applications: Get a list of all currently running applications (names and bundle IDs).

• Application Windows: For a specific application (identified by name or bundle ID), list its open windows.

  • Details: Optionally include window IDs, bounds (position and size), and whether a window is off-screen.

  • Multi-window apps: Clearly lists each window of the target app.

• Server Status: Provides information about the PeepIt MCP server itself (version, configured AI providers).

Use Cases:

• Agent needs to know if 'Photoshop' is running before attempting to automate it. { "item_type": "running_applications" } // Agent checks if 'Photoshop' is in the list.

• Agent wants to find a specific 'Notes' window to capture. { "item_type": "application_windows", "app": "Notes", "include_window_details": ["ids", "bounds"] } The agent can then use the window title or ID with the 'image' tool. PeepIt MCP 1.0.0-beta.1 using openai/gpt-4o, ollama/llava:latest