Skip to main content
Glama
Baird's Hoard MCP Server

Baird's Hoard MCP Server

by Luissalet

Baird's Hoard

Español

Live view, screenshots, instant clips and recordings of another computer plugged into this PC through an HDMI capture device, with files you can drag or paste straight into a chat, and an MCP bridge so assistants can look at that screen too.

Part of the Hoard family (Hoard Hub, Faustus). Runs locally on Windows, port 5232.

What it is

Baird's Hoard turns an HDMI capture device into a tool for working with another computer's screen: you watch it live, optionally enhance the picture on a spare GPU, grab screenshots, keep the last seconds, record, annotate, search the text on captured screens and watch for changes. Every file is ready to drag into a chat, and assistants get the same abilities through MCP.

Related MCP server: Agent Auto Ops

What it does

Live view

The other computer's screen in a window, 1080p, with sound, under a second of delay. A level meter beside the speaker button moves with the captured sound even while muted and says when nothing arrives. The device's own H.264/AAC is copied into fragmented MP4 and played by the browser's hardware decoder: no re-encoding, almost no CPU.

Enhance

Optional GPU chain between the signal and what you see and save, one switch per effect: noise reduction, upscaling (×1.5, ×2, ×3), sharpening, frame-rate interpolation (blend for the live view, motion-compensated for saved files) and HDR10 for saved files. Clips and recordings come from the enhanced picture while it is on; screenshots and screen_look stay the original. The effects run on Vulkan (libplacebo, nlmeans_vulkan) and NVENC on one chosen GPU, with CPU fallbacks; Measure cost reports the milliseconds each effect adds per frame and whether the chain keeps up in real time. A saved video gets an enhanced "(mejorado)" copy from its card.

Screenshot (C)

The exact current frame as PNG (or JPG), saved in a tenth of a second.

Last seconds (B)

The last 30 s (configurable, up to the memory window) saved as MP4 instantly: the app keeps the recent past in memory, cut on key frames.

Record (R)

Picture and sound until you stop; starts from the key frame before the click.

Recent files

Every file appears at once in the side list: drag the card into a chat, a mail or a folder (inside the Hoard window this is a real file drag), or press Copy and paste with Ctrl+V. Explorer shows it, Light makes a 720p copy for chats with upload limits, Delete sends it to the Recycle Bin.

Zone (Z)

Drag a rectangle over the live view and save only that area (screenshot of a zone). Assistants pass region.

Annotate

Arrows, boxes and text over a screenshot; saved as a new "(anotada)" file, the original is never touched. Optionally send it straight to Faustus.

Send to Faustus

Opens a new Faustus chat with the screenshot or clip attached, ready to send.

Search by text

Screenshots are read in the background (OCR through the Hub and Kafka); the search bar finds them by the words on screen.

Watch

Rules that alert when a zone changes (or stays still) or when text appears/disappears; an alert saves a picture, emits baird.watch on the family bus and notifies through the Hub.

Mini view (P)

Always-on-top Picture-in-Picture window to keep an eye on the other computer.

Global shortcuts

Ctrl+Alt+C (screenshot) and Ctrl+Alt+X (last seconds) even when Baird is not focused; configurable in Settings. A small helper registers them with Windows and ends with the app.

Assistants

32 MCP tools. screen_look returns the current picture as an image, so an assistant can see the other computer; clip_save, record_start/stop, media_list, media_look, media_copy, enhance_set, enhance_status, enhance_benchmark, media_enhance…

Other keys: M sound, F full screen (double click on the picture also).

If the device's driver stops responding (it can happen when the other computer goes to sleep), the status shows La capturadora no responde: unplug the device's USB cable, wait five seconds and plug it back in; Baird retries while capture is requested.

Hardware

AVerMedia Live Gamer Portable Lite (GL310, USB id 07CA:C835); the Live Gamer Portable (C875) uses the same path. Only the device driver is needed — the WHQL-signed AVer835_x64.inf (v3.7.64.39) from AVerMedia's GL310_3.7.x.39.zip. No vendor application is used or needed. See docs/DEVICE.md for how the capture works and why ordinary capture programs cannot open this device.

Run

From Hoard Hub: the Baird's Hoard tile (start, stop, open in a window or a browser tab).

By hand:

python -m venv .venv
.venv\Scripts\python -m pip install -r requirements.txt
.venv\Scripts\python -m baird_hoard

Needs ffmpeg on PATH (or BAIRD_FFMPEG). The native helper native/bairdcap.exe is compiled on first start with the C# compiler that ships with Windows (.NET Framework 4.8).

Files go to Videos\Baird by default (Settings → Folder). Settings, thumbnails and logs live in data/.

Capture opens on demand. A visible live view, a recording, an enabled watch rule or a picture tool can open the device. It closes after 10 seconds without demand. The live view offers Reintentar ahora after signal loss and shows the hourly opening limit when it is reached. The Hub skips Baird when it starts a profile at startup or runs Start all. See device notes for the retry policy.

Settings

Capture on/off (off frees the device for other programs), optional always-on capture, device, audio input (HDMI or the 3.5 mm line in; the API also takes spdif or a crossbar input number), screenshot format, clip length, memory window (10–600 s), media folder, size and bitrate of light copies, automatic OCR on/off, global shortcuts on/off and their key combinations (each needs a modifier and must differ). The enhancement has its own block: on/off, clips and recordings from the enhanced picture, one setting per effect and the GPU it runs on (Vulkan and NVENC index, 2 by default).

Connection with Faustus and Hoard Hub

The Hub starts and stops the app from its tile and the plugin manifest faustus-plugin.json registers it in Faustus. Screenshots and clips can be sent to a new Faustus chat, and watch alerts go out on the family bus and through the Hub.

mcp_server.py is a stdio MCP bridge (it starts the app when it is not running). Tools by group:

Group

Tools

Capture

capture_status, screen_look, snapshot_save, clip_save, record_start, record_stop

Library

media_list, media_look, media_light_copy, media_copy, media_reveal, media_rename, media_delete, jobs_list

Text

media_search, media_ocr, ocr_reindex

Faustus

send_to_faustus

Watch

watch_list, watch_add, watch_update, watch_remove, watch_check, watch_events, hotkeys_status

Settings

settings_get, settings_set

snapshot_save and screen_look accept a region. The same handlers serve the web UI (POST /api/ui/call) and POST /api/agent/call (Bearer token from data/mcp-token).

This app carries procedures from the skill library of the family's workspace for the agents that connect to it: screen-capture-evidence, systematic-debugging. They are named in what an agent reads on connecting, read with skills_list and skill_read, searched and assigned with skills_library and skills_assign, and offered as prompts. The person chooses them on the skills page (/api/agent/skills/page) or in the Hub's Skills tab; the skills block of faustus-plugin.json holds what the app asks for by default.

HTTP API

Route

GET /api/health

service, capture state, input resolution

GET /api/status

capture, recording, jobs, viewers and retry timing

POST /api/capture/retry

advance a pending retry while there is demand, within the hourly limit

POST /api/snapshot, /api/clip, /api/record/start, /api/record/stop

the three buttons

GET /api/media, GET /media/{name}, GET /api/thumb/{name}

library, files, thumbnails

POST /api/media/{name}/copy · /reveal · /light · /rename, DELETE /api/media/{name}

file actions

POST /api/snapshot with {"region": {x,y,w,h,unit}}

zone screenshot

POST /api/media/{name}/annotate · /faustus · /ocr

annotated copy (PNG data URL), send to Faustus, read text

GET /api/search?q=, GET /api/ocr/status, POST /api/ocr/reindex

text search over screenshots

GET/POST /api/watch, PUT/DELETE /api/watch/{id}, POST /api/watch/{id}/check, GET /api/watch/events

screen watch rules

GET /api/hotkeys

global shortcut helper status

GET/PUT /api/settings, GET /api/devices

settings (enhance is an object; a partial update keeps the other keys)

WS /api/live

live fragmented MP4 (init JSON, init segment, fragments; reset starts a new stream); the enhanced picture while the enhancement is on, ?view=raw for the original

Tests

.venv\Scripts\python -m pytest

BAIRD_FAKE=1 replaces the device with an ffmpeg test pattern (used by the tests and for demos); BAIRD_FAKE_SOURCE=<video file> loops that file instead.

Project layout

Path

Contents

baird_hoard/

Application: capture, live stream, enhancement chain, media library, OCR, watch rules, hotkeys, API

baird_hoard/static/

Web interface

native/

bairdcap helper that reads the device (source and compiled binary)

mcp_server.py

MCP bridge

docs/DEVICE.md

How the capture works

tests/

Test suite

data/

Settings, thumbnails, logs and the MCP token

License

MIT. Third-party parts: THIRD_PARTY_NOTICES.md.

Tool Schema Changelog

Recent tool additions, removals, and schema changes observed during successful MCP inspections.

Loading tool schema changelog…

    Related MCP Connectors

    Related MCP Servers

    • A
      license
      Not graded
      quality
      C
      maintenance
      Enables AI assistants to perceive and operate macOS applications through screenshots, on-device OCR, accessibility elements, and consent-gated input, and to run an app in an isolated virtual-display session with screenshots, OCR/ASCII frames, bounded history, and evidence reports. It supports text-only models via spatial text representations while keeping capture read-only by default and gating control behind macOS permissions and operator authorization.
      MIT
    • A
      license
      Not graded
      quality
      B
      maintenance
      Enables Codex to observe a physically separate computer or tablet through HDMI capture and control it with USB HID keyboard and mouse, pairing each action with the latest observation.
      2
      AGPL 3.0
    • A
      license
      B
      quality
      B
      maintenance
      Connects MCP agents to a jailbroken console so they can watch live HDMI video and audio, press buttons through a virtual DualSense, launch or close games, install packages, transfer files, and run visual automation with snapshots and recordings. Multiple agents can share one console through a claim-and-queue system.
      28
      MIT
    • A
      license
      Not graded
      quality
      C
      maintenance
      Enables MCP-capable agents to observe a controlled device's screen from captured video and operate it by sending simulated keyboard, text, scroll, drag, and mouse input. Screenshots can be inspected as numbered visual targets, with dense areas split into zoomed regions so the agent picks a target ID and the server handles coordinate mapping and click execution.
      1
      MIT