Skip to main content
Glama

YouAndEye 👀

A tiny DIY face for an AI with something to say

Two little IPS eyes, one pocket-size OLED mouth, and a classic ESP32 doing its best impression of being alive.

YouAndEye Expression Bench showing the physical Heltec face preview and expression controls

Hardware tested Tests ESP32 MCP License

Build one · Meet the face API · Open the expression bench

Hello, little face

YouAndEye is an expressive physical face for local or cloud-connected AI agents. The agent says what it means—happy, thinking, suspicious, listening—and the device decides how to perform it: eye shape, brows, gaze, blink timing, mouth motion, text, and small character beats.

The face does not need a stream of animation frames from a computer. Once powered, it keeps breathing, looking around, and blinking locally. Disconnect the agent and it still has a pulse.

Related MCP server: LUNA

Meet the expressions

The browser bench renders the same semantic poses used by the firmware. These captures use the physical Heltec profile at its real 160×160 eye resolution and 128×64 OLED mouth resolution.

Thinking

Happy

Thinking expression with offset gaze and an animated dotted mouth

Happy expression with smiling closed eyes and mouth

Surprised

Suspicious

Surprised expression with wide eyes and round mouth

Suspicious expression with asymmetric narrowed eyes

Love

Error

Love expression with pink heart-shaped pupils

Error expression with red angry eyes

What is inside?

Part

Job

Classic Heltec WiFi Kit 32

Runs the renderer and contributes its built-in 128×64 OLED mouth

Waveshare 0.71-inch DualEye LCD

Two 160×160 GC9D01 round IPS eyes on one compact board

firmware/

Fifteen expressions, autonomous motion, mouth shapes, text, and synchronized beats

Expression Bench

Exact-size browser playground for tuning before flashing hardware

emote/1

Transport-independent semantic expression contract

Local MCP server

Four safe tools that let Codex or another MCP client wear the face

The accepted build sustains about 30 FPS on the classic ESP32 with synchronized blinking and zero deadline misses in its final 60-second hardware soak. Release firmware is USB-only: it starts no access point, stores no Wi-Fi credentials, and exposes no device network service.

Build one over a weekend

The complete DIY build guide includes:

  • exact board-generation warnings and official source links

  • a shopping list and the proven 11-wire pin map

  • careful first-power and upload steps

  • eye, mouth, serial, and MCP smoke tests

  • enclosure ideas and friendly failure recovery

The short version is delightfully small:

Waveshare DualEye ── SPI ──► classic Heltec WiFi Kit 32
       two eyes                    brain + OLED mouth
                                      │
                                   USB/MCP
                                      │
                                  your agent
IMPORTANT

Heltec's current WiFi Kit 32 is an ESP32-S3 revision. This working build uses the older classic ESP32 target namedheltec_wifi_kit_32 by PlatformIO. Read the buying note before ordering.

Try the software first

No hardware is required to explore the expressions:

python -m http.server 4173

Open http://127.0.0.1:4173/simulator/, choose an expression, and watch the same semantic motion model used by the firmware.

Build and test

uv sync --extra serial
uv run --extra serial python -m unittest discover -s tests -p 'test_*.py' -v
python -m platformio run -d firmware -e heltec_wifi_kit_32

The firmware pins Espressif32 6.12.0 and carries a small, licensed Arduino GFX 1.6.4 subset containing only the GC9D01 and ESP32 SPI code it uses. A fresh checkout therefore cannot silently pull incompatible display code.

Hardware writes are deliberately separate from builds. The DIY guide walks through identifying the board before supplying an upload port.

Give the face a feeling

The preferred agent boundary is local STDIO MCP:

express(affect="thinking", message="PLEASE WAIT...", text_mode="scroll")
express(affect="success", sequence="celebrate")
neutral()

Tool

Meaning

express

Show a temporary affect, message, or device-owned character beat

face_status

Read connection state, active expression, FPS, timing, and display health

face_capabilities

Discover the face without opening its serial port

neutral

Clear pending intent and return to autonomous neutral

See the MCP guide for Codex setup, other MCP clients, the loopback-only HTTP bridge, and safety behavior. The project is local-first and fully usable offline; a trusted desktop client can optionally make the tools available to a cloud agent without turning the microcontroller into a public service.

Design rules

  • Agents express intent. Surfaces perform it. Models never receive raw pixel or keyframe controls.

  • Life belongs on the device. Blinks, saccades, easing, and idle behavior survive host hiccups.

  • Simulator before solder. Visual ideas graduate in the browser before reaching firmware.

  • Readable beats realistic. Six core expressions must remain recognizable at actual eye size.

  • Fail softly. Expired or interrupted host intent returns to an autonomous neutral face.

Project map

Path

What lives there

docs/DIY_BUILD_GUIDE.md

Parts, wiring, flashing, first boot, enclosure, and troubleshooting

simulator/

Interactive expression and motion simulator

firmware/

Accepted classic-ESP32 firmware

host/youandeye/

MCP, HTTP, arbitration, validation, and verified serial bridge

schema/

Canonical emote/1 JSON schemas

docs/MCP.md

Agent interface and client setup

STATUS.md

Concise release status and verification evidence

Engineers joining the project should begin with this README and ARCHITECTURE.md. Humans who just want a charming desk creature should begin with the DIY guide.

Known-good release

The accepted Heltec behavior provides fifteen affects, five coordinated character beats, an animated mouth, smooth text scrolling, native icons, and synchronized binocular blinking. Its paired host stack adds the local MCP/HTTP control plane. Current build sizes, tests, and limitations are recorded in STATUS.md.

Make it yours

Try a cardboard face. Sculpt one from foam clay. Put the eyes in a robot, a puppet, or a tiny haunted radio. The protocol deliberately separates personality from hardware, so a completely different shell can keep the same emotional vocabulary.

YouAndEye enclosure and expression concept sheet

Please document the exact hardware you test, and share photos of anything especially adorable or unsettling.

YouAndEye is free software under the MIT License. Dependency terms are collected in THIRD_PARTY_NOTICES.md.

Available Tools

4 tools
expressExpress through YouAndEyeA

Show one temporary semantic expression on the local face. The firmware owns animation. When sequence is set, omit message so the device can perform its coordinated eye/OLED beat.

ParametersJSON Schema
NameRequiredDescriptionDefault
gazeNouser
causeNoagent expression
affectYes
ttl_msNo
messageNo
autonomyNo
priorityNonormal
sequenceNo
intensityNo
text_modeNostatic
behavior_modeNoattentive

Output Schema

ParametersJSON Schema
NameRequiredDescription

No output parameters

TDQS

A3.6/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations only say the operation is not read-only, not idempotent, and not destructive; the description adds that the expression is temporary and that the firmware owns animation, which explains the device-driven temporal behavior. The sequence/message interaction is a useful behavioral disclosure beyond the schema. It does not describe possible side effects or return behavior, but the annotations provide no contradictions and the output schema covers return shape.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two sentences, front-loaded with the core purpose, no filler; the conditional note earns its place because it prevents a common invocation error. This is an ideal size for this tool.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Despite output schema and annotations, the definition is not complete enough for an agent to correctly use a complex 11-parameter tool. The most important required field (affect) and several behavior-shaping parameters are unexplained, and there is no mention of when temporary expressions expire or how firmware-sequenced expressions interact with other calls. The sequence/message note helps but is the only operational guidance.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

With 0% schema description coverage and 11 parameters, the description must carry the burden and largely fails to. It only explains the message/sequence relationship; the required affect parameter and key controls such as priority, gaze, intensity, ttl_ms, autonomy, text_mode, and behavior_mode are left undefined.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The phrase 'Show one temporary semantic expression on the local face' names a specific verb, resource, and scope, and 'temporary' distinguishes it from persistent state changes. It does not explicitly contrast with sibling tools like neutral or face_status, so it misses the top bar for sibling differentiation.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description gives direct conditional guidance: when sequence is set, omit message so the device can perform its coordinated eye/OLED beat. It conveys this is the tool for showing a temporary expression, but it never mentions when to prefer neutral, face_status, or face_capabilities instead, so exclusions are absent.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

face_capabilitiesRead YouAndEye capabilitiesA
Read-onlyIdempotent

Describe supported affects, sequences, channels, limits, and local connection state.

ParametersJSON Schema
NameRequiredDescriptionDefault

No parameters

Output Schema

ParametersJSON Schema
NameRequiredDescription

No output parameters

TDQS

A4.3/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The annotations already establish readOnlyHint, idempotentHint, and non-destructive behavior, so the description only needs to add context beyond those. It does so by noting that the tool describes connection state and limits, which is behaviorally relevant to an agent deciding whether local state might be stale or constrained.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, front-loaded sentence with no filler. Every listed item adds meaningful detail about what the tool returns, making it efficient and easy to parse.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

This is a simple, zero-parameter read-only introspection tool. The annotations cover safety, the output schema covers return structure, and the description enumerates the main content areas. Nothing essential is missing for an agent to invoke and interpret the tool correctly.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

There are zero parameters, so the description does not need to explain argument semantics. The baseline of 4 for zero-parameter tools applies, and no information is missing on this dimension.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description uses a specific verb ('Describe') with a clear resource ('YouAndEye capabilities') and enumerates the exact content categories: affects, sequences, channels, limits, and local connection state. This sets it apart from sibling tools like express, face_status, and neutral, which are action/status-oriented.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies this tool is used to discover what the system supports and its connection state, but it does not explicitly say when to choose this over siblings or when not to use it. The context is clear enough for a simple read-only capability query, but there is no explicit guidance on alternatives.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

face_statusRead YouAndEye statusA
Read-onlyIdempotent

Read connection, active expression, eye renderer, mouth mode, frame timing, and misses.

ParametersJSON Schema
NameRequiredDescriptionDefault

No parameters

Output Schema

ParametersJSON Schema
NameRequiredDescription

No output parameters

TDQS

A3.6/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint, idempotentHint, and destructiveHint, so the safety profile is covered. The description adds value by disclosing which specific status fields are read, though it does not discuss connection semantics or potential error conditions. No contradiction with annotations exists.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, front-loaded sentence that efficiently lists exactly what the tool reads. Every word earns its place, and there is no redundant or filler content.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a zero-parameter, read-only status tool with an output schema and rich annotations, the description is complete. It covers the key status areas an agent would need to decide whether to call this tool, and no additional behavioral context is necessary.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The tool has zero parameters and the schema is empty, so there is nothing for the description to explain. A baseline of 4 is appropriate for zero-parameter tools because no parameter ambiguity exists.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states a clear verb ('Read') and a specific resource ('YouAndEye status'), and enumerates the exact status dimensions: connection, active expression, eye renderer, mouth mode, frame timing, and misses. It does not explicitly contrast with siblings like express, face_capabilities, or neutral, but the read-versus-action distinction is evident from the wording.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit guidance is given about when to use this tool versus the sibling tools. The read-only framing implies it is appropriate for checking state rather than changing it, but the description does not state exclusions or alternatives.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

neutralReturn YouAndEye to neutralA
Idempotent

Clear pending expressions and restore the safe autonomous neutral face immediately.

ParametersJSON Schema
NameRequiredDescriptionDefault

No parameters

Output Schema

ParametersJSON Schema
NameRequiredDescription

No output parameters

TDQS

A4.5/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The description adds concrete behavioral context beyond the annotations: it clears pending expressions and restores a safe autonomous neutral face immediately. This complements the idempotentHint and clarifies that the operation has a calming/reset effect rather than a persistent destructive one.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, concise sentence that front-loads the core action and states the immediate result. Every phrase earns its place, with no filler or redundant restating of the title.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a zero-parameter tool with an output schema and rich annotations, this description is fully sufficient. It explains the operation, the effect, and the safety-oriented outcome, so an agent can invoke it correctly without additional context.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The tool has zero parameters and the schema coverage is trivially 100%, so there are no parameter semantics for the description to explain. The baseline of 4 applies because the description accurately describes the tool's action without any parameter ambiguity.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description uses specific verbs ('Clear', 'restore') and a clear resource ('pending expressions', 'safe autonomous neutral face'). It clearly distinguishes this from siblings like express, face_status, and face_capabilities by describing a state-resetting operation.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description clearly implies when to use the tool: when there are pending expressions that should be cleared and the face should return to neutral. It does not explicitly name alternatives or exclusions, but the intended context is unmistakable from the action described.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Tool Schema Changelog

Recent tool additions, removals, and schema changes observed during successful MCP inspections. Dates show when Glama detected each change.

  1. 4 tool updatesv0.2.0
    • First observedexpress
    • First observedface_capabilities
    • First observedface_status
    • First observedneutral

TDQS

A4/5.0
Disambiguation5/5

Each tool has a clear, distinct role: express sets a temporary expression, neutral clears it, face_status reads current state, and face_capabilities describes supported options. There is no meaningful overlap between writing, resetting, and reading operations.

Naming Consistency3/5

The query tools share a consistent face_ prefix, but the action tools are bare single words (express, neutral) rather than following a verb_noun pattern. The naming is readable and not chaotic, but the conventions are mixed.

Tool Count5/5

Four tools is an appropriate, focused scope for controlling a local face device. Each tool covers a necessary operation without unnecessary redundancy or bloat.

Completeness5/5

The tool set covers the full interaction loop: discover capabilities, read current state, send an expression, and reset to neutral. No critical operation appears to be missing for the stated purpose.

Maintenance

ActivityMaintained
ResponsivenessNo issues

Resources

Unclaimed servers have limited discoverability.

Looking for Admin?

If you are the server author, to access and configure the admin panel.

Related MCP Connectors

Related MCP Servers

  • A
    license
    A
    quality
    B
    maintenance
    Generic MCP server exposing Nexusm core capabilities (memory, conversation, knowledge, feedback, context) to MCP clients via stdio and Streamable HTTP transports.
    4
    19
    MIT
  • A
    license
    Not graded
    quality
    B
    maintenance
    ESP32-based Streamable HTTP MCP server with embedded Lua scripting engine. Bridges Claude AI to physical devices — telescopes (INDI protocol), sensors, BLE peripherals, and TCP devices. Flash-and-run binary distribution, no build required.
    13
    MIT

Latest Blog Posts

MCP directory API

We provide all the information about MCP servers via our MCP API.

curl -X GET 'https://glama.ai/api/mcp/v1/servers/NotADevIAmaMeatPopsicle/YouAndEye'

If you have feedback or need assistance with the MCP directory API, please join our Discord server