Skip to main content
Glama

accessibility

Destructive

Drive app windows via the OS a11y tree. Find elements by name/role, invoke, toggle, set values, query state for reliable automation across DPI/layout shifts.

Instructions

START HERE to see and drive a window: the OS accessibility tree — read element names, find by name/role, invoke, toggle, expand/collapse, set value, select an option, query state. Pick an action: read_tree, find, get_element, focused, invoke, focus, set_value, get_value, expand, collapse, toggle, select, state, list_children, wait_for, compile_ui, find_button, find_field, smart_click, smart_type, smart_read. Always preferred over computer.click(x,y) when the target has a name — more reliable across DPI, window resize, layout shifts. click, set-value and get-value are aliases of invoke, set_value and get_value. read_tree / find return one line per element — [Role] "name" @x,y w×h (SCREEN coordinates: click them with computer click space:"screen"), plus value= when there is one; page past "+N more" with offset. invoke, set_value, toggle and select change the app (pressing "Delete" deletes); a destructive target name (Send, Delete, Pay) needs the user's confirmation. For sparse/ambiguous UIs: compile_ui fuses a11y+OCR into one ranked map of elements with stable ids; find_button/find_field locate a target semantically and return an {element_id, snapshot_id} you pass straight to invoke/set_value (survives layout shifts, no coordinates).

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
modeNo"replace" (default with a target): select all of the field, then type. "append": type at the cursor, keeping the content (default without a target).
nameNoElement name to search for
textNoThe text to type
limitNoHow many elements to list (default 60)
scopeNoRead scope: "focused" for focused element, "window" for active window, "screen" for full screen
valueNoValue for set-value action
actionYesWhich sub-action to perform. See this tool's description for the enum of valid values.
expectNoOptional post-conditions to verify after this action (same assertion types as the verify tool: window_title_contains, app_running, element_exists, element_value_contains, clipboard_contains, file_exists, file_contains, ocr_contains, file_changed_since_start). If any FAIL the action returns a DEVIATION and you must adapt. State an OUTCOME you can observe (a window title, a rendered element/chip, a status) — NOT the raw text you typed.
intentNoWhat you want to do (submit/cancel/search/login/...)
offsetNoSkip this many elements — page past "… +N more" (default 0)
targetNoElement name/text to click (e.g., "Send", "Submit", "New Email"). Alias: "name".
purposeNoWhat the compile is for (Where the action restricts it: one of general | find_text | act.)
timeoutNoMax time in ms (default 5000)
max_costNoHard ceiling on perception cost (default ocr_ok)
processIdNoOptional: limit to a specific process
timeoutMsNoDefault 5000
element_idNoTarget a compiled element from compile_ui (requires snapshot_id)
intervalMsNoDefault 250
parentNameNoAlias for "name". Accessibility name of the parent element
controlTypeNoUI Automation control type. Either form works: "Button" or "ControlType.Button". An unrecognized type returns no results rather than silently searching unfiltered.
maxChildrenNoCap on children returned
snapshot_idNoThe compile_ui snapshot the element_id came from (requires element_id)
target_textNoIf set and absent from a11y, pull OCR to find it
automationIdNoAutomation ID

Schema Changelog

Changes observed during successful MCP inspections.

  1. First observedv1.5.16

TDQS

A4.7/5.0
Behavior5/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations declare destructiveHint=true but not which actions are destructive; the description fills that gap by naming the mutating actions ('invoke, set_value, toggle and select change the app') and explaining that destructive target names require user confirmation. It also documents aliases, the coordinate space of returned elements, and pagination via '+N more'/offset.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Front-loads the highest-value guidance ('START HERE', the preferred-over-computer rule) before the long action list. It is dense and long, but for a 24-action tool nearly every sentence carries routing or safety information, so the length is largely justified.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With no output schema, the description does the required work of describing return shapes ('one line per element — [Role] "name" @x,y w×h ... plus value=') and pagination. A few actions (state, list_children, wait_for, smart_read/smart_type) get no explanation, but the core read/act path is fully covered.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so the schema already documents every parameter and a 3 is the baseline. The description adds real value beyond it: alias mapping (click/set-value/get-value), the fact that read_tree/find use SCREEN coordinates clickable via `computer click` space:"screen", and the element_id+snapshot_id handoff flow.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Opens with a specific verb+resource ('see and drive a window: the OS accessibility tree') and enumerates the concrete capabilities (read names, find by name/role, invoke, toggle, expand/collapse, set value, select, query state). It cleanly distinguishes itself from sibling `computer` by describing a name-based accessibility approach versus coordinate clicking.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines5/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Explicitly states precedence: 'Always preferred over computer.click(x,y) when the target has a name', with the reasons (DPI, resize, layout shifts). It also routes to alternatives for hard cases: use compile_ui / find_button / find_field for 'sparse/ambiguous UIs'.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Deploy Server

Other Tools