Skip to main content
Glama

runtime_sandboxes_desktop_act

Destructive

Drive a sandbox's Linux desktop like a person: start (width,height) returns a live view URL; move/click/drag/scroll the mouse by pixel coordinates; type text; press keys (xdotool names like ctrl+l, Return); list or focus windows; open a URL in Chromium; launch a program. Take runtime_sandboxes_desktop_screenshot to see the result.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
xNo
yNo
dxNoscroll: wheel clicks, positive is right.
dyNoscroll: wheel clicks, positive is down.
idYes
toNodrag: [x, y] to release at.
urlNoopen: an http(s) address to open in Chromium.
argvNolaunch: a program and its arguments.
fromNodrag: [x, y] to press at.
keysNokey: xdotool names, e.g. "ctrl+l", "Return", "alt+Tab".
textNotype: the text to type.
widthNo
actionYes
buttonNo
doubleNoclick: a double click.
heightNo
delayMsNotype: pause between keystrokes.
windowIdNofocus: an id from the window list.

Schema Changelog

Changes observed during successful MCP inspections.

  1. Added

TDQS

A4.3/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnly=false, destructive=true, and openWorld=true, so the safety profile is covered. The description adds real operational context beyond them: start returns a live view URL, input is by pixel coordinates, keys use xdotool names, and open/launch spawn external programs.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Front-loads the purpose, then a compact semicolon-delimited enumeration of capabilities. Dense but well organized for a 16-action tool, with the screenshot note last as a natural follow-up.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With no output schema, the description carries value by noting that start yields a live view URL and that screenshot reveals results. It does omit several enum actions (stop, cursor, status, mouseDown/mouseUp), leaving minor gaps for a multi-action tool.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 61%, and the description compensates by mapping parameters to actions ('start (width,height)', mouse via pixel coordinates, keys, url, argv/launch). This action-to-parameter mapping is not present in the schema itself, so it adds genuine value despite coverage gaps on x/y/width/height/button.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

States a specific verb+resource ('Drive a sandbox's Linux desktop') and enumerates the concrete operations it supports, so an agent immediately knows this is the interactive input tool. It explicitly distinguishes itself from the sibling runtime_sandboxes_desktop_screenshot, which it delegates result inspection to.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Gives clear context ('like a person') and names the complementary tool to use for results ('Take runtime_sandboxes_desktop_screenshot'). It does not, however, state when to prefer this over runtime_sandboxes_browser or runtime_sandboxes_exec, which are plausible alternatives.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.