rm_click
Click UI components by id, text, tooltip or class, or click screen coordinates. Supports right-click for context menus and double-click actions in AI Studio.
Instructions
Click a component (id or text/name/tooltip/class query) or a point (x,y). Buttons are pressed via their action; other components get real mouse events. Supports right-click (context menus) and double-click.
Tool call template
This tool declares no required parameters. Add optional parameters from the input schema as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {},
"name": "rm_click"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| x | No | X in window coordinates (pixels of an unscaled rm_screenshot) | |
| y | No | Y in window coordinates | |
| id | No | Component id from rm_ui_tree / rm_ui_find | |
| name | No | Match Swing component name | |
| text | No | Match visible text / label (substring, case-insensitive) | |
| class | No | Match Java class name, e.g. JButton, JTree | |
| exact | No | Exact (not substring) text match | |
| index | No | Which match to use when several match (0-based) | |
| scale | No | If x/y come from a scaled screenshot, pass that scale | |
| button | No | ||
| clicks | No | 2 = double-click | |
| window | No | Window id from rm_windows (default: active window) | |
| tooltip | No | Match tooltip text | |
| wait_ms | No | ||
| offset_x | No | Point inside the component (default: center) | |
| offset_y | No | ||
| modifiers | No | e.g. 'ctrl', 'shift', 'ctrl+shift' | |
| synthetic | No | Force mouse events even for buttons |