gui_observe
Observe browser, Android, or macOS GUI targets to capture screenshots and status, with optional accessibility tree for UI analysis.
Instructions
观察 GUI 目标:浏览器页面、安卓设备屏幕或 macOS 桌面。返回截图和状态信息。
Args: target: 观察目标 (browser|android|macos) session_id: 会话 ID include_screenshot: 是否包含截图 include_accessibility_tree: 是否包含无障碍树
Tool call template
This tool declares no required parameters. Add optional parameters from the input schema as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {},
"name": "gui_observe"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| target | No | browser | |
| session_id | No | default | |
| include_screenshot | No | ||
| include_accessibility_tree | No |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| result | Yes |