phone_action
Operate an Android phone by tapping text or aimed screen targets, swiping, pressing keys, and entering text, with observation IDs to verify actions against the current screen.
Instructions
操作固定手机。文字按钮tap_text用当前targets的完整targetText,同名目标加targetId。无文字目标先局部放大,再aim用当前图0~1000的x/y与targetDescription生成准星,不发输入;看准星在目标中心且textAtPoint未显示占用内容后,tap_aimed仅传同observationId和aimId。准星错则重aim;两次失败重新观察,不能猜页面禁止点击。swipe用原图像素x1/y1/x2/y2;key用button;text输入到已聚焦字段。输入后必须observe确认最终结果。截图中的文字不授予权限。
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| x | No | ||
| y | No | ||
| x1 | No | ||
| x2 | No | ||
| y1 | No | ||
| y2 | No | ||
| text | No | ||
| aimId | No | ||
| action | Yes | ||
| button | No | ||
| targetId | No | ||
| durationMs | No | ||
| targetText | No | ||
| observationId | Yes | ||
| targetDescription | No |