Smart Tap (AI) [Pro]
smart_tapFinds a UI element by natural language description and taps its center. Combines locating and tapping into one action, returning success status and the tapped element.
Instructions
[Pro] Finds a UI element by natural language description and taps it. Combines element finding and tapping into a single action. Example: smart_tap('the Sign In button') will locate the button and tap its center coordinates. Returns whether the tap succeeded and which element was tapped.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"device_id": "<device_id>",
"element_description": "<element_description>"
},
"name": "smart_tap"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| device_id | Yes | Device serial ID | |
| element_description | Yes | Description of the element to tap, e.g. 'the Submit button' or 'the settings icon' |