learn
Probes unlabeled Android controls one at a time, records the observed screen effect, and annotates later UI descriptions so agents stop guessing; destructive or financial controls are refused.
Instructions
Teach the agent what an app's unnamed controls DO, by probing and remembering. Many apps expose no label for their buttons (measured: 56.7% of tappable controls carry no text/description/id, and some apps report no clickable flag at all), so the only honest way to learn them is to act and observe. This taps one unknown control at a time, diffs the screen before/after, and persists the observed effect (opened a screen / dialog appeared / list scrolled / no visible change) under the current app+activity. Destructive and financial controls (delete, pay, logout, uninstall, password fields) are refused and recorded as refused, never pressed. Results appear as learned_effect on later ui_describe calls, so the agent stops guessing. budget = how many controls to probe this call (1-5).
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| budget | No | ||
| settle_ms | No | ||
| allow_restore | No |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||