iphone-control
Server Configuration
Describes the environment variables required to run the server.
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||
Instructions
Guidance the server publishes about itself, which clients place ahead of the tool catalog so the model reads it before choosing anything.
This server publishes no instructions, or was last inspected before Glama recorded them.
Capabilities
Features and capabilities supported by this server
Protocol revision2025-11-25
| Capability | Details |
|---|---|
| tools | {} |
Tools
Functions exposed to the LLM to take actions
| Name | Description |
|---|---|
| iphone_statusA | 查看连接状态:WDA 是否就绪、是否锁屏、当前前台 App、屏幕尺寸。 |
| iphone_screenshotA | 截取当前屏幕。图像已缩放到点尺寸,像素坐标可直接用于点击和滑动。 看不清小图标、小字时,传 x/y/width/height(点)放大这块区域:从原始高清截图裁剪, 小区域再额外放大。返回文字里有放大倍数,图中坐标换算回屏幕点:x + 像素/倍数。 |
| iphone_list_elementsA | 列出屏幕上带文字的界面元素:类型、标签、中心点坐标、尺寸。 filter: 只返回类型/标签/名字/值里包含该文字的元素(不区分大小写),例如 SearchField、Button。 注意:按坐标判断是否在屏幕内,被弹窗遮住的元素也可能列出来,不确定时截图核对。 |
| iphone_tapC | 点击屏幕坐标(点)。 |
| iphone_tap_elementA | 按文字点击元素:先找标签/名字完全相同的,找不到再找包含该文字的。中心被悬浮栏、键盘等盖住时改点没被盖住的部分,整个被盖住就不点。 index: 匹配到多个时点第几个(从 0 开始,顺序同 iphone_list_elements)。 |
| iphone_long_pressC | 长按屏幕坐标(点)。 |
| iphone_swipeB | 从一点滑到另一点(点坐标)。向上滑看下面的内容:from_y 大、to_y 小。 |
| iphone_type_textA | 在当前获得焦点的输入框里输入文字(支持中文)。需要先点中输入框。submit=True 时末尾按回车。 输完会读回输入框核对:少了结尾几个字会自动补上;对不上就报错,不按回车。 |
| iphone_press_buttonA | 按硬件键:home(回主屏幕)、volume_up、volume_down、lock(锁屏;配置了密码时之后的操作会自动解锁)。 |
| iphone_list_appsA | 列出已安装的 App(名字和 Bundle ID)。include_system=True 时列出系统 App。 |
| iphone_launch_appB | 启动 App 并切到前台。app 可以是 Bundle ID,也可以是显示名(如「设置」「微信」)。 |
| iphone_terminate_appB | 结束 App 进程。app 可以是 Bundle ID 或显示名。 |
| iphone_open_urlA | 用系统默认方式打开链接或 URL Scheme(网页会在 Safari 打开)。 |
| iphone_wait_forA | 等包含某段文字的界面元素出现(例如页面加载完、弹窗出现),出现就立即返回;超时报错。代替反复截图轮询。输入框里的字不算。 |
| iphone_batchA | 按顺序执行几步操作,一次调用完成(最多 20 步),某一步出错就停下并说明是第几步。 steps 每项是 {"tool": 工具名, 其余是该工具的参数},可用:iphone_tap、iphone_tap_element、iphone_long_press、iphone_swipe、iphone_type_text、iphone_press_button、iphone_launch_app、iphone_terminate_app、iphone_open_url、iphone_wait_for,以及 {"tool": "wait", "seconds": 秒数}(不超过 5)。 适合确定的连续操作;每步的结果不确定(例如点了以后不知道会跳到哪)时,还是一步步来。 then 同其他操作工具:全部做完后顺带返回界面。 |
Prompts
Interactive templates invoked by user choice
| Name | Description |
|---|---|
No prompts | |
Resources
Contextual data attached and managed by the client
| Name | Description |
|---|---|
No resources | |
TDQS
Scored across 15 tools
Each tool targets a distinct action or resource, and the potentially overlapping pairs are clearly separated: iphone_tap uses coordinates while iphone_tap_element uses text, and iphone_screenshot is visual while iphone_list_elements is textual. iphone_batch is explicitly a wrapper for other tools, so it does not create selection ambiguity.
All tools use the same iphone_ prefix followed by snake_case verb or noun phrases, such as iphone_tap, iphone_list_apps, and iphone_launch_app. The convention is predictable throughout the set.
Fifteen tools is well-scoped for iPhone automation, covering status, inspection, input, app lifecycle, and batching without obvious redundancy. Each tool corresponds to a meaningful primitive an agent would need.
The surface covers core mobile automation workflows: status, app listing/launch/terminate, screenshots, element listing, tapping, swiping, typing, hardware buttons, URL opening, waiting, and batching. Minor gaps remain for advanced gestures like pinch/zoom or clipboard access, but most tasks can be worked around with existing tools.