Skip to main content
Glama
liufeicc

cc-computer-use

by liufeicc

click

Click UI elements via accessibility ref, text, or coordinates; falls back to calibrated coordinate click and returns deviation feedback.

Instructions

点击一个元素。优先传 ref(来自 get_ui_tree/find_element/get_screen_text);也可传 text(+app) 现场匹配第一个元素。执行采用三级降级:①元素级 do_action(零坐标,首选)→ ②校准坐标点击(兜底)→ ③都失败则提示改用 screenshot。返回结果会标明实际生效的层级。坐标级点击会回报「落点证据」(落在哪扇窗、底下什么字、点后活动窗口)、一张点击前抓的准星小图(红十字 = 你刚才点的那个像素,未缩放、图上 1 像素 = 屏幕 1 像素),以及程序算好的偏差数值:最近文字块离落点多远;若你传了 expect(如 expect="保存"),还会直接给出「未命中,偏差 (+17,-42) 共45px,建议改点其中心 (517,258)」——按建议坐标重试即可,不必再截图估算。另有「点后界面变化」百分比作为命中参考(无变化 = 大概率点空)。preview=false 可关掉这套画面反馈(更省 token,代价是失去位置依据)。灰区应用(无元素树,如 SWT/自绘控件)可传裸坐标 x+y(屏幕绝对坐标,可先用 get_screen_text 读出坐标)直接坐标级点击,无需再借道 shell。

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
xNo
yNo
appNo
refNo
roleNo
textNo
actionNo
buttonNo
expectNo
previewNo

Schema Changelog

Changes observed during successful MCP inspections.

  1. First observedv0.1.0

TDQS

A4.7/5.0
Behavior5/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations are absent, so the description carries the full disclosure burden and discharges it thoroughly. It reveals the three-tier internal execution fallback (element-level do_action → calibrated coordinate click → suggest screenshot), that the return states the effective tier, and the full set of coordinate-click return artifacts: landing evidence, unscaled crosshair snapshot, computed offset from the nearest text block, expect-driven corrective coordinates, and the post-click change percentage as a miss indicator.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is long, but every clause earns its place given the 0% schema coverage and absent annotations, and it is front-loaded with the core purpose and preferred mode before details. The ①②③ fallback chain, bolded key terms, and arrow/percent framing keep the density structured; the crosshair pixel-mapping passage is valuable but could arguably be tightened.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a 10-parameter tool with no annotations, no schema descriptions, and no output schema, the description supplies everything an agent needs to call it correctly: targeting modes, fallback mechanics, return artifacts, the expect retry loop, and the preview tradeoff. Remaining gaps are minor: role is undocumented, button is underexplained, and the error-return format beyond the effective-tier indicator is not specified.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

With 0% schema description coverage, the description compensates strongly: it explains ref (source tools and precedence), text(+app) first-match semantics, x/y as absolute screen coordinates, expect (enables miss-offset plus suggested retry coordinates), preview (toggles the visual feedback payload), and action via the element-level do_action reference. However, role is never mentioned and button's semantics are left entirely to its default value, so coverage of the 10 parameters is strong but not complete.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

States the purpose immediately and specifically: '点击一个元素' (click an element), a clear verb+resource. It then enumerates the three targeting modes (ref, text+app, bare coordinates), and distinguishes itself from siblings by naming get_ui_tree/find_element/get_screen_text as the sources of ref and screenshot as the fallback path, so an agent can tell it apart from the find/read/keyboard siblings.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines5/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Gives explicit priority ordering: prefer ref, fall back to text(+app) first-match, and use bare x+y only for gray-zone apps lacking an element tree. It also states when not to use the feedback payload (preview=false to save tokens) and when to abandon the tool (both fallback tiers fail → switch to screenshot), which is explicit when/when-not guidance with named alternatives.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.