Skip to main content
Glama

ui_interact

Perform unified DOM interactions on the current page or active iframe, resolving targets via CSS, accessibility, XPath, or coordinates, and return focused overlay results.

Instructions

在当前页面/活动 iframe 中执行统一 DOM 交互并返回聚焦浮层结果。

分析器返回 CSS 时优先 CSS;否则按 AX role/name/description、XPath、text/ placeholder 依次尝试。x/y 是顶层 viewport 绝对 CSS 像素,只在前述候选都无法 解析时作为可信点击回退。坐标应直接取自 vtable_analysis,带 analysis_id 会在 执行前校验页面、iframe、滚动和布局。expect_input=True 时会验证 本次交互后是否真的出现并聚焦 input/textarea/contenteditable。未显式指定 frame 时优先当前激活的 AntD Tab iframe,再回退顶层文档。分析结果中的 frame="active" / "top" 可固定上下文。默认点击后立即 观察 Portal、消息、下拉和通知,限制 max_results 以控制 MCP token。

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
xNo
yNo
cssNo
keyNo
nameNo
roleNo
textNo
frameNo
valueNo
xpathNo
actionYes
in_iframeNo
settle_msNo
timeout_msNo
analysis_idNo
descriptionNo
max_resultsNo
placeholderNo
expect_inputNo
observe_afterNo

Output Schema

TableJSON Schema
NameRequiredDescriptionDefault

No arguments

Behavior5/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries the full burden. It discloses locator resolution priority, x/y fallback behavior, validation behavior with analysis_id, iframe context selection, expect_input verification, and default post-click observation of portals/messages/dropdowns/notifications. This is unusually transparent.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is dense but every sentence contributes: purpose is front-loaded, then resolution order, fallback semantics, validation, frame logic, and observation behavior. A bulleted or grouped structure would improve scannability, but the length is justified for a 20-parameter tool with no schema descriptions.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the high complexity (20 params, no annotations, 0% schema coverage), the description covers behavior and many parameters well. However, it leaves critical gaps around valid action values and the meaning of value/key/in_iframe/settle_ms/timeout_ms. The output schema reduces the need to describe return values, but the missing action semantics prevents full self-sufficiency.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

With 0% schema description coverage, the description compensates substantially by explaining css, role, name, description, xpath, text, placeholder, x/y, analysis_id, frame, expect_input, and max_results. However, the required action parameter's accepted values are not described, and value/key/in_iframe/settle_ms/timeout_ms are only implied or omitted.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

States a specific action ('executes unified DOM interactions') and target ('current page/active iframe'), and describes the returned focused overlay result. However, it does not explicitly contrast itself with siblings like ui_click or vtable_cell_click, so sibling differentiation is left implicit.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Provides clear operational conditions: CSS is preferred when the analyzer returns it, x/y are only fallbacks, analysis_id triggers pre-execution validation, frame defaults to the active AntD tab iframe, and expect_input verifies focus. It lacks explicit 'when not to use this tool' or named sibling alternatives, but the within-tool usage context is strong.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Install Server

Other Tools

Latest Blog Posts

MCP directory API

We provide all the information about MCP servers via our MCP API.

curl -X GET 'https://glama.ai/api/mcp/v1/servers/hooplus1ce/Qa-Automation-MCP'

If you have feedback or need assistance with the MCP directory API, please join our Discord server