Skip to main content
Glama

computer

Drive a real web browser with mouse and keyboard actions: click, type, scroll, screenshot, and press keys to complete tasks.

Instructions

Use a mouse and keyboard to interact with a web browser, and take screenshots. If you don't have a valid tab ID, use tabs_context first to get available tabs.

  • Whenever you intend to click on an element like an icon, you should consult a screenshot to determine the coordinates of the element before moving the cursor.

  • If you tried clicking on a program or link but it failed to load, even after waiting, try adjusting your click location so that the tip of the cursor visually falls on the element that you want to click.

  • Make sure to click any buttons, links, icons, etc with the cursor tip in the center of the element. Don't click boxes on their edges unless asked.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
refNoElement reference ID from read_page or find tools (e.g., "ref_1", "ref_2"). Required for `scroll_to` action. Can be used as alternative to `coordinate` for click actions.
textNoThe text to type (for `type` action) or the key(s) to press (for `key` action). For `key` action: Provide space-separated keys (e.g., "Backspace Backspace Delete"). Supports keyboard shortcuts using the platform's modifier key (use "cmd" on Mac, "ctrl" on Windows/Linux, e.g., "cmd+a" or "ctrl+a" for select all).
tabIdYesTab ID to execute the action on. Must be a tab in the current group. Use tabs_context first if you don't have a valid tab ID.
actionYesThe action to perform: * `left_click`: Click the left mouse button at the specified coordinates. * `right_click`: Click the right mouse button at the specified coordinates to open context menus. * `double_click`: Double-click the left mouse button at the specified coordinates. * `triple_click`: Triple-click the left mouse button at the specified coordinates. * `type`: Type a string of text. * `screenshot`: Take a screenshot of the screen. * `wait`: Wait for a specified number of seconds. * `scroll`: Scroll up, down, left, or right at the specified coordinates. * `key`: Press a specific keyboard key. * `left_click_drag`: Drag from start_coordinate to coordinate. * `zoom`: Take a screenshot of a specific region for closer inspection. * `scroll_to`: Scroll an element into view using its element reference ID from read_page or find tools. * `hover`: Move the mouse cursor to the specified coordinates or element without clicking. Useful for revealing tooltips, dropdown menus, or triggering hover states.
regionNo(x0, y0, x1, y1): The rectangular region to capture for `zoom`. Coordinates define a rectangle from top-left (x0, y0) to bottom-right (x1, y1) in pixels from the viewport origin. Required for `zoom` action. Useful for inspecting small UI elements like icons, buttons, or text.
repeatNoNumber of times to repeat the key sequence. Only applicable for `key` action. Must be a positive integer between 1 and 100. Default is 1. Useful for navigation tasks like pressing arrow keys multiple times.
durationNoThe number of seconds to wait. Required for `wait`. Maximum 10 seconds.
modifiersNoModifier keys for click actions. Supports: "ctrl", "shift", "alt", "cmd" (or "meta"), "win" (or "windows"). Can be combined with "+" (e.g., "ctrl+shift", "cmd+alt"). Optional.
coordinateNo(x, y): The x (pixels from the left edge) and y (pixels from the top edge) coordinates. Required for `left_click`, `right_click`, `double_click`, `triple_click`, and `scroll`. For `left_click_drag`, this is the end position.
scroll_amountNoThe number of scroll wheel ticks. Optional for `scroll`, defaults to 3.
scroll_directionNoThe direction to scroll. Required for `scroll`.
start_coordinateNo(x, y): The starting coordinates for `left_click_drag`.

Output Schema

TableJSON Schema
NameRequiredDescriptionDefault
provenanceNo
interactionReceiptNo
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries the burden of behavioral disclosure. It reveals that operations are coordinate-driven and require screenshots for positioning, as seen in the bullet about consulting a screenshot before clicking. It also hints at potential failure and recovery ('try adjusting your click location'). This is useful context, but it doesn't cover other behavioral aspects like how failed actions are returned, whether actions are asynchronous, or any side effects.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is appropriately concise, with a high-level opening sentence followed by three focused bullet points that provide actionable tips. Each sentence earns its place, and the structure makes it easy to scan. It avoids redundancy with the schema.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's complexity (12 parameters, many actions, broad capabilities), the description provides a reasonable overview but leaves several aspects implied rather than explicit. It covers the core interaction pattern and prerequisite (tab ID), but doesn't discuss how to choose among actions or handle different scenarios. The presence of an output schema reduces the need to explain return values, so completeness is adequate but not rich.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so the parameters are already well-documented in the schema. The description adds minimal extra parameter meaning beyond reinforcing the use of tabs_context for tabId and the need for coordinates when clicking. The baseline of 3 applies because the schema does the heavy lifting; the description doesn't need to compensate and doesn't add substantial value.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool's role: using a mouse and keyboard to interact with a web browser and take screenshots. It distinguishes itself from sibling tools like navigate or read_page by focusing on low-level input actions. However, it could be more explicit about the set of actions (click, type, scroll) rather than relying on the schema.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides some guidance on when to use the tool, especially related to handling tab IDs: 'If you don't have a valid tab ID, use tabs_context first'. It also gives practical tips for click accuracy (consulting screenshots, adjusting click position, clicking centers). However, it doesn't explicitly compare to alternatives like act_on or form_fill, so the 'when vs alternatives' aspect is only partially addressed.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Install Server

Other Tools

Latest Blog Posts

MCP directory API

We provide all the information about MCP servers via our MCP API.

curl -X GET 'https://glama.ai/api/mcp/v1/servers/sylin-org/ghostlight'

If you have feedback or need assistance with the MCP directory API, please join our Discord server