Skip to main content
Glama

Run pan, fling, swipe, pinch, rotate, transform, tap, or drag gestures

gesture
Destructive

Execute structured touch actions—pan, fling, swipe, pinch, rotate, tap, or drag—on mobile, desktop, and TV apps to automate complex UI interactions.

Instructions

Perform a structured pan, fling, swipe, pinch, rotate, transform, tap, or drag gesture. Each gesture kind has its own inputs. A tap touches 2 to 5 points at once; count and pauseMs control repetition. A drag takes a source and a destination ref or selector and holds the source down for 800 ms by default before carrying it over, which is how a list item changes position or a drop target is hit. Times out after 90s.

Tool call template

Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.

{
  "id": 1,
  "jsonrpc": "2.0",
  "method": "tools/call",
  "params": {
    "arguments": {
      "kind": "<kind>"
    },
    "name": "gesture"
  }
}

Input Schema

NameRequiredDescriptionDefault
kindYesGesture variant.
udidNoApple device or simulator UDID.
countNoTap repetitions; the same contacts run this many times.
deltaNoMovement delta for pan or transform gestures.
scaleNoPinch or transform scale.
deviceNoDevice name; ids go in udid or serial.
holdMsNoTap contact hold duration.
moveMsNoDrag movement duration.
originNoGesture origin point.
pointsNoTap contact points, held together for holdMs.
presetNoSwipe preset.
serialNoAndroid, HarmonyOS, or Vega VVD serial.
sourceNoDrag source @ref or selector.
degreesNoRotation in degrees.
pauseMsNoDelay between tap repetitions, added to each repetition’s own time.
sessionNoSession name.
distanceNoFling distance.
noRecordNoDo not record this action.
platformNoDevice platform.
directionNoFling direction.
durationMsNoPan/transform duration.
destinationNoDrag destination @ref or selector.
deviceTargetNoDevice form factor.
pointerCountNoPan touch pointer count (1 or 2).
sourceHoldMsNoDrag activation hold duration.
destinationHoldMsNoHold before releasing at the destination.

Schema Changelog

Changes observed during successful MCP inspections.

  1. Changed5 schema fields changedv0.21.38
    • removedInput schema / properties / debug
      Removed value: -{
      -  "description": "Enable debug diagnostics.",
      -  "type": "boolean"
      -}
    • removedInput schema / properties / includeCost
      Removed value: -{
      -  "description": "Add agent cost (cost.wallClockMs, …) to the result, returned as JSON text.",
      -  "type": "boolean"
      -}
    • removedInput schema / properties / mcpOutputFormat
      Removed value: -{
      -  "description": "Result text: compact optimized (default) or the full result as JSON (larger).",
      -  "enum": [
      -    "optimized",
      -    "json"
      -  ],
      -  "type": "string"
      -}
    • removedInput schema / properties / responseLevel
      Removed value: -{
      -  "description": "Result detail: digest (smallest) or full (largest), as JSON; default is compact text.",
      -  "enum": [
      -    "digest",
      -    "default",
      -    "full"
      -  ],
      -  "type": "string"
      -}
    • removedInput schema / properties / target
      Removed value: -{
      -  "description": "Alias for deviceTarget.",
      -  "enum": [
      -    "mobile",
      -    "tv",
      -    "desktop"
      -  ],
      -  "type": "string"
      -}
  2. Changed14 schema fields changedv0.21.37
    • removedInput schema / properties / androidDeviceAllowlist
      Removed value: -{
      -  "description": "Android serial allowlist used for device resolution.",
      -  "type": "string"
      -}
    • changedInput schema / properties / device / description
      Previous value: -"Device name selector (a UDID belongs in udid, a serial in serial)."New value: +"Device name; ids go in udid or serial."
    • changedInput schema / properties / deviceTarget / description
      Previous value: -"Device target form. Maps to the CLI --target flag."New value: +"Device form factor."
    • changedInput schema / properties / includeCost / description
      Previous value: -"Include per-command agent-cost (cost.wallClockMs, …) in structuredContent. Defaults to off; the default response shape is unchanged."New value: +"Add agent cost (cost.wallClockMs, …) to the result, returned as JSON text."
    • removedInput schema / properties / leaseId
      Removed value: -{
      -  "description": "Existing lease identifier.",
      -  "type": "string"
      -}
    • changedInput schema / properties / mcpOutputFormat / description
      Previous value: -"MCP text content format. Defaults to optimized agent-friendly text; use json for JSON text. Structured content is always returned separately."New value: +"Result text: compact optimized (default) or the full result as JSON (larger)."
    • changedInput schema / properties / platform / description
      Previous value: -"Platform selector used to resolve a device."New value: +"Device platform."
    • changedInput schema / properties / responseLevel / description
      Previous value: -"Response verbosity: token-cheap digest / default (today) / full. Defaults to default; the default response shape is unchanged."New value: +"Result detail: digest (smallest) or full (largest), as JSON; default is compact text."
    • removedInput schema / properties / runId
      Removed value: -{
      -  "description": "Lease run identifier.",
      -  "type": "string"
      -}
    • changedInput schema / properties / serial / description
      Previous value: -"Android, HarmonyOS, or Vega VVD serial selector."New value: +"Android, HarmonyOS, or Vega VVD serial."
    • changedInput schema / properties / session / description
      Previous value: -"Agent-device session name."New value: +"Session name."
    • changedInput schema / properties / target / description
      Previous value: -"Alias for deviceTarget on commands without a UI target field. Interaction commands reserve target for the UI element."New value: +"Alias for deviceTarget."
    • removedInput schema / properties / tenant
      Removed value: -{
      -  "description": "Remote tenant identifier.",
      -  "type": "string"
      -}
    • changedInput schema / properties / udid / description
      Previous value: -"Apple device or simulator UDID; the selector that pins one device when several share a name."New value: +"Apple device or simulator UDID."
  3. Changed5 schema fields changedv0.21.29
    • addedInput schema / properties / count
      Added value: +{
      +  "description": "Tap repetitions; the same contacts run this many times.",
      +  "maximum": 200,
      +  "minimum": 1,
      +  "type": "integer"
      +}
    • addedInput schema / properties / holdMs
      Added value: +{
      +  "description": "Tap contact hold duration.",
      +  "maximum": 10000,
      +  "minimum": 16,
      +  "type": "integer"
      +}
    • changedInput schema / properties / kind / enum
      Previous value: -[
      -  "pan",
      -  "fling",
      -  "swipe",
      -  "pinch",
      -  "rotate",
      -  "transform",
      -  "drag"
      -]New value: +[
      +  "pan",
      +  "fling",
      +  "swipe",
      +  "pinch",
      +  "rotate",
      +  "transform",
      +  "tap",
      +  "drag"
      +]
    • addedInput schema / properties / pauseMs
      Added value: +{
      +  "description": "Delay between tap repetitions, added to each repetition’s own time.",
      +  "maximum": 10000,
      +  "minimum": 0,
      +  "type": "integer"
      +}
    • addedInput schema / properties / points
      Added value: +{
      +  "description": "Tap contact points, held together for holdMs.",
      +  "items": {
      +    "additionalProperties": false,
      +    "description": "One contact point.",
      +    "properties": {
      +      "x": {
      +        "type": "number"
      +      },
      +      "y": {
      +        "type": "number"
      +      }
      +    },
      +    "required": [
      +      "x",
      +      "y"
      +    ],
      +    "type": "object"
      +  },
      +  "maxItems": 5,
      +  "minItems": 2,
      +  "type": "array"
      +}
  4. Changed3 schema fields changedv0.21.0
    • changedInput schema / properties / device / description
      Previous value: -"Device name selector."New value: +"Device name selector (a UDID belongs in udid, a serial in serial)."
    • changedInput schema / properties / serial / description
      Previous value: -"Android device or Vega VVD serial selector."New value: +"Android, HarmonyOS, or Vega VVD serial selector."
    • changedInput schema / properties / udid / description
      Previous value: -"iOS device UDID selector."New value: +"Apple device or simulator UDID; the selector that pins one device when several share a name."
  5. Changed8 schema fields changedv0.20.10
    • removedInput schema / properties / cwd
      Removed value: -{
      -  "description": "Working directory for command execution.",
      -  "type": "string"
      -}
    • removedInput schema / properties / daemonAuthToken
      Removed value: -{
      -  "description": "Remote daemon auth token.",
      -  "type": "string"
      -}
    • removedInput schema / properties / daemonBaseUrl
      Removed value: -{
      -  "description": "Remote daemon base URL.",
      -  "type": "string"
      -}
    • removedInput schema / properties / iosSimulatorDeviceSet
      Removed value: -{
      -  "description": "iOS simulator device-set path used for device resolution.",
      -  "type": "string"
      -}
    • removedInput schema / properties / iosXctestDerivedDataPath
      Removed value: -{
      -  "description": "Derived data path for external iOS XCTest runner execution.",
      -  "type": "string"
      -}
    • removedInput schema / properties / iosXctestEnvDir
      Removed value: -{
      -  "description": "Writable directory for iOS XCTest runner env overlays.",
      -  "type": "string"
      -}
    • removedInput schema / properties / iosXctestrunFile
      Removed value: -{
      -  "description": "Externally built iOS XCTest runner .xctestrun artifact path.",
      -  "type": "string"
      -}
    • removedInput schema / properties / stateDir
      Removed value: -{
      -  "description": "Agent-device state directory.",
      -  "type": "string"
      -}
  6. Changed1 schema field changedv0.20.9
    • changedInput schema / properties / platform / enum
      Previous value: -[
      -  "apple",
      -  "android",
      -  "vega",
      -  "linux",
      -  "web",
      -  "ios",
      -  "macos"
      -]New value: +[
      +  "apple",
      +  "android",
      +  "harmonyos",
      +  "vega",
      +  "linux",
      +  "web",
      +  "ios",
      +  "macos"
      +]
  7. Changed6 schema fields changedv0.20.6
    • addedInput schema / properties / destination
      Added value: +{
      +  "description": "Drag destination @ref or selector.",
      +  "type": "string"
      +}
    • addedInput schema / properties / destinationHoldMs
      Added value: +{
      +  "description": "Hold before releasing at the destination.",
      +  "maximum": 10000,
      +  "minimum": 0,
      +  "type": "integer"
      +}
    • changedInput schema / properties / kind / enum
      Previous value: -[
      -  "pan",
      -  "fling",
      -  "swipe",
      -  "pinch",
      -  "rotate",
      -  "transform"
      -]New value: +[
      +  "pan",
      +  "fling",
      +  "swipe",
      +  "pinch",
      +  "rotate",
      +  "transform",
      +  "drag"
      +]
    • addedInput schema / properties / moveMs
      Added value: +{
      +  "description": "Drag movement duration.",
      +  "maximum": 10000,
      +  "minimum": 16,
      +  "type": "integer"
      +}
    • addedInput schema / properties / source
      Added value: +{
      +  "description": "Drag source @ref or selector.",
      +  "type": "string"
      +}
    • addedInput schema / properties / sourceHoldMs
      Added value: +{
      +  "description": "Drag activation hold duration.",
      +  "maximum": 10000,
      +  "minimum": 1,
      +  "type": "integer"
      +}
  8. Changed8 schema fields changedv0.20.2
    • changedInput schema / properties / durationMs / description
      Previous value: -"Gesture duration in milliseconds."New value: +"Pan/transform duration."
    • addedInput schema / properties / durationMs / maximum
      Added value: +10000
    • changedInput schema / properties / durationMs / minimum
      Previous value: -0New value: +16
    • addedInput schema / properties / noRecord
      Added value: +{
      +  "description": "Do not record this action.",
      +  "type": "boolean"
      +}
    • changedInput schema / properties / platform / enum
      Previous value: -[
      -  "apple",
      -  "android",
      -  "linux",
      -  "web",
      -  "ios",
      -  "macos"
      -]New value: +[
      +  "apple",
      +  "android",
      +  "vega",
      +  "linux",
      +  "web",
      +  "ios",
      +  "macos"
      +]
    • addedInput schema / properties / pointerCount
      Added value: +{
      +  "description": "Pan touch pointer count (1 or 2).",
      +  "maximum": 2,
      +  "minimum": 1,
      +  "type": "integer"
      +}
    • changedInput schema / properties / serial / description
      Previous value: -"Android serial selector."New value: +"Android device or Vega VVD serial selector."
    • removedInput schema / properties / velocity
      Removed value: -{
      -  "description": "Rotate gesture velocity.",
      -  "minimum": 0,
      -  "type": "integer"
      -}
  9. Changed3 schema fields changedv0.17.11
    • addedInput schema / properties / includeCost
      Added value: +{
      +  "description": "Include per-command agent-cost (cost.wallClockMs, …) in structuredContent. Defaults to off; the default response shape is unchanged.",
      +  "type": "boolean"
      +}
    • changedInput schema / properties / platform / enum
      Previous value: -[
      -  "ios",
      -  "macos",
      -  "android",
      -  "linux",
      -  "web",
      -  "apple"
      -]New value: +[
      +  "apple",
      +  "android",
      +  "linux",
      +  "web",
      +  "ios",
      +  "macos"
      +]
    • addedInput schema / properties / responseLevel
      Added value: +{
      +  "description": "Response verbosity: token-cheap digest / default (today) / full. Defaults to default; the default response shape is unchanged.",
      +  "enum": [
      +    "digest",
      +    "default",
      +    "full"
      +  ],
      +  "type": "string"
      +}
  10. Changed1 schema field changedv0.17.7
    • changedInput schema / properties / platform / enum
      Previous value: -[
      -  "ios",
      -  "macos",
      -  "android",
      -  "linux",
      -  "apple"
      -]New value: +[
      +  "ios",
      +  "macos",
      +  "android",
      +  "linux",
      +  "web",
      +  "apple"
      +]
  11. Changed5 schema fields changedv0.17.6
    • addedInput schema / properties / iosXctestDerivedDataPath
      Added value: +{
      +  "description": "Derived data path for external iOS XCTest runner execution.",
      +  "type": "string"
      +}
    • addedInput schema / properties / iosXctestEnvDir
      Added value: +{
      +  "description": "Writable directory for iOS XCTest runner env overlays.",
      +  "type": "string"
      +}
    • addedInput schema / properties / iosXctestrunFile
      Added value: +{
      +  "description": "Externally built iOS XCTest runner .xctestrun artifact path.",
      +  "type": "string"
      +}
    • addedInput schema / properties / mcpOutputFormat
      Added value: +{
      +  "description": "MCP text content format. Defaults to optimized agent-friendly text; use json for JSON text. Structured content is always returned separately.",
      +  "enum": [
      +    "optimized",
      +    "json"
      +  ],
      +  "type": "string"
      +}
    • changedInput schema / properties / platform / enum
      Previous value: -[
      -  "ios",
      -  "android",
      -  "macos",
      -  "linux",
      -  "apple"
      -]New value: +[
      +  "ios",
      +  "macos",
      +  "android",
      +  "linux",
      +  "apple"
      +]
  12. First observedv0.16.9

TDQS

A3.6/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=false and destructiveHint=true, so the mutation profile is covered structurally. The description adds real behavioral detail beyond that: a 90s timeout, an 800ms default source hold before carrying a drag, and the 2-to-5 simultaneous contact model for taps. It does not describe how the 800ms hold interacts with the sourceHoldMs parameter or what failure looks like on timeout.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Four sentences, front-loaded with the core action and the kind list, then drilling into the two most complex variants. The kind enumeration in the first sentence partly duplicates the enum in the schema, but the rest of the prose is dense and earns its place.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

This is a high-complexity tool — 26 parameters, eight variants, nested point objects, no output schema — and the description only details two of the variants (tap and drag). The timeout is a useful addition, but an agent still learns nothing about how pan, fling, pinch, rotate, or transform behave or return, relying on the fully populated schema to fill the gap.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so the baseline is 3. The description does add some meaning beyond the schema — the 800ms default for source hold and the fact that count/pauseMs repeat the same contacts — but it leaves the majority of the 26 parameters (delta, scale, degrees, distance, direction, pointerCount) to the schema alone.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description opens with a specific verb ('Perform') and enumerates the eight supported gesture kinds, so an agent knows exactly which resource is being acted on. It does not, however, distinguish itself from the sibling 'swipe' tool or explain why to pick this composite tool over that one.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

It gives one concrete usage scenario — drag 'is how a list item changes position or a drop target is hit' — and explains repetition for tap, which is genuine when-to-use context. It offers no when-not-to-use guidance and never routes the agent between this tool and the sibling 'swipe', 'click', or 'find' tools, leaving selection largely to inference.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.