android-ui

Execute UI actions on Android devices such as tapping, swiping, inputting text, pressing keys, or launching intents using coordinates, text, keycodes, or package details.

Instructions

Perform various UI interaction operations on an Android device.

Args: ctx: MCP Context. serial: Device serial number. action: The UI action to perform. x: X coordinate (for tap). y: Y coordinate (for tap). start_x: Starting X coordinate (for swipe). start_y: Starting Y coordinate (for swipe). end_x: Ending X coordinate (for swipe). end_y: Ending Y coordinate (for swipe). duration_ms: Duration of the swipe in milliseconds (default: 300). text: Text to input (for input_text). keycode: Android keycode to press (for press_key). package: Package name (for start_intent). activity: Activity name (for start_intent). extras: Optional intent extras (for start_intent).

Returns: A string message indicating the result of the operation.

Input Schema

Name	Required	Description	Default
`action`	Yes
`activity`	No
`duration_ms`	No
`end_x`	No
`end_y`	No
`extras`	No
`keycode`	No
`package`	No
`serial`	Yes
`start_x`	No
`start_y`	No
`text`	No
`x`	No
`y`	No

Input Schema (JSON Schema)

{
  "$defs": {
    "UIAction": {
      "description": "Actions available for UI automation.",
      "enum": [
        "tap",
        "swipe",
        "input_text",
        "press_key",
        "start_intent"
      ],
      "title": "UIAction",
      "type": "string"
    }
  },
  "properties": {
    "action": {
      "$ref": "#/$defs/UIAction"
    },
    "activity": {
      "anyOf": [
        {
          "type": "string"
        },
        {
          "type": "null"
        }
      ],
      "default": null,
      "title": "Activity"
    },
    "duration_ms": {
      "default": 300,
      "title": "Duration Ms",
      "type": "integer"
    },
    "end_x": {
      "anyOf": [
        {
          "type": "integer"
        },
        {
          "type": "null"
        }
      ],
      "default": null,
      "title": "End X"
    },
    "end_y": {
      "anyOf": [
        {
          "type": "integer"
        },
        {
          "type": "null"
        }
      ],
      "default": null,
      "title": "End Y"
    },
    "extras": {
      "anyOf": [
        {
          "additionalProperties": {
            "type": "string"
          },
          "type": "object"
        },
        {
          "type": "null"
        }
      ],
      "default": null,
      "title": "Extras"
    },
    "keycode": {
      "anyOf": [
        {
          "type": "integer"
        },
        {
          "type": "null"
        }
      ],
      "default": null,
      "title": "Keycode"
    },
    "package": {
      "anyOf": [
        {
          "type": "string"
        },
        {
          "type": "null"
        }
      ],
      "default": null,
      "title": "Package"
    },
    "serial": {
      "title": "Serial",
      "type": "string"
    },
    "start_x": {
      "anyOf": [
        {
          "type": "integer"
        },
        {
          "type": "null"
        }
      ],
      "default": null,
      "title": "Start X"
    },
    "start_y": {
      "anyOf": [
        {
          "type": "integer"
        },
        {
          "type": "null"
        }
      ],
      "default": null,
      "title": "Start Y"
    },
    "text": {
      "anyOf": [
        {
          "type": "string"
        },
        {
          "type": "null"
        }
      ],
      "default": null,
      "title": "Text"
    },
    "x": {
      "anyOf": [
        {
          "type": "integer"
        },
        {
          "type": "null"
        }
      ],
      "default": null,
      "title": "X"
    },
    "y": {
      "anyOf": [
        {
          "type": "integer"
        },
        {
          "type": "null"
        }
      ],
      "default": null,
      "title": "Y"
    }
  },
  "required": [
    "serial",
    "action"
  ],
  "title": "android_uiArguments",
  "type": "object"
}

DroidMind

android-ui

Instructions

Input Schema

Input Schema (JSON Schema)

Other Tools from DroidMind

Related Tools

MCP directory API