locate
Find UI elements on a webpage by describing them in natural language. This tool enables AI to perform visual browser automation.
Instructions
Locate UI element by natural language description (browser driver only)
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"session_id": "<session_id>",
"driver": "<driver>",
"description": "<description>"
},
"name": "locate"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| driver | Yes | Driver alias (must be browser) | |
| session_id | Yes | Session ID | |
| description | Yes | Natural language description of element (e.g., 'the blue Submit button') |