Label interactive elements (set-of-mark)
label_interactivesPaint numbered badges on all interactive elements in a webpage and return a legend mapping each number to a unique selector and accessible label, enabling targeted actions on specific elements.
Instructions
Set-of-mark prompting: paints a numbered badge over every interactive element in the viewport — links, buttons, inputs, selects, ARIA widgets, anything with a pointer cursor — and returns the marked screenshot plus a legend mapping each number to a stable, unique selector and its accessible label. Pick your target off the picture by number, then act on its exact selector with interact_and_audit. The overlay is removed after capture.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | Absolute URL to open, e.g. http://localhost:5173. | |
| reload | No | Reload even if the URL is already open (default reuses it, so it can be stale after an edit). | |
| viewport | No | Switch to this breakpoint first. Default: keep the current one. |