browser_observe
Observe live web tabs to return element refs, viewport content, and diagnostics, enabling agents to query controls and scope searches for page interaction.
Instructions
Observe a live tab and return generation-scoped element refs, on-screen controls first, current viewport content_blocks and measured scroll_containers. Treat auth_state as page evidence for your next decision; a visible login form does not itself stop the run. diagnostics lists page errors and failed requests since your previous result. When the result says elements were not shown, narrow the view instead of reading the DOM with browser_evaluate: query finds controls by their words, within scopes to a region, frame or element, and cursor continues where the last response stopped. Every ref returned is valid for browser_act.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| query | No | Words to find. Returns only controls whose role, label, text, value or option labels contain every word, searched across the whole page, not just what an earlier observation showed. | |
| cursor | No | The next_cursor an earlier observation printed; continues the same ordering. | |
| filter | No | interactive (default) lists controls; all also lists the page's headings; links lists where the page can take you as text and URL, which fits a whole index in one answer. query applies to links too and matches the URL, so filter:'links' with query:'/jobs/' returns that section of the site. Every ref is still clickable. | |
| tab_id | Yes | ||
| within | No | Scope to one region id (r…) or frame id (f…) from an earlier observation, or to an element ref (e.g. a dialog, listbox or form) and its descendants. |