orchestrate_session
Execute a timed sequence of browser interactions like clicks, typing, and navigation for testing or demo creation with optional narration and step logging.
Instructions
Execute ordered tap/cursor/keyboard actions. Recording/demoMode: server synthesizes TTS from narration|description, runs the action, holds until VO ends. startMs/endMs are ignored for pacing while recording (placeholders OK). fill=false for live typing. Testing (no recording): startMs/endMs pace the batch; each call clock starts near 0. Optional recordStepsPath writes an MD log. Recording also writes sibling .cues.json.
Example (demo):
{
"sessionId": "sess_01HXYZ",
"commands": [
{
"action": "click",
"description": "Open Settings from the sidebar",
"startMs": 0,
"endMs": 1000,
"selector": "nav >> text=Settings",
"speed": "fast"
},
{
"action": "type",
"description": "Enter the billing search query",
"narration": "Now we search for billing.",
"startMs": 0,
"endMs": 1000,
"selector": "input[type=search]",
"text": "billing",
"fill": false
}
]
}Input Schema
TableJSON Schema
| Name | Required | Description | Default |
|---|---|---|---|
| commands | Yes | ||
| sessionId | Yes | ||
| recordStepsPath | No | If set, write markdown log of commands+results; omit to skip MD |