generate_game_inputs
Translate 3D game state into Playwright MCP actions (WASD, mouse-look, clicks) or map world coordinates to screen pixels and back, enabling automated game interactions from spatial data.
Instructions
Generate Playwright MCP automation inputs (WASD, mouse-look, clicks) or project/unproject 3D entity coordinates and screen pixels.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| action | No | Action to perform (default: generate_inputs) | |
| camera | No | Camera state for projection / click-to-move | |
| project | No | Optional project identifier | |
| screen_x | No | Screen pixel X coordinate for screen_to_world unprojection | |
| screen_y | No | Screen pixel Y coordinate for screen_to_world unprojection | |
| viewport | No | Browser viewport dimensions | |
| direction | No | Projection direction for projection mode | |
| entity_id | No | Player or target entity ID | |
| waypoints | No | Optional intermediate navigation waypoints | |
| output_format | No | Output format (default: playwright_mcp) | |
| world_position | No | 3D world position for projection or starting point | |
| control_profile | No | Game control key bindings and physical parameters | |
| target_position | No | Destination 3D coordinates | |
| current_position | No | Starting 3D coordinates (auto-resolved from entity_id if omitted) | |
| ground_elevation | No | Ground plane elevation Y for raycast intercept (default: 0) | |
| target_entity_id | No | Target destination entity ID | |
| current_orientation | No | Starting orientation angles |