look_direction

Instructions

Implementation Reference

• packages/mcp-server/src/tools/inputTools.ts:187-228 (handler)

  Main handler function implementing the look_direction tool. Sends LookLeft or LookRight OSC inputs via WebSocket to turn the avatar's view.

  public async look(
    direction: LookDirection,
    duration: number = 1.0,
    ctx?: ToolContext
  ): Promise<string> {
    if (ctx) {
      await ctx.info(`Looking ${direction} for ${duration} seconds`);
    }
    
    if (direction !== 'left' && direction !== 'right') {
      return `Unknown direction: ${direction}`;
    }
    
    // ボタン入力名を決定
    const inputName = direction === 'left' ? 'LookLeft' : 'LookRight';
    
    try {
      logger.info(`[LOOK] Starting look ${direction} operation, duration: ${duration}s`);
      
      // ボタン入力を実行
      const result = await this.tryButtonLook(inputName, duration);
      
      if (!result.success) {
        return `Failed to look ${direction}: ${result.error}`;
      }
      
      return `Looked ${direction} for ${duration} seconds`;
    } catch (error) {
      const errorMsg = `Error during look ${direction}: ${error instanceof Error ? error.message : String(error)}`;
      logger.error(`[LOOK] ${errorMsg}`);
      
      // 緊急リセット
      try {
        await this.wsClient.sendInput(inputName, 0);
        logger.info(`[LOOK] Emergency reset of look input after error`);
      } catch (resetError) {
        logger.error(`[LOOK] Failed emergency reset: ${resetError instanceof Error ? resetError.message : String(resetError)}`);
      }
      
      return errorMsg;
    }
  }

• packages/mcp-server/src/tools/inputTools.ts:237-291 (helper)

  Supporting helper method that handles the precise sequence of button press, hold, and release for look inputs, including retries and safety resets.

  private async tryButtonLook(
    inputName: string,
    duration: number
  ): Promise<{success: boolean, error?: string}> {
    try {
      // ボタン入力では、まず0（リリース）を送信してから1（プレス）を送信する必要がある
      logger.info(`[LOOK-BUTTON] Initializing button ${inputName}=0`);
      await this.wsClient.sendInput(inputName, 0);
      
      // 少し待機
      await new Promise(r => setTimeout(r, 50));
      
      // ボタンプレスを送信
      logger.info(`[LOOK-BUTTON] Pressing button ${inputName}=1`);
      const pressSuccess = await this.wsClient.sendInput(inputName, 1);
      
      if (!pressSuccess) {
        return {success: false, error: `Failed to press button ${inputName}`};
      }
      
      // 時間待機
      await new Promise(r => setTimeout(r, (duration+2)*100 ));
      
      // ボタンリリースを送信
      logger.info(`[LOOK-BUTTON] Releasing button ${inputName}=0`);
      const releaseSuccess = await this.wsClient.sendInput(inputName, 0);
      
      if (!releaseSuccess) {
        logger.warn(`[LOOK-BUTTON] Failed to release button ${inputName}`);
        // 再試行
        await new Promise(r => setTimeout(r, 100));
        await this.wsClient.sendInput(inputName, 0);
      }
      
      // // 指定された持続時間だけ待機
      // if (duration > 0.2) { // すでに少し待機したので調整
      //   logger.info(`[LOOK-BUTTON] Waiting for remaining duration: ${duration - 0.2} seconds`);
      //   await new Promise(resolve => setTimeout(resolve, (duration - 0.2) * 1000));
      // }
      
      return {success: true};
    } catch (error) {
      const errorMsg = `Error in button look: ${error instanceof Error ? error.message : String(error)}`;
      logger.error(`[LOOK-BUTTON] ${errorMsg}`);
      return {success: false, error: errorMsg};
    } finally {
      // 最終的な安全策として、もう一度入力をリセットする
      try {
        await this.wsClient.sendInput(inputName, 0);
        logger.info(`[LOOK-BUTTON] Final safety reset of ${inputName}`);
      } catch (e) {
        // エラーを無視
      }
    }
  }

• packages/mcp-server/src/server.ts:512-534 (registration)

  MCP server registration of the 'look_direction' tool, including input schema validation with zod and delegation to InputTools.look handler.

  server.tool(
    'look_direction',
    'Turn to look in a specific direction.',
    {
      direction: z.enum(['left', 'right']).describe('Direction to look'),
      duration: z.number().default(1.0).describe('Duration in seconds')
    },
    async ({ direction, duration }, extra) => {
      try {
        const ctx = createToolContext(extra);
        const result = await inputTools.look(direction as LookDirection, duration, ctx);
        return { content: [{ type: 'text', text: result }] };
      } catch (error) {
        return { 
          content: [{ 
            type: 'text', 
            text: `Error looking direction: ${error instanceof Error ? error.message : String(error)}` 
          }],
          isError: true
        };
      }
    }
  );

• packages/types/src/tools.ts:18-18 (schema)

  Type definition for LookDirection used in the tool's input schema.

  export type LookDirection = 'left' | 'right';