Mobile terminal and method of controlling operation thereof

摘要

A mobile terminal and a method of controlling an operation thereof are disclosed. In the method of controlling the operation of the mobile terminal, the mobile terminal is communicatively with a head mounted display for displaying an augmented reality (AR) screen obtained by combining a virtual image with a real environment. If image data acquired through a camera is analyzed and a predetermined gesture input is detected, the head mounted display is controlled such that a display change corresponding to the detected gesture input is displayed on the AR screen. In a state of displaying the AR screen through the head mounted display, various operations related to the mobile terminal can be controlled according to the predetermined gesture input.

主权项

1. A method of controlling an operation of a mobile terminal, the method comprising:
communicatively connecting the mobile terminal with a head mounted display for displaying an augmented reality (AR) screen; receiving first data from the head mounted display, the received first data includes gesture input data acquired by a first camera at the head mounted display and image data of an image corresponding to an environment acquired by the first camera; receiving second data from the head mounted display, the received second data includes image data acquired by a second camera at the head mounted display; analyzing the first and second data; determining a predetermined gesture based on the analyzed first data and determining an eye position of a user based on the analyzed second data; and controlling the head mounted display to display an indicator corresponding to a shape of the determined gesture on the AR screen, wherein the indicator is displayed at the determined eye position of the user, and wherein the controlling of the head mounted display includes controlling the head mounted display to display a closed curve region on the AR screen when the predetermined gesture is determined to correspond to a closed curve gesture.