Electronic device and method for controlling display of electronic files

摘要

An electronic device displays electronic files on a display device. When a user views the electronic device, a video camera captures a real-time video consisting of a plurality of frames of the user. The electronic device recognizes a face region in each frame and a lip outline in the face region of the frame, and generates a lip shape variation video of a lip of the user according to the lip outline in each frame and a capturing time of each frame. Furthermore, the electronic device searches a preset lip-language video that are pre-stored in a storage device and matches the lip shape variation video, and controls display of the electronic files by executing an voice command associated with the matched preset lip-language video.

主权项

1. A method being executed by a processor of an electronic device for controlling display of electronic files displayed on a display device of the electronic device, the method comprising:
using a video camera to capture a real-time video consisting of a plurality of frames of a user of the electronic device; recognizing a face region of the user in each frame and a lip outline in the face region of the frame, and generating a lip shape variation video of a lip of the user according to the lip outline in each frame and a capturing time of each frame; determining a first characteristic matrix of each of the preset lip-language videos, and determining a second characteristic matrix of the lip shape variation video; searching a preset lip-language video in a storage device that matches the lip shape variation video by comparing the second characteristic matrix with the first characteristic matrices of the preset lip-language videos; and controlling display of the electronic files on the display device by executing a voice command associated with the matched preset lip-language video.