Image analysis and communication device control technology

摘要

Techniques are described for controlling communication devices using image analysis. For instance, when a communication is received by a communication device, the communication device outputs an alert to notify users of the received communication and accesses one or more images of an area proximate to the communication device. The one or more images cover an area proximate to the communication device at a time during which the communication device is outputting the alert. The communication device analyzes the one or more images to determine whether a user is present in the one or more images and in a position to perceive the received communication. The communication device handles at least one aspect of the received communication based on the determination of whether a user is in a position to perceive the received communication.

主权项

1. A smart phone comprising:
a speaker configured to provide audible output; a display screen configured to provide display output; an image capture device configured to capture images of an area in front of the display screen such that the image capture device is oriented to capture images of an area in which a user is in position to perceive the display screen; and at least one processor configured to control operation of the speaker, the display screen, and the image capture device, the at least one processor being configured to perform operations comprising:
controlling the speaker to initiate audible output and controlling the display screen to initiate visual output associated with the audible output from the speaker;while providing the audible output through the speaker and the visual output through the display screen:
controlling the image capture device to capture one or more images of the area in front of the display screen;analyzing the one or more images for a user in a position in front of the display screen;based on the analysis of the one or more images for a user in a position in front of the display screen, detecting a person within the one or more images of the area in front of the display screen;based on detecting the person in the one or more images of the area in front of the display screen, analyzing the one or more images of the area in front of the display screen to determine whether the person is looking at the display screen;based on the analysis of the one or more images of the area in front of the display screen to determine whether the person is looking at the display screen, determining whether the person is looking at the display screen; andautomatically, without human intervention, controlling further handling of the audible output through the speaker and the visual output through the display screen in accordance with the determination of whether the person is looking at the display screen, wherein automatically, without human intervention, controlling further handling of the audible output through the speaker and the visual output through the display screen in accordance with the determination of whether the person is looking at the display screen comprises, in response to a determination that the person is not looking at the display screen, automatically, without human intervention, adjusting the audible output through the speaker and the visual output through the display screen in a manner suitable for a person that is not looking at the display screen.