Method and apparatus to determine focus of attention from video

摘要

A method and system include identifying, by a processing device, at least one media clip captured by at least one camera for an event, detecting at least one human object in the at least one media clip, and calculating, by the processing device, a region in the at least one media clip containing a focus of attention of the detected human object.

主权项

1. A method, comprising:
identifying, by a processing device, at least one media clip representing a scene including a plurality of human objects; determining a respective location and a respective gaze direction associated with each of the plurality of human objects; partitioning the scene into a plurality of cells; calculating a respective viewing cone associated with each of the plurality of human objects based on the respective location and the respective gaze direction, wherein the respective viewing cone overlaps one or more of the plurality of cells; for each cell, determining an accumulated attention value based on viewing cones that overlap a respective cell; and calculating, by the processing device, a region in the at least one media clip containing a focus of attention of the plurality of human objects based on accumulated attention values associated with the plurality of cells.