Sporadic collection of mobile affect data

摘要

A user may react to an interaction by exhibiting a mental state. A camera or other monitoring device can be used to capture one or more manifestations of the user's mental state, such as facial expressions, electrodermal activity, or movements. However, there may be conditions where the monitoring device is not able to detect the manifestation continually. Thus, various capabilities and implementations are described where the mental state data is collected on an intermittent basis, analyzed, and an output rendered based on the analysis of the mental state data.

主权项

1. A computer-implemented method for mental state analysis comprising:
collecting mental state data of an individual on an intermittent basis; collecting other mental state data, including electrodermal activity data, from the individual on a continuous basis; obtaining analysis of the mental state data on the individual, as a result of sending a request to a web service for the analysis where the analysis of the mental state data is received from the web service; interpolating, using one or more processors, mental state analysis in between the collecting which is intermittent; imputing additional mental state data where the mental state data is missing; filtering out faces of one or more other people to determine when an individual is looking in a direction of a camera; determining contextual information based on accelerometer data; and rendering an output based on the analysis of the mental state data.