发明名称 Automatic analysis of rapport
摘要 In selected embodiments, one or more wearable mobile devices provide videos and other sensor data of one or more participants in an interaction, such as a customer service or a sales interaction between a company employee and a customer. A computerized system uses machine learning expression classifiers, temporal filters, and a machine learning function approximator to estimate the quality of the interaction. The computerized system may include a recommendation selector configured to select suggestions for improving the current interaction and/or future interactions, based on the quality estimates and the weights of the machine learning approximator.
申请公布号 US9202110(B2) 申请公布日期 2015.12.01
申请号 US201414185918 申请日期 2014.02.20
申请人 Emotient, Inc. 发明人 Movellan Javier;Bartlett Marian Steward;Fasel Ian;Littlewort Gwen Ford;Susskind Joshua;Whitehill Jacob
分类号 G06K9/62;G06K9/00 主分类号 G06K9/62
代理机构 Acuity Law Group, P.C. 代理人 Acuity Law Group, P.C. ;Chambers Daniel M.
主权项 1. A computer system for estimating quality of an interaction between a first participant and a second participant, the system comprising: a first plurality of machine learning classifiers of extended facial expressions, each classifier of the first plurality of classifiers being configured to generate a stream of first estimates of the degree to which a predetermined emotion or affective state corresponding to said each classifier of the first plurality of classifiers is present in a data stream of the first participant; a second plurality of machine learning classifiers of extended facial expressions, each classifier of the second plurality of classifiers being configured to generate a stream of second estimates of the degree to which a predetermined emotion or affective state corresponding to said each classifier of the second plurality of classifiers is present in a data stream of the second participant, wherein the first and second data streams are synchronized; a first plurality of temporal filters, each filter of the first plurality of temporal filters comprising an input connected to receive output of an associated classifier of the first plurality of classifiers, and an output; a second plurality of temporal filters, each filter of the second plurality of temporal filters comprising an input connected to receive output of an associated classifier of the second plurality of classifiers, and an output; a plurality of correlators configured to receive output signals from the first and second pluralities of temporal filters and to identify correlation patterns in the output signals of the first and second pluralities of temporal filters; and a function approximator configured to receive at least some of output signals of the plurality of correlators, the output signals of the first plurality of temporal filters, and the output signals of the second plurality of temporal filters, the function approximator being machine trained to generate one or more estimates of quality of the interaction between the first participant and the second participant based on at least some of the output signals of the plurality of correlators, the output signals of the first plurality of temporal filters, and the output signals of the second plurality of temporal filters; and a recommendation selector coupled to the function approximator to receive from the function approximator the one or more estimates and machine learning weights of the function approximator, the recommendation selector being configured to generate one or more suggestions regarding the interaction.
地址 San Diego CA US