EMOTION FEEDBACK BASED TRAINING AND PERSONALIZATION SYSTEM FOR AIDING USER PERFORMANCE IN INTERACTIVE PRESENTATIONS

摘要

The present invention relates to a system and method for implementing an assistive emotional companion for a user, wherein the system is designed for capturing emotional as well as performance feedback of a participant participating in an interactive session either with a system or with a presenter participant and utilizing such feedback to adaptively customize subsequent parts of the interactive session in an iterative manner. The interactive presentation can either be a live person talking and/or presenting in person, or a streaming video in an interactive chat session, and an interactive session can be a video gaming activity, an interactive simulation, an entertainment software, an adaptive education training system, or the like. The physiological responses measured will be a combination of facial expression analysis, and voice expression analysis. Optionally, other signals such as camera based heart rate and/or touch based skin conductance may be included in certain embodiments.

主权项

1. A system that can act as an assistive emotion companion for a user wherein the system is designed for capturing emotional as well as performance feedback of first participant participating in an interactive session either with a system or a second presenter participant, and utilizing such feedback to adaptively customize subsequent parts of the interactive session in an iterative manner, wherein said system comprises of emotional feedback tracking module, a feedback analysis module, an adaptive presentation configuration module where in the system is configured to:
receive one or more emotional signals from said at least one participant participating in said interactive presentation/interactive session based on one or more physiological responses for tracking emotion and cognition; receive the physiological response from at least one or a plurality of devices attached to an interactive device system to capture the emotional signals in a consistent manner; dynamically identify and label said at least one participant as a presenter or as a viewer based on the function performed by said at least one participant; divide said interactive presentation/interactive session into sub-sessions; analyze the physiological responses to determine the emotional feedback analysis report by considering said interactive session and/or sub-sessions; integrate a machine learning model with said system to enhance the subsequent portions of the interactive presentation/interactive session that is deployed through the machine learning model; and provide the emotional feedback analysis report as a feedback for a decision-making activity associated with said at least one interactive presentation/interactive session to customize and enhance the subsequent portions of the interactive session/interactive presentation for the first user.