System And Method For Processing User Interaction Information From Multiple Media Sources

摘要

A system and method for processing data on user interactions with a workstation. The system comprises an information system that includes a data storage device. An audio microphone capable of capturing workstation user voice data is linked to the information system. An eye-tracking device capable of capturing workstation user eye-movement data is linked to the information system. A display screen capture routine capable of capturing video display data from a workstation display is linked to the information system. A user input capture routine capable of capturing input data entered into the workstation by the workstation user is linked to the information system. The voice data, eye-movement data, video display data and input data for the workstation user are captured simultaneously and the data are recorded on the data storage device with time information that allows synchronization of the data.