Dipartimento di Ingegneria informatica, automatica e gestionale

Human emotions decoding and assessment is a hot research topic since its implications would be relevant in a huge set of clinical and social applications. Current emotion recognition and evaluation approaches are usually based on interactions between a “patient” and a “specialist”. However, this methodology is intrinsically affected by subjective biases and lack of objectiveness. Recent advancements in neuroscience enable the use of traditional biosensors and maybe commercial wearable devices, which lead to a certain grade of invasiveness for the subject. The proposed study explored an innovative low-invasive hybrid method, based on the use of video data and smart bracelet, to overcome such technological limitations. In particular, we investigated the capability of an Emotional Index (EI), computed by combining the Heart Rate (HR) and the Skin Conductance Level (SCL) estimated through video-based and wearable technology, in discriminating Positive and Negative emotional state during interactive webcalls. The results revealed that the computed EI significantly increased during the Positive condition compared to the Negative one (p = 0.0008) and the Baseline (p = 0.003). Such evidences were confirmed by the subjective data and the classification performance parameters. In this regard, the EI discriminated between two emotional states with an accuracy of 79.4%.