MEmoR: A Multimodal Emotion Recognition using affective biomarkers for smart prediction of emotional health for people analytics in smart industries

作者:

Highlights:

• A multimodal approach for emotion classification based on visual-physiological signal.

• Application of transfer learning for visual signals for more accurate and cost-effective computation.

• Identifying discrete emotions as well as valence -arousal affective dimensions of emotion.

• Weighted Late Fusion of visual and physiological signals for accurate prediction of the emotion.

• Extending predictive capabilities for turning digital biomarker and visual signals data into actions.

摘要

•A multimodal approach for emotion classification based on visual-physiological signal.•Application of transfer learning for visual signals for more accurate and cost-effective computation.•Identifying discrete emotions as well as valence -arousal affective dimensions of emotion.•Weighted Late Fusion of visual and physiological signals for accurate prediction of the emotion.•Extending predictive capabilities for turning digital biomarker and visual signals data into actions.

论文关键词:Affective computing,Visual analysis,Multi-model,Emotion recognition,E-IoT,Facial expression analysis

论文评审过程:Received 30 November 2021, Revised 1 April 2022, Accepted 10 May 2022, Available online 15 May 2022, Version of Record 20 May 2022.

论文官网地址:https://doi.org/10.1016/j.imavis.2022.104483