Turkish Journal of Computer and Mathematics Education
Journal license

Journal

Turkish Journal of Computer and Mathematics Education


Volume
& Issue

Volume 11, Issue 3


Published
on


Pages

2001-2009


DOI

Article

A Transfer Learning -based Approach for Multimodal Emotion Recognition

Check for updates


Authors

Ayushi Jain Affiliation:
Department of Comp. Sc. & Info. Tech., Graphic Era Hill University, Dehradun, Uttarakhand, India 248002


Abstract

The topic of multimodal emotion recognition is one that is expanding at a rapid rate. The goal of this field is to identify and comprehend human emotions through the use of many modalities, such as speech, facial expressions, and physiological data. Transfer learning strategies have been found to be successful in overcoming the issues of processing and integrating material from a variety of modalities, as demonstrated by the findings of a number of studies. For testing multimodal emotion detection models, it is helpful to make use of publicly accessible datasets like IEMOCAP, EmoReact, and AffectNet. They provide useful resources. Data variability, data quality, modality integration, limited labelled data, privacy and ethical issues, and interpretability are only few of the hurdles that must be overcome in order to construct accurate and effective models. In order to address these challenges, a multidisciplinary approach must be taken, and research must continue to be conducted in this area. The goal of this research is to develop more robust and accurate models for multimodal emotion recognition that can be applied across a variety of contexts and populations.


Keywords

Transfer learning, multimodal emotion recognition, speech, facial expressions, interpretability


Citation

Jain, A. (2020). A transfer learning -based approach for multimodal emotion recognition. Turkish Journal of Computer and Mathematics Education, 11(3), 2001–2009. https://doi.org/10.17762/turcomat.v11i3.13597

Published by: Engineering Journals

Engineering Journals Logo