63,083 Hits in 3.8 sec

Human Affect Recognition System based on Survey of Recent Approaches

Shweta Malwatkar, Rekha Sugandhi, Anjali R.
2017 International Journal of Computer Applications  
This paper also presents some basic classifiers such as SVM, ANN, KNN and HMM, used for emotion classification and audiovisual databases with their emotion categories.  ...  Such emotion recognition system involves three main steps: face detection, feature extraction and facial expression classification.  ...  Now for actual affect recognition, test video is provided as input. Again for this test video, concept map is generated. This concept map of test video is classified against trained concept map.  ... 
doi:10.5120/ijca2017912801 fatcat:jrhrct5plrerfebczu45owjm5m

End-to-end Multimodal Emotion and Gender Recognition with Dynamic Joint Loss Weights [article]

Myungsu Chae, Tae-Ho Kim, Young Hoon Shin, June-Woo Kim, Soo-Young Lee
2018 arXiv   pre-print
We apply this method to design an end-to-end multimodal emotion and gender recognition model using audio and video data.  ...  In our experiments, emotion and gender recognition with the proposed method yielded a lower joint loss, which is computed as the negative log-likelihood, than using static weights for joint loss.  ...  emotion recognition.  ... 
arXiv:1809.00758v3 fatcat:wrklbq4dzfeijd3m26ddiam7f4

Accessing movies based on emotional impact

Eva Oliveira, Pedro Martins, Teresa Chambel
2013 Multimedia Systems  
in manual labeling from users, is revealing new ways for exploring emotional information in videos, films or TV series, and brings out new perspectives to enrich and personalize video access.  ...  In addition, the improvement of new techniques for gathering emotional information about videos, both through content analysis or user implicit feedback through user physiological signals complemented  ...  Some of the future features include: extending the concept of video summaries to present movies in chosen emotional perspectives and preferences, with more criteria other then selecting scenes with one  ... 
doi:10.1007/s00530-013-0303-7 fatcat:c4ungddd2fd53mb6v5twovxacq

Interpretability for Multimodal Emotion Recognition using Concept Activation Vectors [article]

Ashish Ramayee Asokan, Nidarshan Kumar, Anirudh Venkata Ragam, Shylaja S Sharath
2022 arXiv   pre-print
Multimodal Emotion Recognition refers to the classification of input video sequences into emotion labels based on multiple input modalities (usually video, audio and text).  ...  In this paper, we address the issue of interpretability for neural networks in the context of emotion recognition using Concept Activation Vectors (CAVs).  ...  concepts used to interpret multimodal emotion recognition models with TCAV.  ... 
arXiv:2202.01072v1 fatcat:iwp76cwadzc3lm6ldw722qgdui

The Child Emotion Facial Expression Set: A Database for Emotion Recognition in Children

Juliana Gioia Negrão, Ana Alexandra Caldas Osorio, Rinaldo Focaccia Siciliano, Vivian Renne Gerber Lederman, Elisa Harumi Kozasa, Maria Eloisa Famá D'Antino, Anderson Tamborim, Vitor Santos, David Leonardo Barsand de Leucas, Paulo Sergio Camargo, Daniel C. Mograbi, Tatiana Pontrelli Mecca (+1 others)
2021 Frontiers in Psychology  
The findings show that this photo and video database can facilitate research on the mechanisms involved in early childhood recognition of facial emotions in children, contributing to the understanding  ...  of facial emotion recognition deficits which characterise several neurodevelopmental and psychiatric disorders.  ...  Among the basic emotions, happiness is the only one with a positive valence, and recognition tends to be easier than for emotions with a negative valence.  ... 
doi:10.3389/fpsyg.2021.666245 pmid:33995223 pmcid:PMC8116652 fatcat:24echw4f25dalfmnxt4il5rmjq

Hierarchical Attention-Based Multimodal Fusion Network for Video Emotion Recognition

Xiaodong Liu, Songyang Li, Miao Wang, Qiangqiang Yuan
2021 Computational Intelligence and Neuroscience  
The context, such as scenes and objects, plays an important role in video emotion recognition. The emotion recognition accuracy can be further improved when the context information is incorporated.  ...  To address the problem of emotion difference between different modes and different images, this paper proposes a hierarchical attention-based multimodal fusion network for video emotion recognition, which  ...  [27] conduct concept selection to investigate the relations between high-level concept features and emotions. e discriminative concepts play important roles in emotion recognition.  ... 
doi:10.1155/2021/5585041 pmid:34616444 pmcid:PMC8487826 fatcat:25xlksqzjzhfvfqe5s3zqhfjtq

Context-Aware Attention Network for Human Emotion Recognition in Video

Xiaodong Liu, Miao Wang, Constantine Kotropoulos
2020 Advances in Multimedia  
In this paper, we first build a video dataset with seven categories of human emotion, named human emotion in the video (HEIV).  ...  Recognition of human emotion from facial expression is affected by distortions of pictorial quality and facial pose, which is often ignored by traditional video emotion recognition methods.  ...  When we show a video with a person marked, we ask the annotators to select one of the emotion categories that suit that video.  ... 
doi:10.1155/2020/8843413 fatcat:jt6ufgxbyjdq7fefy2n5cnvci4

The Effect of the Number of Key-Frames on the Facial Emotion Recognition Accuracy

Suhaila N. Mohammed, Alia K. Abdul Hassan
2021 Engineering and Technology Journal  
Dynamic and static information is employed to select the most effective key-frames of the facial video with a short response time.  ...  The selected keyframes are then fed to a graph mining-based facial emotion recognition system to select the most effective sub-graphs in the given set of keyframes.  ...  In realworld environments, for example, the detection of the emotion from a video with different talking faces poses great challenges on facial emotion recognition [3] .  ... 
doi:10.30684/etj.v39i1b.1806 fatcat:hyyuq2cc5vbfdeqkenp2jxupru

Decoupling facial expressions and head motions in complex emotions

Andra Adams, Marwa Mahmoud, Tadas Baltrusaitis, Peter Robinson
2015 2015 International Conference on Affective Computing and Intelligent Interaction (ACII)  
Index Terms-affective computing; emotion recognition 978-1-4799-9953-8/15/$31.00 ©2015 IEEE  ...  We present a study which isolates the effect of head motion from facial expression in the perception of complex emotions in videos.  ...  We give a quantitative analysis of emotion recognition rates for videos with facial expressions only and videos with head motions only, as compared to the recognition rates of the same videos with both  ... 
doi:10.1109/acii.2015.7344583 dblp:conf/acii/AdamsMB015 fatcat:3k2nomfg4jftres4gmoo335f3i

Personify Educational Assistance Application for Special Children Using Deep Learning

By using this, The scanned image i.e. testing dataset is being compared to training dataset and thus emotion is predicted for incorporating with assisting component  ...  of Face Recognition (in terms of facial expressions).  ...  Meanwhile if they are not distracted the educational video continues playing without any interference while learning the concepts through videos as shown in Figure . 3.  ... 
doi:10.35940/ijitee.a1042.0881019 fatcat:o62s43qjwbgzvn56ozbos33iwy

Exploring the Relationship Between Fiction Reading and Emotion Recognition

Steven C. Schwering, Natalie M. Ghaffari-Nikou, Fangyun Zhao, Paula M. Niedenthal, Maryellen C. MacDonald
2021 Affective Science  
We examine the extent to which contextualized statistical experience with emotion category labels in language is associated with emotion recognition.  ...  In experiment 1 (n = 134), experience with fiction text predicted recognition of emotions employed in an emotive sense in fiction texts.  ...  For example, participants with a college education select fear and disgust labels more often in emotion recognition tasks than participants with no college education (Trauffer et al., 2013) .  ... 
doi:10.1007/s42761-021-00034-0 fatcat:jb5556dhzreitibxwgeivspgna

Sentic Avatar: Multimodal Affective Conversational Agent with Common Sense [chapter]

Erik Cambria, Isabelle Hupont, Amir Hussain, Eva Cerezo, Sandra Baldassarri
2011 Lecture Notes in Computer Science  
It is based on the integration of Sentic Computing, a new opinion mining and sentiment analysis paradigm based on AI and Semantic Web techniques, with a facial emotional classifier and Maxine, a powerful  ...  One of the main distinguishing features of the system is that it does not simply perform emotional classification in terms of a set of discrete emotional labels but it operates in a continuous 2D emotional  ...  A new database has been built for testing this work with a total of 1500 static frames carefully selected from the apex of the video sequences from the FG-NET and MMI databases.  ... 
doi:10.1007/978-3-642-18184-9_8 fatcat:ptwanhtyoveabp2hsnxwwzjqdy

Personify Educational Assistance Application for Special Children using Deep Learning

By using this, The scanned image i.e. testing dataset is being compared to training dataset and thus emotion is predicted for incorporating with assisting component  ...  of Face Recognition (in terms of facial expressions).  ...  IMAGE PROCESSING In this concept in order to enhance an image, the particular image is converted to grayscale when the face recognition/feature extraction on processing.  ... 
doi:10.35940/ijitee.f1105.0486s419 fatcat:bkolz4e2qffnpe7lp53nxsnue4

Emotion based Contextual Semantic Relevance Feedback in Multimedia Information Retrieval

Karm VeerSingh, Anil K. Tripathi
2012 International Journal of Computer Applications  
Hence we are exploiting the plausibility of context associated with semantic concept in retrieving relevance information.  ...  We introduce an Emotion Recognition Unit (ERU) that comprises of spatiotemporal Gabor filter to capture spontaneous facial expression and emotional word recognition system that uses phonemes to recognize  ...  The result shows that this emotion recognition technique has more discriminating characteristics in selecting relevant and irrelevant information.  ... 
doi:10.5120/8834-3052 fatcat:hvvl23mcqjfbhf2z6iecpq26pm

Testing Complex Emotion Recognition in Adults: A Gendered Comparison

Nahla Aljojo, Huda Saifuddin
2015 International Journal of Computer Applications  
Results showed how people performed with regard to emotion recognition displayed by other faces.  ...  Determining the integrity of emotion recognition in adults is important to our understanding of facial expressions and the learning of social skills.  ...  The battery includes two tasks: emotion recognition in the face and emotion recognition in the voice.  ... 
doi:10.5120/21756-5062 fatcat:4nka2ml4djbytbonbmpo2jghxm
« Previous Showing results 1 — 15 out of 63,083 results