2,153 Hits in 6.0 sec

Deep Multi-task Learning to Recognise Subtle Facial Expressions of Mental States [chapter]

Guosheng Hu, Li Liu, Yang Yuan, Zehao Yu, Yang Hua, Zhihong Zhang, Fumin Shen, Ling Shao, Timothy Hospedales, Neil Robertson, Yongxin Yang
2018 Lecture Notes in Computer Science  
We address subtle expression recognition through convolutional neural networks (CNNs) by developing multi-task learning (MTL) methods to effectively leverage a side task: facial landmark detection.  ...  To advance subtle expression recognition, we contribute a Large-scale Subtle Emotions and Mental States in the Wild database (LSEMSW).  ...  To provide this prior knowledge as an inductive bias in our deep network design, we aim to detect landmarks and mental state simultaneously via multi-task learning (MTL).  ... 
doi:10.1007/978-3-030-01258-8_7 fatcat:34twdhjrmbafvjda4bzdtckvy4

Image Based Facial Micro-Expression Recognition Using Deep Learning on Small Datasets

Madhumita A. Takalkar, Min Xu
2017 2017 International Conference on Digital Image Computing: Techniques and Applications (DICTA)  
This paper explores the possible use of deep learning for micro-expression recognition.  ...  However, micro-expression recognition is a challenging task due to the repressed facial appearance and short duration, which results in the lack of training data.  ...  Next, the learned spatial features with expression-state constraints are transferred to learn temporal features of microexpression.  ... 
doi:10.1109/dicta.2017.8227443 dblp:conf/dicta/TakalkarX17 fatcat:dnfev3cwqjasjkohvr2wtocxqm

Real-time Facial Expression Recognition "In The Wild" by Disentangling 3D Expression from Identity [article]

Mohammad Rami Koujan, Luma Alharbawee, Giorgos Giannakakis, Nicolas Pugeault, Anastasios Roussos
2020 arXiv   pre-print
Solutions for automatic emotion analysis have also benefited from the development of deep learning approaches and the availability of vast amount of visual facial data on the internet.  ...  We use this dataset to train a deep Convolutional Neural Network for estimating expression parameters of a 3D Morphable Model and combine it with an effective back-end emotion classifier.  ...  [44] proposed a deep learning approach trained on a geometric model of facial regions for facial expression analysis.  ... 
arXiv:2005.05509v1 fatcat:2l5k2iq7crdxpo6u5qpbhgfc2q

Automatic Recognition of Facial Displays of Unfelt Emotions [article]

Kaustubh Kulkarni, Ciprian Adrian Corneanu, Ikechukwu Ofodile, Sergio Escalera, Xavier Baro, Sylwia Hyniewska, Juri Allik, Gholamreza Anbarjafari
2018 arXiv   pre-print
Humans modify their facial expressions in order to communicate their internal states and sometimes to mislead observers regarding their true emotional states.  ...  Performance of the proposed model shows that on average it is easier to distinguish among genuine facial expressions of emotion than among unfelt facial expressions of emotion and that certain emotion  ...  Second, we fine-tune a pretrained VGG-Face deep network [93] for recognising facial expressions.  ... 
arXiv:1707.04061v2 fatcat:u4iqlkn5xzavdgdecy5qo5crvy

Emotion Based Music Recommendation System

Dhruv Piyush Parikh
2021 International Journal for Research in Applied Science and Engineering Technology  
Our generation's youth has been predisposed to a variety of mental health issues. Our idea attempts to provide a relaxing atmosphere to a person based on his or her facial expressions.  ...  Due to the competitive environment, the youth of our generation has been inclined to a lot of mental health problems such as anxiety and depression.  ...  As one cannot mimic all of the distinctive qualities all at once, the same subtle cues that a person takes while interacting with others may be utilized with criminals to know their state of mind as technology  ... 
doi:10.22214/ijraset.2021.38655 fatcat:f5dxa7xvvbcmrk4zkcoux2escy

Automatic Facial Paralysis Estimation with Facial Action Units [article]

Xuri Ge, Joemon M. Jose, Pengcheng Wang, Arunachalam Iyer, Xiao Liu, Hu Han
2022 arXiv   pre-print
possible facial expression.  ...  We further demonstrate the effectiveness of its application to facial paralysis estimation by migrating ALGRNet to a facial paralysis dataset collected and annotated by medical professionals.  ...  AU recognition is challenging due to the difficulty of recognising subtle facial changes caused by AUs.  ... 
arXiv:2203.01800v2 fatcat:4qege4t2xve77b4h2k4hq6ys7u

Generalisation and robustness investigation for facial and speech emotion recognition using bio-inspired spiking neural networks

Esma Mansouri-Benssassi, Juan Ye
2021 Soft Computing - A Fusion of Foundations, Methodologies and Applications  
They have been extensively studied from classical feature extraction techniques to more recent deep learning approaches.  ...  To directly address these challenges, we first propose the application of a spiking neural network (SNN) in predicting emotional states based on facial expression and speech data, then investigate, and  ...  Acknowledgements We gratefully acknowledge the support of NVIDIA Corporation with the donation of the Quadro M5000 GPU used for this research.  ... 
doi:10.1007/s00500-020-05501-7 fatcat:txnr7o4khba5tjm4prlhupx3be

Automated mental stress recognition through mobile thermal imaging

Youngjun Cho
2017 2017 Seventh International Conference on Affective Computing and Intelligent Interaction (ACII)  
This research focuses on the use of mobile thermal imaging, a new and less explored sensor, to merge the measurement of multiple physiological signatures into one sensor and to build a reliable mental  ...  Mental stress is a critical problem in our modern society. This form of stress strongly affects our well being, and technology is needed to help us to manage health problems.  ...  Acknowledgments This research is conducted under the supervision of Prof. Nadia Bianchi-Berthouze (Primary Supervisor), Dr. Simon Julier and Dr.  ... 
doi:10.1109/acii.2017.8273662 dblp:conf/acii/Cho17 fatcat:n65hwy3mirexxnk33cczcj2c6i

Facial Expression Recognition Complications with the Stages of Face Detection and Recognition

2019 International journal of recent technology and engineering  
Facial expressions are the facial changes in light of a man's interior enthusiastic moods, aims, or social interchanges which are investigated by computer frameworks that endeavor to consequently examine  ...  Henceforth, a detailed study was required about the strategies and systems utilized for unraveling the issues of facial expressions during the time of face detection, feature recognition and expression  ...  They actualized a mental investigation framework on perception of the human for facial expression recognition.  ... 
doi:10.35940/ijrte.b1864.078219 fatcat:brnh75tqbngajfkzcwhcbpfze4

Automatic measurement of affect in dimensional and continuous spaces

Hatice Gunes, Maja Pantic
2010 Proceedings of the 7th International Conference on Methods and Techniques in Behavioral Research - MB '10  
This paper aims to give a brief overview of the current state-of-the-art in automatic measurement of affect signals in dimensional and continuous spaces (a continuous scale from -1 to +1) by seeking answers  ...  to the following questions: i) why has the field shifted towards dimensional and continuous interpretations of affective displays recorded in real-world settings?  ...  Such subtle and complex affective states can be expressed via dozens of anatomically possible facial and bodily expressions, audio or physiological signals.  ... 
doi:10.1145/1931344.1931356 dblp:conf/mb/GunesP10 fatcat:ud5edtitqfffffq334spe2tjpe

Near Real-Time Comprehension Classification with Artificial Neural Networks: Decoding e-Learner Non-Verbal Behavior

Mike Holmes, Annabel Latham, Keeley Crockett, James D. OShea
2018 IEEE Transactions on Learning Technologies  
Abstract-Comprehension is an important cognitive state for learning. Human tutors recognise comprehension and non-comprehension states by interpreting learner non-verbal behaviour (NVB).  ...  The resultant dataset of non-verbal behaviour and question-answer scores has been used to train artificial neural network (ANN) to classify comprehension and non-comprehension states in near real-time.  ...  to classify reading comprehension, classifying learning activity states using facial expressions [12] and predicting self-reported task difficulty by coarse head movements [13] .  ... 
doi:10.1109/tlt.2017.2754497 fatcat:4htwmwczhnhobadnjbnd76lbr4

Beyond Mobile Apps: A Survey of Technologies for Mental Well-being [article]

Kieran Woodward, Eiman Kanjo, David Brown, T.M. McGinnity, Becky Inkster, Donald J Macintyre, Athanasios Tsanas
2020 arXiv   pre-print
Capitalising on the data these ubiquitous devices can record, state of the art machine learning algorithms can lead to the development of robust clinical decision support tools towards diagnosis and improvement  ...  Technologies for mental well-being exhibit a range of attractive properties, which facilitate the delivery of state-of-the-art clinical monitoring.  ...  However, as deep learning models require thousands of samples to be sufficiently trained it is difficult to develop a robust deep learning approach for the classification of mental well-being without first  ... 
arXiv:1905.00288v3 fatcat:jppb5uzr3nc4rcvp6xrljxlnny

'Lifting the shell': expressions of emotion and cross-cultural struggle in international students

Rebekah Callow
2020 Holiness  
The article argues that in the increasingly international context of higher education, urgent attention needs to be given to these different cultural expressions of struggle, in order to better understand  ...  This article explores the different expressions of 'struggle' that arise when a person experiences 'culture shock' or 'culture stress' due to life in a cross-cultural context.  ...  mentality, perhaps reflecting a less individually expressive system, Multi-active cultures tend towards being more individualistic in expression; therefore, they 'reinforce verbal expression of negative  ... 
doi:10.2478/holiness-2016-0007 fatcat:benwkv2g2jb5bhmt7slbmtwpp4

Emotion representation, analysis and synthesis in continuous space: A survey

Hatice Gunes, Bjorn Schuller, Maja Pantic, Roddy Cowie
2011 Face and Gesture 2011  
Accordingly, this paper aims to present the current state of the art and the new challenges in automatic, dimensional and continuous analysis and synthesis of human emotional behaviour in an interdisciplinary  ...  Thus, a small number of discrete categories (e.g., happiness and sadness) may not reflect the subtlety and complexity of the affective states conveyed by such rich sources of information.  ...  Such subtle and complex affective states can be expressed via dozens of anatomically possible facial and bodily expressions, audio or physiological signals.  ... 
doi:10.1109/fg.2011.5771357 dblp:conf/fgr/GunesSPC11 fatcat:5vykm64mavg3bc4kf3oe22b7ki

The Psychophysiology Primer: A Guide to Methods and a Broad Review with a Focus on Human–Computer Interaction

Benjamin Cowley, Marco Filetti, Kristian Lukander, Jari Torniainen, Andreas Henelius, Lauri Ahonen, Oswald Barral, Ilkka Kosunen, Teppo Valtonen, Minna Huotilainen, Niklas Ravaja, Giulio Jacucci
2016 Foundations and Trends® in Human–Computer Interaction  
JT contributed to the internal editing; wrote section 3.12; contributed to sections 3.2, 3.4; and peer-reviewed section 3.11.  ...  AH wrote section 3.1; contributed to section 3.12; and peer-reviewed section 3.3. LA wrote section 3.5; contributed to section 3.6; and peer-reviewed section 3.2.  ...  Facial expressions are an obvious signal as to the mental state, and the recognition of facial expressions is natural (and automatic) for humans; it is an important part of our communication.  ... 
doi:10.1561/1100000065 fatcat:2hpkqxxtyfg5nhb3canmxg6shy
« Previous Showing results 1 — 15 out of 2,153 results