Filters








62 Hits in 10.2 sec

Survey on RGB, 3D, Thermal, and Multimodal Approaches for Facial Expression Recognition: History, Trends, and Affect-related Applications [article]

Ciprian Corneanu, Marc Oliu, Jeffrey F. Cohn, Sergio Escalera
2016 arXiv   pre-print
This paper presents a general overview of automatic RGB, 3D, thermal and multimodal facial expression analysis.  ...  Interpreting such expressions remains challenging and much research is needed about the way they relate to human affect.  ...  In this survey, we define a comprehensive taxonomy of automatic RGB 1 , 3D, thermal, and multimodal computer vision approaches for AFER.  ... 
arXiv:1606.03237v1 fatcat:t55kncgy6fgsvgi42pdgleu43m

Survey on RGB, 3D, Thermal, and Multimodal Approaches for Facial Expression Recognition: History, Trends, and Affect-Related Applications

Ciprian Adrian Corneanu, Marc Oliu Simon, Jeffrey F. Cohn, Sergio Escalera Guerrero
2016 IEEE Transactions on Pattern Analysis and Machine Intelligence  
This paper presents a general overview of automatic RGB, 3D, thermal and multimodal facial expression analysis.  ...  Interpreting such expressions remains challenging and much research is needed about the way they relate to human affect.  ...  In this survey, we define a comprehensive taxonomy of automatic RGB 1 , 3D, thermal, and multimodal computer vision approaches for AFER.  ... 
doi:10.1109/tpami.2016.2515606 pmid:26761193 pmcid:PMC7426891 fatcat:ezwkw2bmhbdtlffz3uz3m3hoiy

Guest Editors' Introduction to the Special Issue on Multimodal Human Pose Recovery and Behavior Analysis

Sergio Escalera, Jordi Gonzalez, Xavier Baro, Jamie Shotton
2016 IEEE Transactions on Pattern Analysis and Machine Intelligence  
It is of critical importance for application areas that include gaming, computer interaction, human robot interaction, security, commerce, assistive technologies and rehabilitation, sports, sign language  ...  , including new methods considering still images, image sequences, depth data, stereo vision, 3D vision, audio, and IMUs, among others, while presenting new multimodal datasets, in addition to those proposed  ...  For information on obtaining reprints of this article, please send e-mail to: reprints@ieee.org, and reference the Digital Object Identifier below.  ... 
doi:10.1109/tpami.2016.2557878 fatcat:ee3j7nre4fgdtjrozavgexvhi4

Analyzing trajectories on Grassmann manifold for early emotion detection from depth videos

Taleb Alashkar, Boulbaba Ben Amor, Stefano Berretti, Mohamed Daoudi
2015 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG)  
I n this thesis, we have investigated the problems of identity recognition and emotion detection from facial 3D shapes animations (called 4D faces).  ...  To this end, we have adopted a comprehensive geometric framework for the purpose of analyzing 3D faces and their dynamics across time.  ...  A 616 recent and more comprehensive survey on facial expression recognition from 3D video 617sequences is published in [38] .  ... 
doi:10.1109/fg.2015.7163122 dblp:conf/fgr/AlashkarABD15 fatcat:53lkhk6apzaqndylmu5iphqupe

A survey on deep multimodal learning for computer vision: advances, trends, applications, and datasets

Khaled Bayoudh, Raja Knani, Fayçal Hamdaoui, Abdellatif Mtibaa
2021 The Visual Computer  
We also survey current multimodal applications and present a collection of benchmark datasets for solving problems in various vision domains.  ...  Finally, we highlight the limitations and challenges of deep multimodal learning and provide insights and directions for future research.  ...  for various real-world use cases, such as video synthesis and description [68] , and facial expression recognition [123] .  ... 
doi:10.1007/s00371-021-02166-7 pmid:34131356 pmcid:PMC8192112 fatcat:jojwyc6slnevzk7eaiutlmlgfe

Identity-Aware Facial Expression Recognition Method Based on Synthesized Images and Deep Metric Learning

Siyuan Zhang, Shiming Xiao, Peng Zhang, Wei Huang
2021 Journal of Computer-Aided Design & Computer Graphics  
Facial expression recognition (FER) is a challenging task because the external environment and identity characteristics could affect the classification results directly.  ...  To settle down the above-mentioned challenges, this paper proposed an identity-aware facial expression recognition method which combined images synthesis techniques and deep metric learning, and made facial  ...  Survey on RGB, 3D, thermal, and multimodal approaches for facial expression recognition: history, trends, and affect-related applications[J].  ... 
doi:10.3724/sp.j.1089.2021.18462 fatcat:ektlv3jvtbcevi5zftbivsqu44

Assessment of Depression using Image Processing

P. Bhosale, M. Ghadage, M. Kanse, S. Mhamane
2019 Zenodo  
By using this techniques and algorithm one can collect the database for depression analysis.  ...  The aim of review paper specifically gives the methods for recognition of face, classification techniques for detection of different face parts like eyes, lips etc.  ...  Guerrero, "Survey on RGB, 3D, Thermal, and Multimodal Approaches for Facial Expression Recognition: History, Trends, and Affect Related Application,"IEEE transactions on Pattern Analysis and Machine Intelligence  ... 
doi:10.5281/zenodo.2632995 fatcat:3fbdpk5mzzgmjhks4ooeroqi2y

State of the Art of Audio- and Video-Based Solutions for AAL

Slavisa ALeksic, Michael Atanasov, Jean Calleja Agius, Kenneth Camilleri, Anto Čartolovni, Pau Climent-Pérez, Sara Colantonio, Stefania Cristina, Vladimir Despotovic, Hazım Kemal Ekenel, Ekrem Erakin, Francisco Florez-Revuelta (+27 others)
2022 Zenodo  
Active and Assisted Living (AAL) technologies come as a viable approach to help facing these challenges, thanks to the high potential they have in enabling remote care and support.  ...  The recent COVID-19 pandemic has stressed this situation even further, thus highlighting the need for taking action.  ...  Multimodal data fusion for AAL In this section, we introduce two technological approaches for fusing multimodal sensing data. Firstly, we survey how thermal and depth data can be combined.  ... 
doi:10.5281/zenodo.6390708 fatcat:6qfwqd2v2rhe5iuu5zgz77ay4i

Technologies for Multimodal Interaction in Extended Reality—A Scoping Review

Ismo Rakkolainen, Ahmed Farooq, Jari Kangas, Jaakko Hakulinen, Jussi Rantala, Markku Turunen, Roope Raisamo
2021 Multimodal Technologies and Interaction  
We conclude with our perspective on promising research avenues for multimodal interaction technologies.  ...  Multimodal interaction can transform how people communicate remotely, practice for tasks, entertain themselves, process information visualizations, and make decisions based on the provided information.  ...  [49] surveyed hand gesture recognition using 3D depth sensors, 3D hand gesture recognition approaches, the related applications, and typical systems.  ... 
doi:10.3390/mti5120081 fatcat:3oea4tqlwfcojfvnohv72id7i4

Camera Measurement of Physiological Vital Signs [article]

Daniel McDuff
2021 arXiv   pre-print
I cover both clinical and non-clinical applications and the challenges that need to be overcome for these applications to advance from proofs-of-concept.  ...  This paper presents a comprehensive survey of camera measurement of physiological vital signs, describing they vital signs that can be measured and the computational techniques for doing so.  ...  I would also like to thank Wenjin Wang and Sander Stuijk for co-organizing the Computer Vision for Physiological Measurement (CVPM) workshops which have helped to consolidate the research community around  ... 
arXiv:2111.11547v1 fatcat:47l2buzxg5ht5lhrqsuszjha6a

Taking the Temperature of Sports Arenas [article]

Rikke Gade
2014 Ph.d.-serien for Det Teknisk-Naturvidenskabelige Fakultet, Aalborg Universitet  
We would also like to thank the administration of the building Knud Højgaards Hus in Copenhagen and the company Fokustranslatørerne for allowing access to their roof top terrace for us to install the thermal  ...  Acknowledgements We would like to thank Aalborg municipality for support and for providing access to the sports arenas.  ...  The recognition of common facial expressions is another task of great interest. Neural networks have also been used as an early approach here [125] .  ... 
doi:10.5278/vbn.phd.engsci.00070 fatcat:qudgoqzxc5bavfyib5wfwkiu5y

Visual analysis of faces with application in biometrics, forensics and health informatics [article]

Mohammad Ahsanul Haque
2016 Ph.d.-serien for Det Teknisk-Naturvidenskabelige Fakultet, Aalborg Universitet  
Another related application-centric article written by Sadri [34] surveyed AmI and its applications at home, including care of older adults.  ...  When facial expression conveys emotion and cognitive processes, facial expression recognition and analysis systems find their applications in medical diagnosis for diseases like delirium and dementia,  ...  applications, for example, in patient monitoring and biometric recognition.  ... 
doi:10.5278/vbn.phd.engsci.00104 fatcat:445elv6ftfcw3lhg7svwqx3ifu

Humanode Whitepaper: You are [not] a bot [article]

Dato Kavazi, Victor Smirnov, Sasha Shilina, MOZGIII, MingDong Li, Rafael Contreras, Hardik Gajera, Dmitry Lavrenov, the Humanode Core
2021 arXiv   pre-print
cryptographically secure neural networks for the private classification of 3D templates of users' faces 2) a private Liveness detection mechanism for identification of real human beings 3) a Substrate  ...  This approach can potentially lead to the creation of a public, permissionless financial network based on consensus between equal human nodes with algorithm-based emission mechanisms targeting real value  ...  Starting only with 3D facial recognition and liveness detection, later on one will have to go through multimodal biometric processing.  ... 
arXiv:2111.13189v1 fatcat:6pc4nj46sjdkvketwydvwh2ulu

Visual Analysis in Traffic & Re-identification [article]

Andreas Møgelmose
2015 Ph.d.-serien for Det Teknisk-Naturvidenskabelige Fakultet, Aalborg Universitet  
Sujitha Martin, and Mr. Eshed Ohn-Bar for their comments.  ...  Acknowledgment The authors would like to thank their colleagues at the LISA lab for useful discussion and encouragement, especially Eshed Ohn-Bar for his valuable comments.  ...  As opposed to the works described above, in this paper we introduce a truly multi-modal approach based on RGB, depth and thermal data.  ... 
doi:10.5278/vbn.phd.engsci.00026 fatcat:taivrerts5debi734ddeeaq244

Trends, Challenges and Adopted Strategies in RoboCup@Home [article]

Mauricio Matamoros and Viktor Seib and Dietrich Paulus
2019 arXiv   pre-print
In this paper, we aim to tackle this problems by presenting a summary of the trending solutions and approaches used in RoboCup@Home, and discussing the attained achievements and challenges to overcome  ...  in relation with the progress required to fulfill the long-term goal of the league.  ...  In addition, hybrid techniques like combining 3D object recognition with face detection (e.g. OpenFace), or analysis of thermal images [15, 21, 40] are also being used.  ... 
arXiv:1903.02516v1 fatcat:a2dv4ps5wzg5dafmfslefwkxfi
« Previous Showing results 1 — 15 out of 62 results