Filters








39 Hits in 6.5 sec

Spatiotemporal analysis of RGB-D-T facial images for multimodal pain level recognition

Ramin Irani, Kamal Nasrollahi, Marc O. Simon, Ciprian A. Corneanu, Sergio Escalera, Chris Bahnsen, Dennis H. Lundtoft, Thomas B. Moeslund, Tanja L. Pedersen, Maria-Louise Klitgaard, Laura Petrini
2015 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)  
While most available computer vision techniques are based on RGB, in this paper, we investigate the effect of combining RGB, depth, and thermal facial images for pain intensity level recognition.  ...  For this purpose, we extract energies released by facial pixels using a spatiotemporal filter.  ...  In this paper, we present a multimodal dynamic pain recognition method from RGB, depth and thermal facial images.  ... 
doi:10.1109/cvprw.2015.7301341 dblp:conf/cvpr/IraniNSCEBLMPKP15 fatcat:3jekokhcuzbsnmr3dasaez3kvq

Multimodal-Based Stream Integrated Neural Networks for Pain Assessment

Ruicong ZHI, Caixia ZHOU, Junwei YU, Tingting LI, Ghada ZAMZMI
2021 IEICE transactions on information and systems  
In this paper, we propose a multimodal-based Stream Integrated Neural Network with Different Frame Rates (SINN) that combines facial expression and biomedical signals for automatic pain assessment.  ...  The main contributions of this research are threefold. (1) There are four-stream inputs of the SINN for facial expression feature extraction.  ...  The computing work is supported by USTB MatCom of Beijing Advanced Innovation Center for Materials Genome Engineering.  ... 
doi:10.1587/transinf.2021edp7065 fatcat:r3h6cews75duhhadmb73rvvokm

Alzheimer's Disease Diagnosis Based on Cognitive Methods in Virtual Environments and Emotions Analysis [article]

Juan Manuel Fernández Montenegro
2018 arXiv   pre-print
Data from this dataset is used to introduce novel descriptors for Electroencephalogram (EEG) and facial images data.  ...  The use of emotion recognition to analyse AD symptoms has been also proposed. A novel multimodal dataset was specifically created to remark the autobiographical memory deficits of AD patients.  ...  Facial Action Coding System I FER Image intensity Facial Expression Recognition f FERA Motion of the image Facial Emotion Recognition and Analysis C FR Crease pattern Facial Recognition Abbreviations  ... 
arXiv:1810.10941v1 fatcat:lrqvy6gqkvhszkxffxbq5iyut4

AttendAffectNet–Emotion Prediction of Movie Viewers Using Multimodal Fusion with Self-Attention

Ha Thi Phuong Thao, B T Balamurali, Gemma Roig, Dorien Herremans
2021 Sensors  
Particularly, visual, audio, and text features are considered for predicting emotions (and expressed in terms of valence and arousal).  ...  In the Temporal AAN, self-attention is applied on the concatenated (multimodal) feature vectors representing different subsequent movie segments.  ...  The first facial expression recognition and analysis challenge.  ... 
doi:10.3390/s21248356 pmid:34960450 pmcid:PMC8704548 fatcat:dhqibcpfozgm3as4rzp2n4qa4u

Multi-modal RGB–Depth–Thermal Human Body Segmentation

Cristina Palmero, Albert Clapés, Chris Bahnsen, Andreas Møgelmose, Thomas B. Moeslund, Sergio Escalera
2016 International Journal of Computer Vision  
This work addresses the problem of human body segmentation from multi-modal visual cues as a first stage of automatic human behavior analysis.  ...  Our baseline extracts regions of interest using background subtraction, defines a partitioning of the foreground regions into cells, computes a set of image features on those cells using different state-of-the-art  ...  The work of Albert Clapés was supported by SUR-DEC of the Generalitat de Catalunya and FSE. We would like to thank Anders Jørgensen for his valuable help in capturing the dataset.  ... 
doi:10.1007/s11263-016-0901-x fatcat:sb4niwecpfamdacoaxdl27y7ma

Learning Neural Textual Representations for Citation Recommendation

Binh Thanh Kieu, Inigo Jauregi Unanue, Son Bao Pham, Hieu Xuan Phan, Massimo Piccardi
2021 2020 25th International Conference on Pattern Recognition (ICPR)  
RGB-D Image DAY 1 -Jan 12, 2021 Liu, Shuang; Xiong, Chengyi; Gao, Zhirong 2073 Face Super-Resolution Network with Incremental Enhancement of Facial Parsing Information DAY 1 -Jan 12, 2021  ...  Fusion Learning for RGB-D Face Recognition DAY 1 -Jan 12, 2021 Lamghari, Soufiane; Bilodeau, Guillaume-Alexandre; Saunier, Nicolas 2932 A Grid-based Representation for Human Action Recognition  ... 
doi:10.1109/icpr48806.2021.9412725 fatcat:3vge2tpd2zf7jcv5btcixnaikm

Facial Expression Analysis under Partial Occlusion

Ligang Zhang, Brijesh Verma, Dian Tjondronegoro, Vinod Chandran
2018 ACM Computing Surveys  
Automatic machine-based Facial Expression Analysis (FEA) has made substantial progress in the past few decades driven by its importance for applications in psychology, security, health, entertainment and  ...  The context is right for a comprehensive perspective of these developments and the state of the art from this perspective.  ...  video based, image based, and group-level emotion recognition.  ... 
doi:10.1145/3158369 fatcat:xmfmw7z275hb7e6dbazjqm5fui

Survey on Emotional Body Gesture Recognition [article]

Fatemeh Noroozi and Ciprian Adrian Corneanu and Dorota Kamińska and Tomasz Sapiński and Sergio Escalera and Gholamreza Anbarjafari
2018 arXiv   pre-print
We then comment the recent literature related to representation learning and emotion recognition from images of emotionally expressive gestures.  ...  While pre-processing methodologies (e.g. human detection and pose estimation) are nowadays mature technologies fully developed for robust large scale analysis, we show that for emotion recognition the  ...  Even though recently we can see deep meaningful representations being learned for facial analysis for affect recognition a similar approach for a more broader affective expression of humans is still to  ... 
arXiv:1801.07481v1 fatcat:7x7zhe77rvbqtpedefmwwqisqm

Proceedings of eNTERFACE 2015 Workshop on Intelligent Interfaces [article]

Matei Mancas, Christian Frisson, Joëlle Tilmanne, Nicolas d'Alessandro, Petr Barborka, Furkan Bayansar, Francisco Bernard, Rebecca Fiebrink, Alexis Heloir, Edgar Hemery, Sohaib Laraba, Alexis Moinet (+58 others)
2018 arXiv   pre-print
The 11th Summer Workshop on Multimodal Interfaces eNTERFACE 2015 was hosted by the Numediart Institute of Creative Technologies of the University of Mons from August 10th to September 2015.  ...  During the four weeks, students and researchers from all over the world came together in the Numediart Institute of the University of Mons to work on eight selected projects structured around intelligent  ...  The team would like to thank Metapraxis for supporting this project and lending us one of the tablets for the experiments.  ... 
arXiv:1801.06349v1 fatcat:qauytivdq5axxis2xlknp3r2ne

2021 Index IEEE Transactions on Pattern Analysis and Machine Intelligence Vol. 43

2022 IEEE Transactions on Pattern Analysis and Machine Intelligence  
The Author Index contains the primary entry for each item, listed under the first author's name.  ...  The primary entry includes the coauthors' names, the title of the paper or other item, and its location, specified by the publication abbreviation, year, month, and inclusive pagination.  ...  ., +, TPAMI Dec. 2021 4477-4490 Emotion recognition Automatic Detection of Pain from Facial Expressions: A Survey.  ... 
doi:10.1109/tpami.2021.3126216 fatcat:h6bdbf2tdngefjgj76cudpoyia

Aalborg Universitet Deep Multimodal Pain Recognition: A Database and Comparison of Spatio-Temporal Visual Modalities

Mohammad Haque, Ahsanul, Kamal Nasrollahi, Thomas Moeslund, Ruben Bautista, Christian Laursen, Sergio Escalera, Ramin Irani, Ole Andersen, Kaeseler, Erika Spaich, Geraldina (+4 others)
unpublished
BEST SCORES IN BOLD Fusion EF-RGB-T EF-RGB-D EF-D-T EF-RGB-DT LF-RGB-T LF-RGB-D LF-D-T LF RGB-The confusion matrix corresponding to the early fusion of all three modalities.  ...  While human observation constitutes the ground truth for the pain level for objective assessment, automated system for pain assessment based on facial image or video analysis tries to provide an effective  ... 
fatcat:kdoedbrzzrfw5by6eiajcmabmq

Graph-Based Deep Learning for Medical Diagnosis and Analysis: Past, Present and Future [article]

David Ahmedt-Aristizabal, Mohammad Ali Armin, Simon Denman, Clinton Fookes, Lars Petersson
2021 arXiv   pre-print
We also outline the limitations of existing techniques and discuss potential directions for future research.  ...  We provide an overview of these methods in a systematic manner, organized by their domain of application including functional connectivity, anatomical structure and electrical-based analysis.  ...  The relational reasoning and the spatiotemporal pattern learning of graph-based methods have been explored for facial expression recognition [294] , action unit detection [292] and micro-expression  ... 
arXiv:2105.13137v1 fatcat:gm7d2ziagba7bj3g34u4t3k43y

2020 Index IEEE Transactions on Biomedical Engineering Vol. 67

2020 IEEE Transactions on Biomedical Engineering  
, Facilitating Calibration in High-Speed BCI Spellers via Leveraging Cross-Device Shared Latent Responses; TBME April 2020 1105-1113 Narayanan, A.M., and Bertrand, A., Analysis of Miniaturization Effects  ...  ., and Heldt, T., A Time-Frequency Approach for Cerebral Embolic Load Monitoring; TBME April 2020 1007-1018 Imaduddin, S.M., Fanelli, A., Vonberg, F.W., Tasker, R.C., and Heldt, T., Pseudo-Bayesian Model-Based  ...  Gessert, N., +, TBME Feb. 2020 495- 503 Image color analysis Modified RGB Cameras for Infrared Remote-PPG.  ... 
doi:10.1109/tbme.2020.3048339 fatcat:y7zxxew27fgerapsnrhh54tm7y

2021 Index IEEE Transactions on Instrumentation and Measurement Vol. 70

2021 IEEE Transactions on Instrumentation and Measurement  
The Author Index contains the primary entry for each item, listed under the first author's name.  ...  The primary entry includes the coauthors' names, the title of the paper or other item, and its location, specified by the publication abbreviation, year, and article number.  ...  Banik, D., +, TIM 2021 4000512 Real-Time and Efficient 6-D Pose Estimation From a Single RGB Image.  ... 
doi:10.1109/tim.2022.3156705 fatcat:dmqderzenrcopoyipv3v4vh4ry

CARS 2016—Computer Assisted Radiology and Surgery Proceedings of the 30th International Congress and Exhibition Heidelberg, Germany, June 21–25, 2016

2016 International Journal of Computer Assisted Radiology and Surgery  
We would like to thank the Spanish company BQ for the donation of the 3D printing hardware for clinical use.  ...  Acknowledgments The authors wish to thank Fundación CEIBA and Alcaldía Mayor de Bogotá, for the financial support of Ricardo Mendoza's PhD studies through the scholarship program ''Becas Rodolfo Llinás  ...  Furthermore, we assume the standard linear model for the distance information: References d t ð Þ ¼ y t ð Þ þ e t ð Þ where d(t) is the input distance at time t, y(t) is the true (but unknown) distance  ... 
doi:10.1007/s11548-016-1412-5 pmid:27206418 fatcat:uk5r46n2xvhedkfjzmeiweyneq
« Previous Showing results 1 — 15 out of 39 results