Filters








205 Hits in 7.4 sec

The Multimodal Driver Monitoring Database: A Naturalistic Corpus to Study Driver Attention [article]

Sumit Jha, Mohamed F. Marzban, Tiancheng Hu, Mohamed H. Mahmoud, Naofal Al-Dhahir Carlos Busso
2020 arXiv   pre-print
A smart vehicle should be able to monitor the actions and behaviors of the human driver to provide critical warnings or intervene when necessary.  ...  We ask the driver to look at predetermined gaze locations to obtain accurate correlation between the driver's facial image and visual attention.  ...  The authors would like to thank Lucas Weaver, Mayank Mangla, Stanley Liu, Vijay Pothukuchi, and Muhammad Ikram from Texas Instruments and Aneesh Saripalli from UT-Dallas for helpful discussions on the  ... 
arXiv:2101.04639v1 fatcat:elqcv7vpafdkldvfcoib2fnnze

The Multimodal Driver Monitoring Database: A Naturalistic Corpus to Study Driver Attention

Sumit Jha, Mohamed F. Marzban, Tiancheng Hu, Mohamed H. Mahmoud, Naofal Al-Dhahir, Carlos Busso
2021 IEEE transactions on intelligent transportation systems (Print)  
A smart vehicle should be able to monitor the actions and behaviors of the human driver to provide critical warnings or intervene when necessary.  ...  Index Terms-In-vehicle safety, driver visual attention, driver monitoring dataset.  ...  ACKNOWLEDGMENT The authors would like to thank Lucas Weaver, Mayank Mangla, Stanley Liu, Vijay Pothukuchi, and Muhammad Ikram from Texas Instruments, and Aneesh Saripalli from UT-Dallas for helpful discussions  ... 
doi:10.1109/tits.2021.3095462 fatcat:6vhsn2x7v5dtzbidg6xvvzmmri

The Multimodal Driver Monitoring Database: A Naturalistic Corpus to Study Driver Attention [article]

Sumit Jha, Mohamed F. Marzban, Tiancheng Hu, Mohamed H. Mahmoud, Naofal Al-Dhahir, Carlos Busso
2021
A smart vehicle should be able to monitor the actions and behaviors of the human driver to provide critical warnings or intervene when necessary.  ...  We ask the driver to look at predetermined gaze locations to obtain accurate correlation between the driver's facial image and visual attention.  ...  This study presents the multimodal driver monitoring (MDM) database, which was specifically designed to study the driver's visual attention.  ... 
doi:10.48550/arxiv.2101.04639 fatcat:y736llxodjaqrojvvua3pwpolq

A Survey on Human Emotion Recognition Approaches, Databases and Applications

C. Vinola, K. Vimaladevi
2015 ELCVIA Electronic Letters on Computer Vision and Image Analysis  
This paper discovers them in a comparison and descriptive manner. Various applications that use the methodologies in different contexts to address the challenges in real time are discussed.  ...  Thus an integrated discussion of methods, databases used and applications pertaining to the emerging field of Affective Computing (AC) is done and surveyed.  ...  Database serves as a basis of numerous studies in the field.  ... 
doi:10.5565/rev/elcvia.795 fatcat:wlaxn2xgczhm7dhkekk2atfcuq

A Multimodal Database for Affect Recognition and Implicit Tagging

M. Soleymani, J. Lichtenauer, T. Pun, M. Pantic
2012 IEEE Transactions on Affective Computing  
MAHNOB-HCI is a multimodal database recorded in response to affective stimuli with the goal of emotion recognition and implicit tagging research.  ...  The database is made available to the academic community via a web-based system.  ...  ACKNOWLEDGMENTS The work of Soleymani  ... 
doi:10.1109/t-affc.2011.25 fatcat:4xgim4pc3fgllpedes4gt5xhvu

Temporal Head Pose Estimation From Point Cloud in Naturalistic Driving Conditions

Tiancheng Hu, Sumit Jha, Carlos Busso
2021 IEEE transactions on intelligent transportation systems (Print)  
We train this model on the newly collected multimodal driver monitoring (MDM) dataset, achieving better results compared to non-temporal algorithms using point cloud data, and state-of-the-art models using  ...  Our study leverages this observation, proposing a novel temporal deep learning model for head pose estimation from point cloud.  ...  We evaluate our approach on the multimodal driver monitoring (MDM) database [37] , which is a naturalistic driving corpus.  ... 
doi:10.1109/tits.2021.3075350 fatcat:57pcpuwbqjdobkpt3osx7dsr3a

Can ADAS Distract Driver's Attention? An RGB-D Camera and Deep Learning-Based Analysis

Luca Ulrich, Francesca Nonis, Enrico Vezzetti, Sandro Moos, Giandomenico Caruso, Yuan Shi, Federica Marcolin
2021 Applied Sciences  
In the present study, an experiment involving auditory and haptic ADAS has been conducted involving 11 participants, whose attention has been monitored during their driving experience.  ...  In addition to the experimental results, the proposed approach has proved to be an effective tool to monitor the driver through the usage of non-invasive techniques.  ...  The Multimodal Driver Monitoring Database: A Naturalistic Corpus to Study Driver Attention. IEEE Trans. Intell. Transp. Syst. 2021. [CrossRef] 13. Nishigaki, M.; Shirakata, T.  ... 
doi:10.3390/app112411587 fatcat:ietm3k3hpjb2hmagtwgsq7achq

Towards Multimodal Driver's Stress Detection [chapter]

Hynek Bořil, Pinar Boyraz, John H. L. Hansen
2011 Digital Signal Processing for In-Vehicle Systems and Safety  
Non-driving-related cognitive load and variations of emotional state may impact the drivers' capability to control a vehicle and introduce driving errors.  ...  The goal is to obtain a continuous operation-mode detection employing driver's speech and CAN-Bus signals, with a direct application for an intelligent human-vehicle interface which will adapt to the actual  ...  In order to examine the effect of distraction and secondary common tasks on these driver groups, a close-to-naturalistic data collection protocol is used.  ... 
doi:10.1007/978-1-4419-9607-7_1 fatcat:kphvqicpbvdupoajug72ysh72a

HARMONY: A Human-centered Multimodal Driving Study in the Wild

Arash Tavakoli, Shashwat Kumar, Xiang Guo, Vahid Balali, Mehdi Boukhechba, Arsalan Heydarian
2021 IEEE Access  
Over the past 15 years, the research community has identified that there is a need for collecting multimodal driving data through naturalistic studies.  ...  To better grasp the need for using multimodal driver sensing, in this section we discuss the limitations of existing studies in solely relying on in-cabin video streams for monitoring driver's states and  ... 
doi:10.1109/access.2021.3056007 fatcat:qczxgrbxsfdwvfawemlhyclspi

Speech Emotion Analysis: Exploring the Role of Context

Ashish Tawari, Mohan Manubhai Trivedi
2010 IEEE transactions on multimedia  
Second, we introduce the collection of a new audiovisual database in an automobile setting (CVRRCar-AVDB). In this current study, we only use the audio channel of the database.  ...  With the research shift toward spontaneous behavior, many challenges have come to surface ranging from database collection strategies to the use of new feature sets (e.g., lexical cues apart from prosodic  ...  ACKNOWLEDGMENT The authors would like to thank the reviewers and editors for their insightful comments and helpful suggestions.  ... 
doi:10.1109/tmm.2010.2058095 fatcat:2ylqik5uazbbfofjeojfwaetnq

Macro- and Micro-Expressions Facial Datasets: A Survey

Hajer Guerdelli, Claudio Ferrari, Walid Barhoumi, Haythem Ghazouani, Stefano Berretti
2022 Sensors  
The proposed survey can help researchers to have a better understanding of the characteristics of the existing datasets, thus facilitating the choice of the data that best suits the particular context  ...  The proposed study is mostly focused on spontaneous and in-the-wild datasets, given the common trend in the research is that of considering contexts where expressions are shown in a spontaneous way and  ...  Conflicts of Interest: The authors declare no conflict of interest.  ... 
doi:10.3390/s22041524 pmid:35214430 pmcid:PMC8879817 fatcat:mylt5rain5d4dbszdknpcjmdui

Technologies, Multitasking, and Driving: Attending to and Preparing for a Mobile Phone Conversation in a Car

Pentti Haddington, Mirka Rauniomaa
2011 Human Communication Research  
the prebeginning as a collaborative effort.  ...  coordinate situations that require multitasking, that is, use a phone while on the move.  ...  This study was made possible by funding from the Emil Aaltonen Foundation, the Helsinki Collegium for Advanced Studies, and the University of Oulu, Finland.  ... 
doi:10.1111/j.1468-2958.2010.01400.x fatcat:6k22r5dgqrhvvpoi5n5s3ofnke

An Evaluation of Speech-Based Recognition of Emotional and Physiological Markers of Stress

Alice Baird, Andreas Triantafyllopoulos, Sandra Zänkert, Sandra Ottl, Lukas Christ, Lukas Stappen, Julian Konzok, Sarah Sturmbauer, Eva-Maria Meßner, Brigitte M. Kudielka, Nicolas Rohleder, Harald Baumeister (+1 others)
2021 Frontiers in Computer Science  
The development of stress monitoring methods is a growing area of research due to the personal and economic advantages that timely detection provides.  ...  We present cross-corpus and transfer learning results which explore the efficacy of the speech signal to predict three physiological markers of stress—sequentially measured saliva-based cortisol, continuous  ...  recent years being targeted at products including driver monitoring speakers (+100) than is typically observed in the literature thus far.  ... 
doi:10.3389/fcomp.2021.750284 fatcat:2rdv6mngzrhhfcj3s5f53p55jy

A survey of affect recognition methods

Zhihong Zeng, Maja Pantic, Glenn I. Roisman, Thomas S. Huang
2007 Proceedings of the ninth international conference on Multimodal interfaces - ICMI '07  
We finally outline some of the scientific and engineering challenges to advancing human affect sensing technology.  ...  We first discuss human emotion perception from a psychological perspective.  ...  ACKNOWLEDGMENTS The authors would like to thank Qiang Ji and the anonymous reviewers for encouragement and valuable comments. This paper is a collaborative work.  ... 
doi:10.1145/1322192.1322216 dblp:conf/icmi/ZengPRH07 fatcat:byahqj5l4zhzhg5mzlgqu3edqy

A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions

Zhihong Zeng, M. Pantic, G.I. Roisman, T.S. Huang
2009 IEEE Transactions on Pattern Analysis and Machine Intelligence  
We finally outline some of the scientific and engineering challenges to advancing human affect sensing technology.  ...  We first discuss human emotion perception from a psychological perspective.  ...  ACKNOWLEDGMENTS The authors would like to thank Qiang Ji and the anonymous reviewers for encouragement and valuable comments. This paper is a collaborative work.  ... 
doi:10.1109/tpami.2008.52 pmid:19029545 fatcat:xntouxtsxze3bn3dstdrv5eibi
« Previous Showing results 1 — 15 out of 205 results