LifeSeeker 4.0: An Interactive Lifelog Search Engine for LSC'22

Thao-Nhu Nguyen, Tu-Khiem Le, Van-Tu Ninh, Minh-Triet Tran, Thanh Binh Nguyen, Graham Healy, Sinéad Smyth, Annalina Caputo, Cathal Gurrin
2022 Proceedings of the 5th Annual on Lifelog Search Challenge  
In this paper, we introduce LifeSeeker 4.0 -an interactive lifelog retrieval system developed for the fifth annual Lifelog Search Challenge (LSC'22). In LifeSeeker 4.0, we focus on enhancing our previous system to allow users who have little to no knowledge of underlying system functioning and lifelog data to use it with ease by not only enhancing the text parser but also employing a Contrastive Language-Image Pre-training (CLIP) model as an extra search mechanism. Furthermore, we have
more » ... the music metadata to facilitate searches that may incorporate emotion. Event clustering is also improved in this version to increase user experience by reducing the occurrence of repeated images, and hence decreasing the search time. CCS CONCEPTS • Information systems → Multimedia databases; Users and interactive retrieval; Search interfaces; • Human-centered computing → Interactive systems and tools.
doi:10.1145/3512729.3533014 fatcat:omyjkjszdzdhtkwzmdnhdowdgi