8 Hits in 10.4 sec

The MIREX grand challenge: A framework of holistic user-experience evaluation in music information retrieval

Xiao Hu, Jin Ha Lee, David Bainbridge, Kahyun Choi, Peter Organisciak, J. Stephen Downie
2015 Journal of the Association for Information Science and Technology  
This paper describes the first implementation of a holistic user experience evaluation in MIR, the MIREX Grand Challenge, where complete MIR systems are evaluated with user experience being the single  ...  There are two major limitations of such system-centered evaluation approaches: 1) the evaluation focuses on subtasks in music information retrieval but not entire systems; and 2) users and their interactions  ...  Acknowledgements We sincerely thank all the anonymous evaluators participating in the GC14UX , the authors of the participating systems, and the colleagues in the MIR community who kindly shared their  ... 
doi:10.1002/asi.23618 fatcat:6y34cd7jircmxal2tzotgxdqam

Ten Years Of Mirex (Music Information Retrieval Evaluation Exchange): Reflections, Challenges And Opportunities

J. Stephen Downie, Xiao Hu 0001, Jin Ha Lee, Kahyun Choi, Sally Jo Cunningham, Yun Hao
2014 Zenodo  
The "Grand Challenge '14 User Experience" (GC14UX) 1 task is unlike any previous MIREX task.  ...  Workshop on the Evaluation of Music Information Retrieval Systems 2003 Andrew W.  ... 
doi:10.5281/zenodo.1417181 fatcat:qnvww5omcrgl5cs4xynjkuirj4

Mirex Grand Challenge 2014 User Experience: Qualitative Analysis Of User Feedback

Jin Ha Lee, Xiao Hu 0001, Kahyun Choi, J. Stephen Downie
2015 Zenodo  
INTRODUCTION Since 2005, the Music Information Retrieval (MIR) community has benefited from the Music Information Retrieval Evaluation eXchange (MIREX), an annual evaluation event led by researchers at  ...  Three different MIR systems participated in the Grand Challenge 2014 User Experience (GC14UX).  ... 
doi:10.5281/zenodo.1417102 fatcat:nxgthhrfizcvpj5giun6sunqmy

Evaluation in Music Information Retrieval

Julián Urbano, Markus Schedl, Xavier Serra
2013 Journal of Intelligent Information Systems  
The field of Music Information Retrieval has always acknowledged the need for rigorous scientific evaluations, and several efforts have set out to develop and provide the infrastructure, technology and  ...  Based on a formalization of the evaluation process, this paper presents a survey of past evaluation work in the context of Text IR, from the point of view of validity, reliability and efficiency of the  ...  The second meeting took place in 2012, and Evaluation was still recognized as one of the six grand challenges in Information Retrieval (Allan et al, 2012) .  ... 
doi:10.1007/s10844-013-0249-4 fatcat:uslx5lxeyrge7b5utjv75yxk3q

User experience with commercial music services: An empirical exploration

Jin Ha Lee, Rachel Price
2015 Journal of the Association for Information Science and Technology  
The Music Information Retrieval (MIR) community has long understood the role of evaluation as a critical component for successful information retrieval systems.  ...  that may be used for the holistic evaluation of user experience in MIR systems.  ...  Acknowledgment This research is supported by the University of Washington Information School Research Seed Fund.  ... 
doi:10.1002/asi.23433 fatcat:nyqqndr5dzhx3gzfl3dhhkjddm

Detecting Music-Induced Emotion Based on Acoustic Analysis and Physiological Sensing: A Multimodal Approach

Xiao Hu, Fanjie Li, Ruilun Liu
2022 Applied Sciences  
This study contributes to designing music retrieval systems which incorporate user physiological data and model listeners' emotional responses to music in a customized manner.  ...  The subjectivity of listeners' emotional responses to music is at the crux of optimizing emotion-aware music recommendation.  ...  The participants of the user experiment are also appreciated for their contribution to this study. Conflicts of Interest: The authors declare that they have no conflict of interest.  ... 
doi:10.3390/app12189354 fatcat:z6nrth7dizgc5geqro7av4naqy

Multi-Modal Music Information Retrieval: Augmenting Audio-Analysis with Visual Computing for Improved Music Video Analysis [article]

Alexander Schindler
2020 arXiv   pre-print
A series of comprehensive experiments and evaluations are conducted which are focused on the extraction of visual information and its application in different MIR tasks.  ...  This thesis combines audio-analysis with computer vision to approach Music Information Retrieval (MIR) tasks from a multi-modal perspective.  ...  Based on the experiences made at the ADC the Music Information Retrieval Evaluation Exchange (MIREX) was initiated in 2005 [62] , which has then become the annual evaluation campaign of ISMIR [61] .  ... 
arXiv:2002.00251v1 fatcat:6cz6rivc3fbg7fahdsnokxfrk4

Perceptual and algorithmic evaluation of inter-song similarity in Western popular music [article]

Novello, A (Alberto), Kohlrausch, AG (Armin), McKinney, MF (Martin), Cambouropoulos, E (Emilios)
of papers to the International Symposium of Music Information Retrieval (ISMIR) and algorithmic applications to the Music Information Retrieval Evaluation eXchange (MIREX) 1 .  ...  The criterion for selecting these feature sets was their high ranking in the MIREX competitions (Downie et al., 2005) for evaluation of music information retrieval (MIR) systems Rauber, 2005, 2006;  ...  Despite all my passion for music, music information retrieval remains a complex multidisciplinary field requiring knowledge of music perception, skills in experimental design, digital signal processing  ... 
doi:10.6100/ir642834 fatcat:csdqlfgl55aufinm56chpot6zy