60,960 Hits in 1.5 sec

Evaluation in Music Information Retrieval

Julián Urbano, Markus Schedl, Xavier Serra
2013 Journal of Intelligent Information Systems  
The field of Music Information Retrieval has always acknowledged the need for rigorous scientific evaluations, and several efforts have set out to develop and provide the infrastructure, technology and  ...  We show the problems that our community currently has in terms of evaluation, point to several lines of research to improve it and make various proposals in that line.  ...  Finally, the first edition of the Music Information Retrieval Evaluation eXchange 8 (MIREX) took place in 2005, organized by IMIRSEL (International Music IR Systems Evaluation Laboratory) (Downie et al  ... 
doi:10.1007/s10844-013-0249-4 fatcat:uslx5lxeyrge7b5utjv75yxk3q

Evaluation of a simple and effective music information retrieval method

Stephen Downie, Michael Nelson
2000 Proceedings of the 23rd annual international ACM SIGIR conference on Research and development in information retrieval - SIGIR '00  
We developed, and then evaluated, a music information retrieval (MIR) system based upon the intervals found within the melodies of a collection of 9354 folksongs.  ...  We constructed a collection of "musical word" databases using the text-based, SMART information retrieval system.  ...  roles in defining the domain of Music Information Retrieval.  ... 
doi:10.1145/345508.345551 dblp:conf/sigir/DownieN00 fatcat:fj32y3vqgjfm3k4wnrxdz4urzu

The Music Information Retrieval Evaluation eXchange: Some Observations and Insights [chapter]

J. Stephen Downie, Andreas F. Ehmann, Mert Bay, M. Cameron Jones
2010 Studies in Computational Intelligence  
This is the motivating principle driving the efforts of the International Music Information Retrieval Systems Evaluation Laboratory (IMIRSEL) and the annual Music Information Retrieval Evaluation eXchange  ...  Advances in the science and technology of Music Information Retrieval (MIR) systems and algorithms are dependent on the development of rigorous measures of accuracy and performance such that meaningful  ...  latest results data from the Music Information Retrieval Evaluation eXchange (MIREX).  ... 
doi:10.1007/978-3-642-11674-2_5 fatcat:pokseicfcre6pgrhdi327mxt6m

A "do-it-yourself" evaluation service for music information retrieval systems

M. Cameron Jones, Mert Bay, J. Stephen Downie, Andreas F. Ehmann
2007 Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval - SIGIR '07  
In previous years, MIREX participants submitted systems to the International Music Information Retrieval Systems Evaluation Laboratory (IMIRSEL), where they were manually executed, and evaluated.  ...  As TREC does for text retrieval, MIREX provides standardized datasets and evaluation frameworks to evaluate Music Information Retrieval (MIR) systems and algorithms [1] .  ... 
doi:10.1145/1277741.1277981 dblp:conf/sigir/JonesBDE07 fatcat:5bwyfnn7hjfurfras54cdt3ah4

Chord Recognition in Symbolic Music: A Segmental CRF Model, Segment-Level Features, and Comparative Evaluations on Classical and Popular Music

Kristen Masada, Razvan Bunescu
2019 Transactions of the International Society for Music Information Retrieval  
The new chord recognition model is evaluated extensively on three corpora of Western classical music and a newly created corpus of rock music.  ...  semi-CRF), this joint segmentation and labeling approach enables the use of a rich set of segment-level features, such as segment purity and chord coverage, that capture the extent to which the events in  ...  We would like to thank Bryan Pardo for sharing the KP Corpus and David Temperley for providing us with an updated version that fixed some of the labeling errors in the original KP corpus.  ... 
doi:10.5334/tismir.18 fatcat:myretuxuynbqbgr7fj6eno4oja

The MIREX grand challenge: A framework of holistic user-experience evaluation in music information retrieval

Xiao Hu, Jin Ha Lee, David Bainbridge, Kahyun Choi, Peter Organisciak, J. Stephen Downie
2015 Journal of the Association for Information Science and Technology  
There are two major limitations of such system-centered evaluation approaches: 1) the evaluation focuses on subtasks in music information retrieval but not entire systems; and 2) users and their interactions  ...  Music Information Retrieval (MIR) evaluation has traditionally focused upon system-centered approaches where components of MIR systems are evaluated against predefined datasets and golden answers (i.e.  ...  Acknowledgements We sincerely thank all the anonymous evaluators participating in the GC14UX , the authors of the participating systems, and the colleagues in the MIR community who kindly shared their  ... 
doi:10.1002/asi.23618 fatcat:6y34cd7jircmxal2tzotgxdqam

The TREC-like evaluation of music IR systems

J. Stephen Downie
2003 Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval - SIGIR '03  
This poster reports upon the ongoing efforts being made to establish TREC-like and other comprehensive evaluation paradigms within the Music IR (MIR) and Music Digital Library (MDL) research communities  ...  The proposed research tasks are based upon expert opinion garnered from members of the Information Retrieval (IR), MDL and MIR communities with regard to the construction and implementation of scientifically  ...  A formal resolution expressing this need was passed, 16 October 2001 by the attendees of the Second International Symposium on Music Information Retrieval (ISMIR 2001).  ... 
doi:10.1145/860435.860547 dblp:conf/sigir/Downie03 fatcat:rkodsdbojjfs3lqedm72ws52ca

The State of the Art Ten Years After a State of the Art: Future Research in Music Information Retrieval

Bob L. Sturm
2014 Journal of New Music Research  
The GTZAN dataset appears in at least 100 published works, and is the most-used public dataset for evaluation in machine listening research for music genre recognition (MGR).  ...  In this article, we disprove the claims that all MGR systems are affected in the same ways by these faults, and that the performances of MGR systems in GTZAN are still meaningfully comparable since they  ...  a "flagship application" of music information retrieval (MIR) (Aucouturier and Pampalk, 2008) .  ... 
doi:10.1080/09298215.2014.894533 fatcat:6763djkfs5cybgbehinfvwmp4u

Performance Evaluation of TreeQ and LVQ Classifiers for Music Information Retrieval [chapter]

Matina Charami, Rami Halloush, Sofia Tsekeridou
IFIP The International Federation for Information Processing  
In this paper, we aim to address this issue by conducting extensive experiments in a music information retrieval application, specifically with respect to music genre queries, in order to compare the performance  ...  Classification algorithms are gaining more and more importance in many fields such as Artificial Intelligence, Information Retrieval, Data Mining and Machine Vision.  ...  We will concentrate on content-based music information retrieval in the rest of the paper.  ... 
doi:10.1007/978-0-387-74161-1_36 dblp:conf/ifip12/CharamiHT07 fatcat:y7syhmxywja2jguhacalhwbcam

Fast Music Information Retrieval With Indirect Matching

Takahiro Hayashi, Nobuaki Ishii, Masato Yamaguchi
2014 Zenodo  
Publication in the conference proceedings of EUSIPCO, Lisbon, Portugal, 2014  ...  CONVENTIONAL MUSIC INFORMATION RETRIEVAL METHODS Music information retrieval methods can be classified into two types: tag-based retrieval and content-based retrieval.  ...  INTRODUCTION The rapid growth of digital audio music has generated a great deal of interest in effective ways of music information retrieval.  ... 
doi:10.5281/zenodo.44043 fatcat:q2zwdwvfiva3poliv34ugaouba

Information-Theoretic Measures Of Music Listening Behaviour

Daniel Boland, Roderick Murray-Smith
2014 Zenodo  
In an effort to address these failings, the Music Information Retrieval Evaluation Exchange (MIREX) was established [7] .  ...  In this work, we develop an information-theoretic approach to measuring users' music listening behaviour, with a view to informing the development of music retrieval systems.  ... 
doi:10.5281/zenodo.1416191 fatcat:umg2rg7eh5bgno277qey7vebfe

Music-to-knowledge (M2K)

J. Stephen Downie, Andreas F. Ehmann, David Tcheng
2005 Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval - SIGIR '05  
Special thanks to Joe Futrelle, Kris West and Paul Lamere for their assistance in making M2K a reality.  ...  INTRODUCTION This demonstration introduces the M2K (Music-to-Knowledge) music digital library (MDL) and music information retrieval (MIR) prototyping and evaluation environment to the information retrieval  ...  M2K plays a central role in the upcoming Music Information Retrieval Evaluation eXchange (MIREX) contest being held over the spring and summer of 2005.  ... 
doi:10.1145/1076034.1076188 dblp:conf/sigir/DownieET05 fatcat:kx3j4ix5evgwpksfeouhr2bdd4

MIR Evaluation Practices [article]

Marius Miron, Lorenzo Porcaro
2021 Zenodo  
Slides for the lesson on "MIR Evaluation Practices", prepared for the Music Information Retrieval course of the Master in Sound and Music Computing organized by the Music Technology Group (Universitat  ...  Evaluation in music information retrieval.  ...  Evaluation in music information retrieval.  ... 
doi:10.5281/zenodo.4611731 fatcat:t6hvgvqc3vekbhcyz45hfcwngq

Music Information Seeking Behaviour Poses Unique Challenges for the Design of Information Retrieval Systems

Cari Merkley
2010 Evidence Based Library and Information Practice  
involving mood classification conducted through MIREX, the Music Information Retrieval Evaluation Exchange, in 2007.  ...  Another potential implication for music information retrieval system development is a need to re-evaluate the terminology employed in testing to ensure that it is the language most often employed by users  ...  involving mood classification conducted through MIREX, the Music Information Retrieval Evaluation Exchange, in 2007.  ... 
doi:10.18438/b8t621 fatcat:xgmws2w6oneidd57a7rl2revea

Extension And Evaluation Of Interface "2D-Rib" For Impression-Based Retrieval

S. Kikuchi, Y. Hashimoto, T. Takayama, T. Ikeda, Y. Murata
2008 Zenodo  
In '2D-RIB', after a retrieval person selects a single basic music, the system visually shows some other music around the basic one along relative position.  ...  We implement them in different five combinations. According to an evaluation experiment, both of these two measures can contribute to the improvement.  ...  Method As in the paper [7] , after a subject has determined a music image that he/she should reach, he/she evaluates how much a retrieval result satisfies the image.  ... 
doi:10.5281/zenodo.1329068 fatcat:n5vrarfa3jd2fcy22dszlajpxu
« Previous Showing results 1 — 15 out of 60,960 results