22,734 Hits in 4.3 sec

Visualization in Audio-Based Music Information Retrieval

Matthew Cooper, Jonathan Foote, Elias Pampalk, George Tzanetakis
2006 Computer Music Journal  
The main goal of this article is to provide an overview of visualization techniques developed in the context of music information retrieval for representing polyphonic audio signals.  ...  Music information retrieval (MIR) is an emerging research area that explores how music stored digitally can be effectively organized, searched, retrieved, and browsed.  ... 
doi:10.1162/comj.2006.30.2.42 fatcat:d64hj5xhgfhepe4ueffhpwinfq

Automatic music video summarization based on audio-visual-text analysis and alignment

Changsheng Xu, Xi Shao, Namunu C. Maddage, Mohan S. Kankanhalli
2005 Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval - SIGIR '05  
In this paper, we propose a novel approach for automatic music video summarization based on audio-visual-text analysis and alignment. The music video is separated into the music and video tracks.  ...  For the music track, the chorus is detected based on music structure analysis.  ...  The proposed method automatically extracts the metadata from low-level audio/visual/text features and music knowledge instead of assuming the availability of these metadata as in [12, 13] .  ... 
doi:10.1145/1076034.1076097 dblp:conf/sigir/XuSMK05 fatcat:cztem66jfvci7mog35q3drxiwu

A Picture is Worth a Thousand Songs

Alexander Schindler
2014 Proceedings of the 1st International Workshop on Digital Libraries for Musicology - DLfM '14  
Modeling music similarities based on such criteria is in many cases problematic or visionary.  ...  visual domain.  ...  Shot editing of music video can serve as valuable information in cases where audio based approaches fail.  ... 
doi:10.1145/2660168.2660185 dblp:conf/jcdl/Schindler14 fatcat:5hoblranurhy5hhku6klcq3ksy

Audio-Visual Embedding for Cross-Modal MusicVideo Retrieval through Supervised Deep CCA [article]

Donghuo Zeng, Yi Yu, Keizo Oyama
2019 arXiv   pre-print
Music video retrieval by given musical audio is a natural way to search and interact with music contents. In this work, we study cross-modal music video retrieval in terms of emotion similarity.  ...  The contribution of our approach is mainly manifested in the two aspects: i) We propose to select top k audio chunks by attention-based Long Short-Term Memory (LSTM)model, which can represent good audio  ...  This space links audio chunks and visual feature in terms of emotion, and enables us to implement cross-modal music video retrieval based on emotion similarity.  ... 
arXiv:1908.03744v1 fatcat:2l2vdm7a7zatvdbk6ja2tfdmqi

A content-based system for music recommendation and visualization of user preferences working on semantic notions

Dmitry Bogdanov, Martin Haro, Ferdinand Fuhrmann
2011 2011 9th International Workshop on Content-Based Multimedia Indexing (CBMI)  
Using these services, the system retrieves a set of tracks preferred by a user, and further computes a semantic description of musical preferences based on raw audio information.  ...  In particular, contentbased preference elicitation for music recommendation is a challenging problem that is effectively addressed in this paper.  ...  Here, content-based information extracted from audio can help to overcome this problem [6, 1] . In this work, we present a system for music recommendation and visualization of user preferences.  ... 
doi:10.1109/cbmi.2011.5972554 dblp:conf/cbmi/BogdanovHFXGH11 fatcat:qyardjwo2jcxhf5ddov44ifo4u

An Audio-Visual Approach to Music Genre Classification through Affective Color Features [chapter]

Alexander Schindler, Andreas Rauber
2015 Lecture Notes in Computer Science  
This paper presents a study on classifying music by affective visual information extracted from music videos. The proposed audio-visual approach analyzes genre specific utilization of color.  ...  The evaluation of the presented color features is based on comparative classification experiments on the newly introduced 'Music Video Dataset'.  ...  Conclusions and Future Work We presented a comparative evaluation of audio-visual music classification that focused on the color information of music videos.  ... 
doi:10.1007/978-3-319-16354-3_8 fatcat:u6kmlzyptnhu7ipksxsnwroviy

Content-Based Information Retrieval and Digital Libraries

Gary (Gang) Wan, Zao Liu
2008 Information Technology and Libraries  
This paper discusses the applications and importance of content-based information retrieval technology in digital libraries.  ...  Content-based information retrieval has been shown to be an effective way to search for the type of multimedia documents that are increasingly stored in digital libraries.  ...  By using the content-based audio retrieval system, the patron can get similar audio clips with detailed information from a digital music library, and then listen to them to find an exact match.  ... 
doi:10.6017/ital.v27i1.3262 fatcat:i2vcfkeewbge7dxg5jelkvzv7y

Multimodal Music Processing (Dagstuhl Seminar 11041)

Meinard Müller, Masataka Goto, Simon Dixon, Marc Herbstritt
2011 Dagstuhl Reports  
of research in multimodal music processing and music information retrieval.  ...  For example, the authors show how visual cues can be used to support audio-based drum transcription.  ... 
doi:10.4230/dagrep.1.1.68 dblp:journals/dagstuhl-reports/MullerGD11 fatcat:qpuvecey6jhgdmp344uujkmcja

Trial Realization of Human-Centered Multimedia Navigation for Video Retrieval

Miki Haseyama, Takahiro Ogawa
2013 International Journal of Human-Computer Interaction  
A trial realization of human-centered navigation for video retrieval is presented in this paper.  ...  consists of the following functions: (i) multi-modal analysis for collaborative use of multimedia data, (ii) preference extraction for the system to adapt to users' individual demands, and (iii) adaptive visualization  ...  Part 2: Distance calculation based on audio-visual features In the second part, distances based on audio-visual features between two scenes are calculated.  ... 
doi:10.1080/10447318.2012.692316 fatcat:tkqkf5qzjbc4lpwhcz6n3ozejm

Musical Instrument Recognition in User-generated Videos using a Multimodal Convolutional Neural Network Architecture

Olga Slizovskaia, Emilia Gómez, Gloria Haro
2017 Proceedings of the 2017 ACM on International Conference on Multimedia Retrieval - ICMR '17  
CCS CONCEPTS •Information systems → Multimedia and multimodal retrieval; Music retrieval; •Computing methodologies → Neural networks; Visual content-based indexing and retrieval; KEYWORDS multimodal musical  ...  Our approach does not only focus on the analysis of audio information, but we exploit the multimodal information embedded in the audio and visual domains.  ...  Musical instrument recognition is a well-known problem in the music information retrieval (MIR) eld.  ... 
doi:10.1145/3078971.3079002 dblp:conf/mir/SlizovskaiaGH17 fatcat:obngh3odxzai7jhwoslsiedh7a

Multimedia information retrieval

Markus Schedl, Emilia Gómez, Masataka Goto
2013 Proceedings of the 21st ACM international conference on Multimedia - MM '13  
In addition, we provide links to existing software packages and toolboxes for music content-and music context-based feature extraction, similarity computation, knowledge discovery, and music visualization  ...  The music content refers to features extracted from the audio signal, while information about musical entities not encoded in the signal (e.g., image of an artist or political background of a song) are  ... 
doi:10.1145/2502081.2502237 dblp:conf/mm/SchedlGG13 fatcat:korpleagovgrhjcnjq2cz3q6qu

Deep Learning for MIR Tutorial [article]

Alexander Schindler, Thomas Lidy, Sebastian Böck
2020 arXiv   pre-print
Deep Learning has become state of the art in visual computing and continuously emerges into the Music Information Retrieval (MIR) and audio retrieval domain.  ...  Siamese Networks have been shown effective in learning audio representations and distance functions specific for music similarity retrieval.  ...  MOTIVATION AND FORMAT Deep Learning has become state of the art in visual computing and continuously emerges into the Music Information Retrieval (MIR) and audio retrieval domain.  ... 
arXiv:2001.05266v1 fatcat:rzkfk5wn5fasxd7tynyi3eu4iq

Audio-based queries for video retrieval over Java enabled mobile devices

Iftikhar Ahmad, Faouzi Alaya Cheikh, Serkan Kiranyaz, Moncef Gabbouj, Reiner Creutzburg, Jarmo H. Takala, Chang Wen Chen
2006 Multimedia on Mobile Devices II  
In this paper we propose a generic framework for efficient retrieval of audiovisual media based on its audio content.  ...  Therefore, the primary objective of this framework is to provide an adaptive basis for performing efficient video retrieval operations based on the audio content and types (i.e. speech, music, fuzzy and  ...  Audio-based Indexing and Retrieval for Video Databases Audio information often plays an important role in understanding the content of digital media and in certain cases; audio might even be the only source  ... 
doi:10.1117/12.642756 fatcat:6t62ajirg5hntaehr6v4unghky

Generic content-based audio indexing and retrieval framework

S. Kiranyaz, M. Gabbouj
2006 IEE Proceedings - Vision Image and Signal Processing  
Moreover, from the content-based multimedia retrieval point of view the audio information can be even more important than the visual part since it is mostly unique and significantly stable within the entire  ...  Furthermore the proposed framework is designed based on the high-level content classification and segmentation in order to improve the speed and accuracy of the aural retrievals.  ...  AUDIO INDEXING AND RETRIEVAL FRAMEWORK IN MUVIS Audio is an important source of information for content-based multimedia indexing and retrieval and it can sometimes be even more important then the visual  ... 
doi:10.1049/ip-vis:20050063 fatcat:33k67wkberci7iebjtj7hrbycu

Music Information Retrieval in Live Coding: A Theoretical Framework

Anna Xambó, Alexander Lerch, Jason Freeman
2019 Computer Music Journal  
Music information retrieval (MIR) has a great potential in musical live coding because it can help the musician–programmer to make musical decisions based on audio content analysis and explore new sonorities  ...  We found that it is still a technical challenge to use high-level features in real time, yet using rhythmic and tonal properties (midlevel features) in combination with text-based information (e.g., tags  ...  Technology, and Women in Music Tech.  ... 
doi:10.1162/comj_a_00484 fatcat:m5s4sdzfmfddjgwplmy7k6gtr4
« Previous Showing results 1 — 15 out of 22,734 results