11,891 Hits in 6.7 sec

Linking Sheet Music and Audio-Challenges and New Approaches

Verena Thomas, Christian Fremerey, Meinard Müller, Michael Clausen
In particular, we discuss the task of sheet music-audio synchronization 1 with the aim to link regions in images of scanned scores to musically corresponding sections in an audio recording of the same  ...  Score and audio files are the two most important ways to represent, convey, record, store, and experience music.  ...  We would like to express our gratitude to Maarten Grachten, Masataka Goto, and Markus Schedl for their helpful and constructive feedback.  ... 

Multimodal presentation and browsing of music

David Damm, Christian Fremerey, Frank Kurth, Meinard Müller, Michael Clausen
2008 Proceedings of the 10th international conference on Multimodal interfaces - IMCI '08  
Our system offers high quality audio playback with time-synchronous display of the digitized sheet music associated to a musical work.  ...  In particular, we concentrate on music documents of two widely used types for representing a musical work, namely visual music representation (scanned images of sheet music) and associated interpretations  ...  The Sheet Music Interface utilizes synchronization data which links image regions within the sheet music and time regions within the selected audio recording.  ... 
doi:10.1145/1452392.1452436 dblp:conf/icmi/DammFKMC08 fatcat:s2zk4qth7babpknzmisnmkw4h4

Multimodal Music Processing (Dagstuhl Seminar 11041)

Meinard Müller, Masataka Goto, Simon Dixon, Marc Herbstritt
2011 Dagstuhl Reports  
In the first contribution, Thomas et al. discuss the problem of automatically synchronizing two important types of music representations: sheet music and audio files.  ...  recordings, digitized images of scanned sheet music and album covers, and an increasing number of video clips of music performances and dances.  ... 
doi:10.4230/dagrep.1.1.68 dblp:journals/dagstuhl-reports/MullerGD11 fatcat:qpuvecey6jhgdmp344uujkmcja

Towards Linking the Lakh and IMSLP Datasets

TJ Tsai
2020 ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)  
Previous sheet-audio and sheet-MIDI alignment approaches have primarily focused on a 1-to-1 alignment task, which is not a scalable solution for retrieval from large databases.  ...  We propose a method for scalable cross-modal retrieval that might be used to link the Lakh MIDI dataset with IMSLP sheet music data.  ...  This approach has been explored in the context of online sheet music score following [15] , sheet music retrieval given an audio query [16] [13] [14] , and offline alignment of sheet music and audio  ... 
doi:10.1109/icassp40776.2020.9053815 dblp:conf/icassp/Tsai20 fatcat:bcprd7y6o5epxhuvm24q5sy2ty

A Multimodal Way of Experiencing and Exploring Music

Meinard Müller, Verena Konz, Michael Clausen, Sebastian Ewert, Christian Fremerey
2010 Interdisciplinary Science Reviews  
The challenge is to organize, understand, and search musical content in a robust, efficient, and intelligent manner.  ...  Significant digitization efforts have resulted in large multimodal music collections, which comprise music-related documents of various types and formats including text, symbolic data, audio, image, and  ...  Furthermore, spatio-temporal links between sheet music and audio data facilitate multimodal music interaction, where a user can exploit the benefits of each of the modalities to access music data in a  ... 
doi:10.1179/030801810x12723585301110 fatcat:v6rew66dtnahlf7fs5fdo7kv4y

Interactive Scores In Classical Music Production

Simon Waloschek, Axel Berndt, Benjamin W. Bohl, Aristotelis Hadjakos
2016 Zenodo  
and music information retrieval (audio-to-audio and audio-toscore alignment).  ...  Limitations become apparent when musical sections have to be recorded repeatedly, each take introducing new annotations until the paper sheet is overfull and hardly readable.  ... 
doi:10.5281/zenodo.1416709 fatcat:j6nlyxywwbhevay6o5thcyttbq

Interweaving and Enriching Digital Music Collections for Scholarship, Performance, and Enjoyment

David M. Weigl, Cynthia C. S. Liem, Álvaro Sarasúa, Marcel van Tilburg, Werner Goebl, Tim Crawford, Aggelos Gkiokas, Nicolas F. Gutierrez, Alastair Porter, Patricia Santos, Casper Karreman, Ingmar Vroomen
2019 6th International Conference on Digital Libraries for Musicology on - DLfM '19  
While each repository reveals rich information for scholarly investigation, the unified exploration and analysis of separate digital collections remains a challenge.  ...  The knowledge graph is exposed as Linked Data, adhering to the FAIR principles of making data Findable, Accessible, Interoperable, and Re-usable, and supporting further interlinking, re-interpretation  ...  -Study European heritage, memory, identity, integration and cultural interaction and translation, including its representations in cultural and scientific collections, archives and museums, to better inform  ... 
doi:10.1145/3358664.3358666 dblp:conf/dlfm/WeiglGCGGPSKVLS19 fatcat:es3itob5rrbtxkwwbswlmpxdqi

The PROBADO Project - Approach and Lessons Learned in Building a Digital Library System for Heterogeneous Non-textual Documents [chapter]

René Berndt, Ina Blümel, Michael Clausen, David Damm, Jürgen Diet, Dieter Fellner, Christian Fremerey, Reinhard Klein, Frank Krahl, Maximilian Scherer, Tobias Schreck, Irina Sens (+2 others)
2010 Lecture Notes in Computer Science  
In this paper, we review the overall goals, approaches taken, and lessons learned so far in a highly integrated effort of university researchers and library experts.  ...  While not limited in terms of supported document types, reference support is developed for classical digital music and 3D architectural models.  ...  The collection currently contains approx. 96,000 pages of sheet music and corresponding audio recordings from compact disks.  ... 
doi:10.1007/978-3-642-15464-5_37 fatcat:ke4hfbq7rbafpax365lhivobvu

CorpusVis: Visual Analysis of Digital Sheet Music Collections [article]

Matthias Miller, Julius Rauscher, Daniel A. Keim, Mennatallah El-Assady
2022 arXiv   pre-print
Manually investigating sheet music collections is challenging for music analysts due to the magnitude and complexity of underlying features, structures, and contextual information.  ...  The qualitative results show that CorpusVis supports users in performing exploratory and confirmatory analysis, leading them to new insights and findings.  ...  Based on initial expert feedback, we identified benefits and challenges of our approach.  ... 
arXiv:2203.12663v1 fatcat:twqowrwdyrehbg6vefeiivrpra

Learning Audio - Sheet Music Correspondences for Score Identification and Offline Alignment [article]

Matthias Dorfer, Andreas Arzt, Gerhard Widmer
2017 arXiv   pre-print
a music audio as a search query; and aligning an audio recording of a piece with the corresponding images of sheet music.  ...  multi-modal neural networks to be a fruitful paradigm for dealing with sheet music and audio at the same time.  ...  ACKNOWLEDGEMENTS This work is supported by the Austrian Ministries BMVIT and BMWFW, and the Province of Upper Austria via the COMET Center SCCH, and by the European Research Council (ERC Grant Agreement  ... 
arXiv:1707.09887v1 fatcat:tnftmt3ff5g2zgkb4jlcv5ovcy

Learning Audio-Sheet Music Correspondences For Score Identification And Offline Alignment

Matthias Dorfer, Andreas Arzt, Gerhard Widmer
2017 Zenodo  
Evaluation of Approach AUDIO-TO-SHEET-MUSIC ALIGNMENT As a second usage scenario for our approach we present the task of audio-to-sheet-music alignment.  ...  The next challenge will be to deal with real audio and real performances, with challenges such as asynchronous onsets, pedal, and varying dynamics.  ... 
doi:10.5281/zenodo.1417806 fatcat:ryjhfkdfxbdzddco34lhxv5hnu

Linked Data and Music: Current Projects and Opportunities

Elizabeth Joan Kelly
2016 Figshare  
This article describes Linked Data and the Semantic Web and summarizes current projects which utilize Linked Data to enhance online music collections.This is a post-print [post-peer review] version of  ...  Music collections have special considerations when it comes to indexing and information retrieval.  ...  Linked Data and Music: Current Projects Publishing Linked Open Data The Sheet Music Consortium (SMS) is a collaboration of several universities to digitally publish sheet music and metadata as inspired  ... 
doi:10.6084/m9.figshare.3206083.v1 fatcat:nccox2cgl5ewxlbnqwbbfuntgu

Bridging the Gap: Enriching YouTube Videos with Jazz Music Annotations

Stefan Balke, Christian Dittmar, Jakob Abeßer, Klaus Frieler, Martin Pfleiderer, Meinard Müller
2018 Frontiers in Digital Humanities  
First, we establish a link between the WJD annotations and corresponding YouTube videos employing existing retrieval techniques.  ...  Our web-based tools offer researchers and music lovers novel possibilities to interact with and navigate through the content.  ...  recordings or matching audio excerpt against sheet music representations).  ... 
doi:10.3389/fdigh.2018.00001 fatcat:4zxdnsjk6rc7plnqe6ei6uvpdi

Freischutz digital: A multimodal scenario for informed music processing

Meinard Muller, Thomas Pratzlich, Benjamin Bohl, Joachim Veit
2013 2013 14th International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS)  
In this paper, we give an overview of various informed approaches to music processing, where the availability of multiple sources of music-related information is used for supporting and improving the analysis  ...  For example, in the case of an opera there typically exist digitized versions of the libretto, different editions of the musical score, as well as a large number of performances given as audio and video  ...  For example, in SheetMusic-Audio synchronization the objective is to link regions (given as pixel coordinates) within the scanned images of a given sheet music representation to semantically corresponding  ... 
doi:10.1109/wiamis.2013.6616168 dblp:conf/wiamis/MullerPBV13 fatcat:4df323zvs5hzng2y6fuhr2zteu

Learning Audio–Sheet Music Correspondences for Cross-Modal Retrieval and Piece Identification

Matthias Dorfer, Jan Hajič jr., Andreas Arzt, Harald Frostel, Gerhard Widmer
2018 Transactions of the International Society for Music Information Retrieval  
All retrieval models are trained and evaluated on a new, large scale multimodal audio-sheet music dataset which is made publicly available along with this article.  ...  This work addresses the problem of matching musical audio directly to sheet music, without any higherlevel abstract representation.  ...  P103/12/G084 and Charles University Grant Agency grant no. 1444217.  ... 
doi:10.5334/timsir.12 fatcat:6ke27ryhkvhdhas6e6zoto2vni
« Previous Showing results 1 — 15 out of 11,891 results