56,287 Hits in 6.5 sec

An Attention Mechanism for Musical Instrument Recognition

Siddharth Gururani, Mohit Sharma, Alexander Lerch
2019 Zenodo  
., instrument presence or absence is annotated only for long snippets of a song. We explore an attention mechanism for handling weakly labeled data for multi-label instrument recognition.  ...  While the automatic recognition of musical instruments has seen significant progress, the task is still considered hard for music featuring multiple instruments as opposed to single instrument recordings  ...  "An Attention Mechanism for Musical Instrument Recognition", 20th International Society for Music Information Retrieval Conference, Delft, The Netherlands, 2019.  ... 
doi:10.5281/zenodo.3527746 fatcat:3k3s4bucdjcpzgmeoxqklkllq4

Attention-Based Predominant Instruments Recognition in Polyphonic Music

Lekshmi Reghunath, Rajeev Rajan
2021 Zenodo  
The experiments demonstrate the potential of CNN with attention mechanism on Mel-spectro/modgdgram fusion framework for the task of predominant instrument recognition.  ...  Convolutional neural networks (CNN) with an attention mechanism, learn the distinctive local characteristics and classify the instrument to the group where it belongs.  ...  Acknowledgments The first author would like to acknowledge the CERD of APJ Abdul Kalam Technological University, Trivandrum, Kerala, India for providing a Ph.D. fellowship.  ... 
doi:10.5281/zenodo.5043841 fatcat:ko7bji5dpjavre3vmwqsv2pqnu

Recognition and Classification Model of Music Genres and Chinese Traditional Musical Instruments Based on Deep Neural Networks

Ke Xu, Shah Nazir
2021 Scientific Programming  
The teaching of ideological and political theory courses and daily ideological and political education are two important parts of education for college students.  ...  Some universities have developed new paths in the teaching model, but they have not considered the evaluation module and paid little attention to their own development.  ...  At the same time, for the recognition and classification of musical instruments, this study proposes a Chinese traditional musical instrument recognition and classification algorithm based on the deep  ... 
doi:10.1155/2021/2348494 fatcat:flt72o35ujbjdhmygdziifivee

Visual Attention for Musical Instrument Recognition [article]

Karn Watcharasupat, Siddharth Gururani, Alexander Lerch
2020 arXiv   pre-print
In this project, we further explore the use of attention mechanism in a timbral-temporal sense, \'a la visual attention, to improve the performance of musical instrument recognition using weakly-labeled  ...  The first approach applies attention mechanism to the sliding-window paradigm, where a prediction based on each timbral-temporal 'instance' is given an attention weight, before aggregation to produce the  ...  Recently, an open, moderately-sized dataset for multiple instrument recognition, OpenMIC-2018, was released [2] .  ... 
arXiv:2006.09640v2 fatcat:cwtyxoszdjfungn3hx7cemnao4

Transformer-based ensemble method for multiple predominant instruments recognition in polyphonic music

Lekshmi Chandrika Reghunath, Rajeev Rajan
2022 EURASIP Journal on Audio, Speech, and Music Processing  
AbstractMultiple predominant instrument recognition in polyphonic music is addressed using decision level fusion of three transformer-based architectures on an ensemble of visual representations.  ...  We train our networks from fixed-length music excerpts with a single-labeled predominant instrument and estimate an arbitrary number of predominant instruments from the variable-length test audio file  ...  Bosch, Ferdinand Fuhrmann, and Perfecto Herrera ( Music Technology Group -Universitat Pompeu Fabra) for developing the IRMAS dataset and making it publicly available.  ... 
doi:10.1186/s13636-022-00245-8 fatcat:nvlrbz2y3new7mwquafljfxyie

Omnizart: A General Toolbox for Automatic Music Transcription

Yu-Te Wu, Yin-Jyun Luo, Tsung-Ping Chen, I-Chieh Wei, Jui-Yang Hsu, Yi-Chin Chuang, Li Su
2021 Journal of Open Source Software  
To the best of our knowledge, Omnizart is the first toolkit that offers transcription models for various music content including piano solo, instrument ensembles, percussion and vocal.  ...  Omnizart also supports models for chord recognition and beat/downbeat tracking, which are highly related to AMT.  ...  Drum transcription The model for drum transcription is a re-implementation of Wei et al. (2021) . Building blocks of the network include convolutional layers and the attention mechanism.  ... 
doi:10.21105/joss.03391 fatcat:2fhd33kserfxfbc7h2ctge4bpy

Learning Multi-instrument Classification with Partial Labels [article]

Amir Kenarsari Anhari
2020 arXiv   pre-print
Multi-instrument recognition is the task of predicting the presence or absence of different instruments within an audio clip.  ...  The dataset is also partially labeled, in that only a subset of instruments are labeled for each clip.  ...  is proposed for multi-instrument recognition that attends more towards harder instruments. • The impact of different data augmentation mechanisms on multi-instrument recognition is studied.  ... 
arXiv:2001.08864v1 fatcat:b6thuwjt5vbvfmc5hb5wcmftwa

A neurobiological strategy for exploring links between emotion recognition in music and speech

Aniruddh D. Patel
2008 Behavioral and Brain Sciences  
Are the neural systems involved in recognizing affective prosody in language also used for emotion recognition in instrumental music?  ...  Music perception in RAA is totally unexplored and could provide a powerful way to test the idea that we perceive music as a kind of emotional voice.  ...  Acknowledgment Supported by Neurosciences Research Foundation as part of its program on music and the brain at The Neurosciences Institute, where ADP is the Esther J. Burnham Senior Fellow.  ... 
doi:10.1017/s0140525x0800544x fatcat:tpbk7g4u6bat5dyk2pga4k3eju

Timbre Classification of Musical Instruments with a Deep Learning Multi-Head Attention-Based Model [article]

Carlos Hernandez-Olivan, Jose R. Beltran
2021 arXiv   pre-print
The network employed uses a multi-head attention mechanism, with 8 heads and a dense network at the output taking as input the log-mel magnitude spectrograms of the sound samples.  ...  For this purpose, we have worked with classical orchestral instruments played with different dynamics, which are part of a few instrument families and which play notes in the same pitch range.  ...  New approaches for multi-label instrument recognition uses the attention mechanism in order to predict the presence of instruments in weakly labeled datasets [29] .  ... 
arXiv:2107.06231v1 fatcat:zkko4yzyfffbpleqjyusp226zi

Omnizart: A General Toolbox for Automatic Music Transcription [article]

Yu-Te Wu, Yin-Jyun Luo, Tsung-Ping Chen, I-Chieh Wei, Jui-Yang Hsu, Yi-Chin Chuang, Li Su
2021 arXiv   pre-print
, as well as models for chord recognition and beat/downbeat tracking, two music information retrieval (MIR) tasks highly related to AMT.  ...  To the best of our knowledge, Omnizart is the first transcription toolkit which offers models covering a wide class of instruments ranging from solo, instrument ensembles, percussion instruments to vocal  ...  The model is mainly based on a two-layer bidirectional LSTM (BLSTM) recurrent neural network (RNN) with an optional attention mechanism and a fully-connected layer.  ... 
arXiv:2106.00497v1 fatcat:v64n4z6ygjfh7gfjq2uut4wdva

Music Signal Recognition Based on the Mathematical and Physical Equation Inversion Method

Wei Jiang, Dong Sun, Miaochao Chen
2021 Advances in Mathematical Physics  
The attention network-based classification model draws on the properties of human auditory attention to improve the recognition scores of the main playing instruments and the overall recognition accuracy  ...  the music score recognition.  ...  The baseline model demonstrates the effectiveness of pitch features in music recognition; the attention mechanism has been widely used in computer vision, and we apply it to the "auditory" attention of  ... 
doi:10.1155/2021/3148747 fatcat:lbv7zxdsqbda3idxv4szawdwi4

Recognition of musical beat and style and applications in interactive humanoid robot

Yue Chu
2022 Frontiers in Neurorobotics  
On this basis, a note beat recognition method combining attention mechanism (AM) and independent RNN (IndRNN) [AM-IndRNN] is proposed.  ...  Therefore, the AM-optimized LSTM model has gained a higher recognition accuracy. The research results provide specific ideas for applying DL technology in musical beat and style recognition.  ...  The innovative combination of independent recurrent neural network (RNN) and attention mechanism (AM) is used for music style recognition, and the data are transferred to the multi-attention CNN and long-short  ... 
doi:10.3389/fnbot.2022.875058 pmid:35990882 pmcid:PMC9386054 fatcat:yhdcvlbmynbirn6fouwjqexwzm

Musical B-boying: A Wearable Musical Instrument by Dancing [chapter]

Minoru Fujimoto, Naotaka Fujita, Yoshinari Takegawa, Tsutomu Terada, Masahiko Tsukamoto
2008 Lecture Notes in Computer Science  
Advances in computer technologies have enabled new means of musical expression with motion enabled musical instruments, which have attracted a great deal of attention.  ...  We used an implemented prototype on stage, and we found that dancers were able to control the music flexibly while b-boying.  ...  Actual use of the system on stage revealed that dancers could effectively make music. In the future, we will create an algorithm with high recognition accuracy.  ... 
doi:10.1007/978-3-540-89222-9_17 fatcat:pqnmuixzd5gw7ksyb74ec2d7mm

Research on Music Classification Technology Based on Deep Learning

Fang Zhang, Jian Su
2021 Security and Communication Networks  
In this paper, we propose a MC method based on deep learning to improve feature extraction and classifier design based on MIDI (musical instrument digital interface) MC task.  ...  Considering that the existing classification technology is limited by the shallow structure, it is difficult for the classifier to learn the time sequence and semantic information of music; this paper  ...  MIDI (musical instrument digital interface ) is an important digital music format, widely used in music creation and education. MIDI is a general format standard.  ... 
doi:10.1155/2021/7182143 fatcat:cdbxfuccrfgwvdo2v5ka5xk65i

An Automatic Mechanism to Recognize and Generate Emotional MIDI Sound Arts Based on Affective Computing Techniques

Hao-Chiang Koong Lin, Cong Jie Sun, Bei Ni Su, Zu An Lin
2013 International Journal of Online Pedagogy and Course Design  
The results of this study are as follows: (1) The authors design a corresponding mechanism of music tone and human emotion recognition.  ...  Musicality. (4) The authors Assess and complete the emotion discrimination mechanism of how mood music can feedback accurately.  ...  The type of emerging performance makes us to think: When users played MIDI instruments, the data produced by affective computing may touch the automatic music mechanism and then to play the corresponding  ... 
doi:10.4018/ijopcd.2013070104 fatcat:u574qnmdvfcxfni737etnbplum
« Previous Showing results 1 — 15 out of 56,287 results